20 redirections exceeded. failure (2048)

[Anna]

Hey,

I installed all polymer packages with all extensions.

When running the code
./polymer_cli.py 'S2B_MSIL1C_20220615T101559_N0400_R065_T32UQA_20220615T122549.SAFE/GRANULE/L1C_T32UQA_A027547_20220615T102248' 'test.hdf'

I get the following error

/home/micha/anaconda3/envs/polymer/lib/python3.8/site-packages/scipy/__init__.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.23.1
warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
Starting processing at 2022-08-18 22:12:43.863314
Initialize MSI projection EPSG:32632
/home/micha/anaconda3/envs/polymer/lib/python3.8/site-packages/pyproj/crs/crs.py:130: FutureWarning: '+init=<authority>:<code>' syntax is deprecated. '<authority>:<code>' is the preferred initialization method. When making the change, be mindful of axis order changes: https://pyproj4.github.io/pyproj/stable ... -in-proj-6
in_crs_string = _prepare_from_proj_string(in_crs_string)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MI_24h.hdf ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MI_24h.hdf ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... OAST.OZONE ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... TOVS.OZONE ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... 1_f015.hdf ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... 1_f012.hdf ...
20 redirections exceeded.
failure (2048)
Traceback (most recent call last):
File "./polymer_cli.py", line 34, in <module>
run_atm_corr(Level1(args.input_file),
File "/home/micha/anaconda3/envs/polymer/polymer/main.py", line 496, in run_atm_corr
with level2 as l2, level1 as l1:
File "/home/micha/anaconda3/envs/polymer/polymer/level1.py", line 113, in __enter__
self.level1 = L1(self.filename, **self.kwargs)
File "/home/micha/anaconda3/envs/polymer/polymer/level1_msi.py", line 151, in __init__
self.init_ancillary()
File "/home/micha/anaconda3/envs/polymer/polymer/level1_msi.py", line 180, in init_ancillary
self.ozone = self.ancillary.get('ozone', self.date)
File "/home/micha/anaconda3/envs/polymer/polymer/ancillary.py", line 272, in get
if len(res) > 1:
TypeError: object of type 'NoneType' has no len()


I already thought of using ERA5 Ancillary Data, but I have no clue where to change this.

I am using Polymer for the first time and installed it strictly from the Readme file.
My Linux is Ubuntu 22.04

Is there anyone who could help me?

[avea]

Hello!

I have the same problem processing S2 MSI image. What could possibly be wrong?

Thanks in advance
Ave

[fsteinmetz]

Hello,
Did you add your earthdata credentials to your ~/.netrc file following https://wiki.earthdata.nasa.gov/display ... L+And+Wget ?
I don't see what coud be wrong, I don't reproduce this error.
Cheers, François

[avea]

Thank you for your relpy!
Yes, I followed the instructions

echo "machine urs.earthdata.nasa.gov login USERNAME password PASSWD" > ~/.netrc ; > ~/.urs_cookies
chmod 0600 ~/.netrc

but I still get the same 20 redirections exceeded. failure (2048).
Is it possible to check somehow, is everything okay with login?

product_paths
['/mnt/e/ave/proov_poly/S2A_MSIL1C_20170830T093031_N0205_R136_T35VME_20170830T093331.SAFE']
2023-04-14T11:43:31.771783 Processing product /mnt/e/ave/proov_poly/S2A_MSIL1C_20170830T093031_N0205_R136_T35VME_20170830T093331.SAFE
basename S2A_MSIL1C_20170830T093031_N0205_R136_T35VME_20170830T093331
input_folder /mnt/e/ave/proov_poly
granule_output_folder /mnt/e/ave/proov_poly/polymer_out_S2A_MSIL1C_20170830T093031_N0205_R136_T35VME_20170830T093331.SAFE
2023-04-14T11:43:31.773662 Processing granule /mnt/e/ave/proov_poly/S2A_MSIL1C_20170830T093031_N0205_R136_T35VME_20170830T093331.SAFE/GRANULE/L1C_T35VME_A011430_20170830T093331
Initialize MSI projection EPSG:32635
/home/krista/anaconda3/envs/polymer/lib/python3.8/site-packages/pyproj/crs/crs.py:141: FutureWarning: '+init=<authority>:<code>' syntax is deprecated. '<authority>:<code>' is the preferred initialization method. When making the change, be mindful of axis order changes: https://pyproj4.github.io/pyproj/stable ... -in-proj-6
in_crs_string = _prepare_from_proj_string(in_crs_string)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MET.NRT.nc ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MET.NRT.nc ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MI_24h.hdf ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MI_24h.hdf ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... OAST.OZONE ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... TOVS.OZONE ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... 1_f015.hdf ...
20 redirections exceeded.
failure (2048)
Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... 1_f012.hdf ...
20 redirections exceeded.
failure (2048)
object of type 'NoneType' has no len()
2023-04-14T11:45:02.115654 1/1 granule done
2023-04-14T11:45:02.115728 1/1 product done

[fsteinmetz]

Ok thanks for confirming, but I currently don't know what to advise, this error is from wget so there might be some network issue...
What you could do as a workaround is use the ERA5 ancillary data, which uses a completely different download system.
For that, import the Ancillary_ERA5 class from the ancillary_era5 module and pass an instance to the level1 object: Level1_MSI(..., ancillary=Ancillary_ERA5())
I hope this helps,
Cheers, François

[avea]

The problem was connected with 'approved applications' in Earthdata account. I authorized several applications such as sentinel data etc and it started to work. However, I got ERROR 404, but the processing was still excecuted. As I didn't know, did it affect the processing I used ERA5 ancillary data instead and everything works fine now.

Thank you for your help