Page 1 of 1

Webpage error

Posted: Tue May 25, 2021 1:38 pm
by dingky
Hello everyone,


When I process Landsat8 data, I need to download the file https://oceandata.sci.gsfc.nasa.gov/ob/ ... TOVS.OZONE. When I open this webpage, an error message as shown in the figure below appears. How to solve this problem.




ding

Re: Webpage error

Posted: Wed May 26, 2021 2:59 pm
by fsteinmetz
Hi Ding,
This file does not seem to be present on the server : https://oceandata.sci.gsfc.nasa.gov/Anc ... /2019/254/
But Polymer's script should automatically download the "best" available file for you.
Cheers,
François

Re: Webpage error

Posted: Wed May 26, 2021 3:47 pm
by gbourdin
Hi Francois,
I have the same problem downloading ancillary data.
It happens with several types of ancillary data depending the image:

Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... TOVS.OZONE ...
https://oceandata.sci.gsfc.nasa.gov/ob/ ... TOVS.OZONE:
2021-05-26 11:19:17 ERROR 404: Not Found.
failure (2048)

Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MI_24h.hdf ...
https://oceandata.sci.gsfc.nasa.gov/ob/ ... MI_24h.hdf:
2021-05-26 11:19:01 ERROR 404: Not Found.
failure (2048)

Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi ... MI_24h.hdf ...
https://oceandata.sci.gsfc.nasa.gov/ob/ ... MI_24h.hdf:
2021-05-26 11:18:40 ERROR 404: Not Found.
failure (2048)

And it seems to make polymer crash after all.
It happens for about 1% of my images but still annoying to lose some data.

Cheers,
Guillaume

Re: Webpage error

Posted: Tue Jun 01, 2021 1:31 pm
by fsteinmetz
Hi Guillaume,

I'd have to investigate why those requests are failing. Which file are you trying to process ? It seems that no valid ancillary file could be downloaded.
In the meantime, I can recommend to use ECMWF Era5 ancillary data source instead, which should anyway be a more consistent data source.
Please see the dedicated short section 2.2.3 in the README.md.
Cheers,
François

Re: Webpage error

Posted: Tue Jul 06, 2021 6:20 pm
by gbourdin
Hi François,
Sorry for the late answer I was busy on other things.
I was trying to process several images, here are few examples that failed when trying to download ancillary data:
A2018051010500.L1C_LAC_OC.nc
A2016161013500.L1C_LAC_OC.nc
A2016074013500.L1C_LAC_OC.nc
T2018144223500.L1C_LAC_OC.nc
T2017170220000.L1C_LAC_OC.nc
T2017080213000.L1C_LAC_OC.nc

I just tried with ERA5, the ancillary data download seems to work now but it is giving me an 'unknown error'.
The two VIIRS were already giving me an 'unknown error'.
V2017090010000.L1C_SNPP_OC.nc
V2017282010000.L1C_SNPP_OC.nc

So I think some of my files I downloaded are corrupted, I will try to reprocess those files.
Best,
Guillaume