Change in Earthdata API

[gbourdin]

Hello Nathan,
Is it possible to have access to this release quickly?
I am having the same problem to process near real time data and need to fix it as soon as possible to send data for two cruises currently at sea.
Best,
Guillaume

[mfestuary]

I am also having problems processing Sentinel2a tiles. I successfully used Polymer in the past to process hundreds of tiles, but now when I use the same scripts to process new tiles I am getting an error downloading the necessary ancillary data. Instead of getting the proper hdf file, I get an html document with the error: "403 Forbidden...". I verified that my credentials for urs.earthdata.nasa.gov are up to date and allow me to login to their website.

This issue has been raised on the Earthdata Forum: https://forum.earthdata.nasa.gov/viewtopic.php?t=4750

One answer that was given in the above thread is: "The NCEPR2 and AURAOMI have been replaced with GMAO MERRA2 ancillary MET files. Update your code to use these instead."

Based on this info, it seems like the Polymer code needs to be updated to reflect the changes in the ancillary data that nasa is providing.

Thanks...

-M

[fsteinmetz]

Dear all,
Apologies for the delay on this update.
The latest release v4.17beta2 should fix this issue (see viewtopic.php?f=5&t=235)
Kind regards,
François

[mfestuary]

Thanks you for the update!

Even with the new beta version I am still getting errors related to the ancillary data when processing Sentinel2A tiles. For example, Polymer tries to download this file:

https://oceandata.sci.gsfc.nasa.gov/cgi ... MET.NRT.nc

but what comes back is some HTML indicating a 404 error. I am not sure if the problem is with the Earthdata API, or if Polymer is trying to download something that Earthdata no longer supports.

Any ideas?

Thanks!

[mfestuary]

Thanks you for the update!

Even with the new beta version I am still getting errors related to the ancillary data when processing Sentinel2A tiles. For example, Polymer tries to download this file:

https://oceandata.sci.gsfc.nasa.gov/cgi ... MET.NRT.nc

but what comes back is some HTML indicating a 404 error. I am not sure if the problem is with the Earthdata API, or if Polymer is trying to download something that Earthdata no longer supports.

Any ideas?

Thanks!

I was able to get it working by hacking ancillary.py as mentioned in this thread: viewtopic.php?f=7&t=211&sid=cdf70904cd6 ... db18a3407f.

Namely, "changing lines 29 and 37 of ancillary.py to read

lambda date: [('GMAO_MERRA2.%Y%m%dT%H0000.MET.nc', d)

instead of

lambda date: [('GMAO_FP.%Y%m%dT%H0000.MET.NRT.nc', d)"

[fsteinmetz]

Hello,
This issue should now be solved on the latest version of Polymer, now available on github.
https://github.com/hygeos/polymer
Kind regards