Search found 24 matches

by gbourdin
Wed Mar 09, 2022 3:27 pm
Forum: Support
Topic: ERROR:cdsapi:Reason: Request returned no data
Replies: 3
Views: 3349

ERROR:cdsapi:Reason: Request returned no data

Hi François, It seems cdapi in polymer can't find any ancillary data on ERA5 for some NASA satellites in some rare cases: MODISA: 8 out of 931 images MODIST: 4 out of 985 images VIIRSN: 8 of 1165 images VIIRSJ1: 3 of 431 images I am subsetting each image to only process a 20x20 pixels zone to save c...
by gbourdin
Mon Jan 31, 2022 10:53 pm
Forum: Support
Topic: Near real time and ancillary data
Replies: 4
Views: 3364

Re: Near real time and ancillary data

Great! I will test it, thank you,
Guillaume
by gbourdin
Tue Jan 18, 2022 8:04 pm
Forum: Support
Topic: Near real time and ancillary data
Replies: 4
Views: 3364

Re: Near real time and ancillary data

Hello François, Yes I think this is because there is no ancillary available. Do you know what is the delay for ERA5? I managed to get it working with NASA ancillary data with a 3 days delay, but there is several images every day that are not processed due to inconsistent ancillary data (which doesn'...
by gbourdin
Mon Oct 25, 2021 4:27 pm
Forum: Support
Topic: Near real time and ancillary data
Replies: 4
Views: 3364

Near real time and ancillary data

Hello François, I am trying to process data from several satellites in near real-time. You said in a previous post that the ancillary data from ERA5 is more reliable when I had issues running polymer using the NASA ancillary data. Polymer is indeed running smoothly on thousands of images using ERA5 ...
by gbourdin
Mon Sep 20, 2021 6:56 pm
Forum: Support
Topic: OSError: [Errno 24] Too many open files:
Replies: 2
Views: 4370

Re: OSError: [Errno 24] Too many open files:

I was already using a function that processes single files but you were right it was due to garbage references I was creating doing my subsets. Solved now thank you!
Cheers,
Guillaume
by gbourdin
Mon Aug 30, 2021 5:28 pm
Forum: Support
Topic: OSError: [Errno 24] Too many open files:
Replies: 2
Views: 4370

OSError: [Errno 24] Too many open files:

Hello François, I get an error when I try to batch process thousands of images, subsetting them beforehand. There number of files opened reaches the limit set for the operating system (which is currently 1024). I will increase it to 4096 to see what it does but I was wondering in the meantime, if th...
by gbourdin
Tue Jul 06, 2021 6:20 pm
Forum: Support
Topic: Webpage error
Replies: 4
Views: 3889

Re: Webpage error

Hi François, Sorry for the late answer I was busy on other things. I was trying to process several images, here are few examples that failed when trying to download ancillary data: A2018051010500.L1C_LAC_OC.nc A2016161013500.L1C_LAC_OC.nc A2016074013500.L1C_LAC_OC.nc T2018144223500.L1C_LAC_OC.nc T20...
by gbourdin
Wed May 26, 2021 3:47 pm
Forum: Support
Topic: Webpage error
Replies: 4
Views: 3889

Re: Webpage error

Hi Francois, I have the same problem downloading ancillary data. It happens with several types of ancillary data depending the image: Trying to download https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S19700010000123_TOVS.OZONE ... https://oceandata.sci.gsfc.nasa.gov/ob/getfile/S19700010000123_TOVS....
by gbourdin
Tue Feb 16, 2021 9:29 pm
Forum: Support
Topic: NetCDF: HDF error when processing MODIST and VIIRSN
Replies: 4
Views: 3607

Re: NetCDF: HDF error when processing MODIST and VIIRSN

Hi François, As I said before some of my L1C images were corrupted and I could reprocess some, but there is still about 10% of VIIRS and MODIST images that are giving me another error. Here an example with a VIIRS-SNPP image: Starting processing at 2021-02-16 16:09:16.426121 Initializing output file...
by gbourdin
Mon Feb 08, 2021 11:18 pm
Forum: Support
Topic: NetCDF: HDF error when processing MODIST and VIIRSN
Replies: 4
Views: 3607

Re: NetCDF: HDF error when processing MODIST and VIIRSN

I think I found the problem, some of my L1C files are corrupted, even though I could read them without problem with matlab ...