Search found 17 matches

by gbourdin
Mon Apr 11, 2022 2:58 pm
Forum: Support
Topic: output nLw using POLYMER
Replies: 1
Views: 116

output nLw using POLYMER

Hi all,
Is there any way to output nLw using POLYMER?
Best,
Guillaume
by gbourdin
Fri Apr 08, 2022 11:38 pm
Forum: Support
Topic: ERROR:cdsapi:Reason: Request returned no data
Replies: 3
Views: 514

Re: ERROR:cdsapi:Reason: Request returned no data

Hi François, I may have found the problem. I am only processing the zone of interest of the L1A file into L1C using the same sline, eline, srow and erow on l2gen. The output file are usually ~600K except the ones that make the ancillary request crash on POLYMER. Those ones are ~200K so the zone I am...
by gbourdin
Wed Mar 09, 2022 3:56 pm
Forum: Support
Topic: ERROR:cdsapi:Reason: Request returned no data
Replies: 3
Views: 514

Re: ERROR:cdsapi:Reason: Request returned no data

I have set my program to create an ancillary folder for each image separately and found out that polymer is creating a folder dated to 1970/01/01 ANCILLARY/ERA5/A2017315041000/1970/01/01/ for all the image the cdapi can't find ancillary data for: A2017315041000/ A2018035061500/ A2018043052500/ A2018...
by gbourdin
Wed Mar 09, 2022 3:27 pm
Forum: Support
Topic: ERROR:cdsapi:Reason: Request returned no data
Replies: 3
Views: 514

ERROR:cdsapi:Reason: Request returned no data

Hi François, It seems cdapi in polymer can't find any ancillary data on ERA5 for some NASA satellites in some rare cases: MODISA: 8 out of 931 images MODIST: 4 out of 985 images VIIRSN: 8 of 1165 images VIIRSJ1: 3 of 431 images I am subsetting each image to only process a 20x20 pixels zone to save c...
by gbourdin
Mon Jan 31, 2022 10:53 pm
Forum: Support
Topic: Near real time and ancillary data
Replies: 4
Views: 500

Re: Near real time and ancillary data

Great! I will test it, thank you,
Guillaume
by gbourdin
Tue Jan 18, 2022 8:04 pm
Forum: Support
Topic: Near real time and ancillary data
Replies: 4
Views: 500

Re: Near real time and ancillary data

Hello François, Yes I think this is because there is no ancillary available. Do you know what is the delay for ERA5? I managed to get it working with NASA ancillary data with a 3 days delay, but there is several images every day that are not processed due to inconsistent ancillary data (which doesn'...
by gbourdin
Mon Oct 25, 2021 4:27 pm
Forum: Support
Topic: Near real time and ancillary data
Replies: 4
Views: 500

Near real time and ancillary data

Hello François, I am trying to process data from several satellites in near real-time. You said in a previous post that the ancillary data from ERA5 is more reliable when I had issues running polymer using the NASA ancillary data. Polymer is indeed running smoothly on thousands of images using ERA5 ...
by gbourdin
Mon Sep 20, 2021 6:56 pm
Forum: Support
Topic: OSError: [Errno 24] Too many open files:
Replies: 2
Views: 468

Re: OSError: [Errno 24] Too many open files:

I was already using a function that processes single files but you were right it was due to garbage references I was creating doing my subsets. Solved now thank you!
Cheers,
Guillaume
by gbourdin
Mon Aug 30, 2021 5:28 pm
Forum: Support
Topic: OSError: [Errno 24] Too many open files:
Replies: 2
Views: 468

OSError: [Errno 24] Too many open files:

Hello François, I get an error when I try to batch process thousands of images, subsetting them beforehand. There number of files opened reaches the limit set for the operating system (which is currently 1024). I will increase it to 4096 to see what it does but I was wondering in the meantime, if th...
by gbourdin
Tue Jul 06, 2021 6:20 pm
Forum: Support
Topic: Webpage error
Replies: 4
Views: 1085

Re: Webpage error

Hi François, Sorry for the late answer I was busy on other things. I was trying to process several images, here are few examples that failed when trying to download ancillary data: A2018051010500.L1C_LAC_OC.nc A2016161013500.L1C_LAC_OC.nc A2016074013500.L1C_LAC_OC.nc T2018144223500.L1C_LAC_OC.nc T20...