Search found 3 matches

by derekja
Sat Dec 22, 2018 12:35 am
Forum: Support
Topic: occasional multiprocessing errors
Replies: 5
Views: 6709

Re: occasional multiprocessing errors

Great, I can confirm that upgrading netcdf from version 4.4.0 to version 4.6.1 solved the issue. Thanks. Normally, I wouldn't care about multiprocessing and would just request single core nodes. However, our job scheduler de-prioritizes jobs that run over 3 hours, which is often the case without mul...
by derekja
Thu Dec 20, 2018 9:53 pm
Forum: Support
Topic: occasional multiprocessing errors
Replies: 5
Views: 6709

Re: occasional multiprocessing errors

The error does not occur when multiprocessing is disabled, but the detrimental impact on processing time is greater than simply re-running those instances that have generated the error.

Thank you, François, I will investigate different netcdf versions and will report back.
by derekja
Wed Dec 19, 2018 7:15 pm
Forum: Support
Topic: occasional multiprocessing errors
Replies: 5
Views: 6709

occasional multiprocessing errors

Hi, Thanks for Polymer. Very nice package. I am running against copernicus imagery in a high-performance computing environment, so I am running polymer in many dozens of containers at once. In most cases it is working perfectly, but in about 5% or less of cases I get an error from within the multipr...