-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use updated fitscube to corm larger than memory cubes #196
Conversation
Codecov ReportAttention: Patch coverage is
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #196 +/- ##
=======================================
Coverage 60.48% 60.48%
=======================================
Files 35 35
Lines 6089 6135 +46
=======================================
+ Hits 3683 3711 +28
- Misses 2406 2424 +18 ☔ View full report in Codecov by Sentry. |
flint
uses fitscube to form image cubes out of many single plane fits images. To date this was all done in memory and required sufficient resources. This was not really scalable to combining channel images after linmos was performed.@AlecThomson has re-worked
fitscube
to use asyncio and a pre-stashed final fits cube to worker within the memory limitations. This also improves the overall performance.There was a slight change in some of the API components along the way, but I think these are largely dealt with.