Skip to content

20.5.0

Compare
Choose a tag to compare
@nritsche nritsche released this 07 May 00:49
· 276 commits to master since this release

Note: we have switched to calendar versioning for this release.

Bug Fixes

  • Fixed circular references in memh5 containers (#60)
  • Fixed a race condition when creating output directories (#64)
  • Fixed bug in tod.concatenate
  • memh5: explicitly set h5py read mode in routines and tests (e5c0016)
  • memh5: no comm attribute on group in redistribute (be655b0)
  • memh5: allow writing unicode datasets into h5py (25c5b2d)
  • memh5: change default convert_attribute_strings for backwards compatibility (bc8261b)
  • memh5: comm property was set when distributed=False (a9acd90)
  • memh5: detect and convert types annotated with metadata (ef4ebc8)
  • memh5: Mapping has moved into collections.abc in Python 3.8 (631412e)
  • memh5: serialise datetimes with dict attributes without crashing (5d30194)
  • memh5: sort items when copying to/from HDF5 to eliminate MPI errors (7af91fe)
  • mpiarray: partition parallel IO to be under the 2GB HDF5 limit (bee591e)
  • mpiarray: workaround for h5py collective IO bug (9c68fe3), closes #965
  • mpiutil: disable the MPI excepthook (6fba9f6)
  • parallel_map: fixed crash (2462a2f)
  • pipeline: changed incorrect pro_argspec.keywords to pro_argspec.varkw (906d753), closes #121
  • pipeline: use safe_load to avoid warning when loading pipeline conf (8f2d7c3)
  • runner: Add call to group at end of file. (e48ef60)
  • runner: use copyfile instead of copy (3da9976), closes #102
  • time: include required skyfield data in the repo (via Git LFS) (39f357d)
  • time: set SkyfieldWrapper default expire=False (#126) (8e84719)
  • tod: fixes bug where data variable overwritten (0ed8b2c)

Features

  • Context Manager for all memh5 container types (#60). You can now do:
with memh5.BasicCont.from_file("filename.h5"):
   pass
  • Support for new CHIME stacked data with reverse_map (#58)
  • Better handling of missing config information (#56)
  • IO for distributed memh5 containers is now MPI parallel if possible (#66). This should make a big difference to write times of large containers.
  • config: add a list Property for validating input lists (b32ad1d)
  • BasicCont: make history an h5 attribute (fbc5034)
  • caput-pipeline: add option to run job from a temporary dir (90043f5)
  • Manager: add metadata options (47432ee), closes #104
  • memh5: add compression and chunking of memh5 datasets (c0886c8)
  • memh5: sel_* parameters (6743098), closes #108
  • misc: context manager for lockfiles (af67279)
  • MPIArray: add gather and allgather for collecting the full array (2da95ae)
  • pipeline: improve log level config (f418299)
  • pipeline: use locking when writing output (2ab01ed)
  • setup.py: support building without OpenMP (e478a03)
  • tod: allow control of string conversion in tod.concatenate (249face)
  • util: moving weighted median (f3e1a2c)
  • versioneer: add versioneer for better version naming (fa9cccb)