Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updating to master #104

Merged
merged 11 commits into from
Dec 28, 2023
2 changes: 1 addition & 1 deletion .github/funding.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,3 @@
# These are supported funding model platforms

custom: "https://hdfgroup.org/about-us/donate-to-the-hdf-group/"
custom: "https://www.hdfgroup.org/donate"
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ Here is the current policy regarding VFD identifier assignment: Valid VFD identi

Please contact the maintainer of a VFD for help implementing the plugin.

## List of VFDs Registered with The HDF Groupv
## List of VFDs Registered with The HDF Group

| Driver | Driver Identifier| Search Name* | Short Description | URL | Contacts|
| --- | --- | --- | --- | --- | --- |
Expand Down
32 changes: 16 additions & 16 deletions documentation/hdf5-docs/registered_vol_connectors.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,26 +15,26 @@ Here is the current policy regarding VOL connector identifier assignment: Valid
Please contact the maintainer of a VOL connector for help implementing the plugin.

## List of VOL Connectors Registered with The HDF Group
| Connector | Connector Identifier | Search Name* | Short Description | URL | Contacts
| --- | --- | --- | --- | --- | ---|
| Asynchronous I/O | 512 | async | Provides support for asynchronous operations to HDF5 | [https://github.com/hpc-io/vol-async](https://github.com/hpc-io/vol-async) | Suren Byna (sbyna at lbl dot gov) |
| Cache | 513 | cache | Provides support for multi-level, multi-location data caching to dataset I/O operations | [https://github.com/hpc-io/vol-cache](https://github.com/hpc-io/vol-cache) | Suren Byna (sbyna at lbl dot gov) |
| Log-based | 514 | LOG | The log-based VOL plugin stores HDF5 datasets in a log-based storage layout.<br>In this layout, data of multiple write requests made by an MPI process are appended one after another in the file. Such I/O strategy can avoid the expensive inter-process communication and I/O serialization due to file lock contentions when storing data in the canonical order. Through the log-based VOL, existing HDF5 programs can achieve a better parallel write performance with minimal changes to their codes. | [https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md](https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md) | Kai Yuan Hou <br> (khl7265 at ece dot northwestern dot edu) |
| DAOS | 4004 | daos | Designed to utilize the DAOS object storage system by use of the DAOS API <br> https://doi.org/10.1109/TPDS.2021.3097884 | [https://github.com/HDFGroup/vol-daos](https://github.com/HDFGroup/vol-daos) <br> [HDF5 DAOS VOL Connector Design](https://github.com/HDFGroup/vol-daos/blob/master/docs/design_doc.pdf) <br> [HDF5 DAOS VOL Connector User's Guide](https://github.com/HDFGroup/vol-daos/blob/master/docs/users_guide.pdf) | help at hdfgroup dot org |
| native| 0 | native | | | help at hdfgroup dot org |

| pass-through| 517 | pass_through_ext | Provides a simple example of a pass-through VOL connector | [https://github.com/hpc-io/vol-external-passthrough](https://github.com/hpc-io/vol-external-passthrough) | Suren Byna (sbyna at lbl dot gov) |
| dset-split | 518 | dset-split | Creates separate sub files for each dataset created and mounts these sub-files as external links in the main file. It enables versioning of HDF5 files at a dataset boundary. | [https://github.com/hpc-io/vol-dset-split](https://github.com/hpc-io/vol-dset-split) | Annmary Justine (annmary dot roy at hpe dot com) |
| PDC-VOL | 519 | PDC-VOL | It is a terminal VOL that reads and writes HDF5 objects to the PDC system | [https://github.com/hpc-io/pdc](https://github.com/hpc-io/pdc) [https://github.com/hpc-io/vol-pdc](https://github.com/hpc-io/vol-pdc) | Houjun Tang (htang4 at lbl dot gov) |
| REST | 520 | REST | Designed to utilize web-based storage systems by use of the HDF5 REST APIs | [https://github.com/HDFGroup/vol-rest](https://github.com/HDFGroup/vol-rest) | Matthew Larson (mlarson at hdfgroup dot org) |
| LowFive | 521 | LowFive | A new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. | [https://github.com/diatomic/LowFive](https://github.com/diatomic/LowFive) | Tom Peterka (tpeterka at mcs dot anl dot gov) <br> Dmitriy Morozov (dmorozov at lbl dot gov) |

| Connector | Connector Identifier | Search Name* | Short Description | URL | Contacts |
| --- | --- | --- | --- | --- | --- |
| Asynchronous I/O | 512 | async | Provides support for asynchronous operations to HDF5 | [https://github.com/hpc-io/vol-async](https://github.com/hpc-io/vol-async) | Suren Byna (sbyna at lbl dot gov) |
| Cache | 513 | cache | Provides support for multi-level, multi-location data caching to dataset I/O operations | [https://github.com/hpc-io/vol-cache](https://github.com/hpc-io/vol-cache) | Suren Byna (sbyna at lbl dot gov) |
| Log-based | 514 | LOG | The log-based VOL plugin stores HDF5 datasets in a log-based storage layout.<br>In this layout, data of multiple write requests made by an MPI process are appended one after another in the file. Such I/O strategy can avoid the expensive inter-process communication and I/O serialization due to file lock contentions when storing data in the canonical order. Through the log-based VOL, existing HDF5 programs can achieve a better parallel write performance with minimal changes to their codes. | [https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md](https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md) | Kai Yuan Hou <br> (khl7265 at ece dot northwestern dot edu) |
| DAOS | 4004 | daos | Designed to utilize the DAOS object storage system by use of the DAOS API <br> https://doi.org/10.1109/TPDS.2021.3097884 | [https://github.com/HDFGroup/vol-daos](https://github.com/HDFGroup/vol-daos) <br> [HDF5 DAOS VOL Connector Design](https://github.com/HDFGroup/vol-daos/blob/master/docs/design_doc.pdf) <br> [HDF5 DAOS VOL Connector User's Guide](https://github.com/HDFGroup/vol-daos/blob/master/docs/users_guide.pdf) | help at hdfgroup dot org |
| native| 0 | native | | | help at hdfgroup dot org |
| pass-through| 517 | pass_through_ext | Provides a simple example of a pass-through VOL connector | [https://github.com/hpc-io/vol-external-passthrough](https://github.com/hpc-io/vol-external-passthrough) | Suren Byna (sbyna at lbl dot gov) |
| dset-split | 518 | dset-split | Creates separate sub files for each dataset created and mounts these sub-files as external links in the main file. It enables versioning of HDF5 files at a dataset boundary. | [https://github.com/hpc-io/vol-dset-split](https://github.com/hpc-io/vol-dset-split) | Annmary Justine (annmary dot roy at hpe dot com) |
| PDC-VOL | 519 | PDC-VOL | It is a terminal VOL that reads and writes HDF5 objects to the PDC system | [https://github.com/hpc-io/pdc](https://github.com/hpc-io/pdc) [https://github.com/hpc-io/vol-pdc](https://github.com/hpc-io/vol-pdc) | Houjun Tang (htang4 at lbl dot gov) |
| REST | 520 | REST | Designed to utilize web-based storage systems by use of the HDF5 REST APIs | [https://github.com/HDFGroup/vol-rest](https://github.com/HDFGroup/vol-rest) | Matthew Larson (mlarson at hdfgroup dot org) |
| LowFive | 521 | LowFive | A new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. | [https://github.com/diatomic/LowFive](https://github.com/diatomic/LowFive) | Tom Peterka (tpeterka at mcs dot anl dot gov) <br> Dmitriy Morozov (dmorozov at lbl dot gov) |

*The Search Name provides a mechanism for searching for a VOL.

## List of Prototype VOL Connectors

| Connector | Connector Identifier | Search Name* | Short Description| URL | Contacts |
| --- | --- | --- | --- | --- | --- |
| rados | unassigned | rados | Prototype VOL connector to access data in RADOS | [https://github.com/HDFGroup/vol-rados](https://github.com/HDFGroup/vol-rados) | help at hdfgroup dot org |
| Connector | Connector Identifier | Search Name* | Short Description| URL | Contacts |
| --- | --- | --- | --- | --- | --- |
| rados | unassigned | rados | Prototype VOL connector to access data in RADOS | [https://github.com/HDFGroup/vol-rados](https://github.com/HDFGroup/vol-rados) | help at hdfgroup dot org |

*The Search Name provides a mechanism for searching for a VOL.