Skip to content

Commit

Permalink
Update registered_vol_connectors.md
Browse files Browse the repository at this point in the history
  • Loading branch information
loricooperhdf authored Dec 4, 2023
1 parent 4b9db2a commit 2da6ca7
Showing 1 changed file with 7 additions and 6 deletions.
13 changes: 7 additions & 6 deletions documentation/hdf5-docs/registered_vol_connectors.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,16 +13,17 @@ Please contact the maintainer of a VOL connector for help implementing the plugi
## List of VOL Connectors Registered with The HDF Group
| Connector | Connector Identifier | Search Name* | Short Description | URL | Contacts
| --- | --- | --- | --- | --- | ---|
| Asynchronous I/O | 512 | async | Provides support for asynchronous operations to HDF5 | [https://github.com/hpc-io/vol-async](https://github.com/hpc-io/vol-async) | Suren Byna (sbyna at lbl dot gov) |
| Asynchronous I/O | 512 | async | Provides support for asynchronous operations to HDF5 | [https://github.com/hpc-io/vol-async](https://github.com/hpc-io/vol-async) | Suren Byna (sbyna at lbl dot gov) |
| Cache | 513 | cache | Provides support for multi-level, multi-location data caching to dataset I/O operations | [https://github.com/hpc-io/vol-cache](https://github.com/hpc-io/vol-cache) | Suren Byna (sbyna at lbl dot gov) |
| Log-based | 514 | LOG | The log-based VOL plugin stores HDF5 datasets in a log-based storage layout.<br>In this layout, data of multiple write requests made by an MPI process are appended one after another in the file. Such I/O strategy can avoid the expensive inter-process communication and I/O serialization due to file lock contentions when storing data in the canonical order. Through the log-based VOL, existing HDF5 programs can achieve a better parallel write performance with minimal changes to their codes. | [https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md](https://github.com/DataLib-ECP/vol-log-based/blob/master/README.md) | Kai Yuan Hou <br> (khl7265 at ece dot northwestern dot edu) |
| DAOS | 4004 | daos | Designed to utilize the DAOS object storage system by use of the DAOS API <br> https://doi.org/10.1109/TPDS.2021.3097884 | https://github.com/HDFGroup/vol-daos <br> [HDF5 DAOS VOL Connector Design](https://github.com/HDFGroup/vol-daos/blob/master/docs/design_doc.pdf) <br> [HDF5 DAOS VOL Connector User's Guide](https://github.com/HDFGroup/vol-daos/blob/master/docs/users_guide.pdf) | help at hdfgroup dot org |
| DAOS | 4004 | daos | Designed to utilize the DAOS object storage system by use of the DAOS API <br> https://doi.org/10.1109/TPDS.2021.3097884 | [https://github.com/HDFGroup/vol-daos](https://github.com/HDFGroup/vol-daos) <br> [HDF5 DAOS VOL Connector Design](https://github.com/HDFGroup/vol-daos/blob/master/docs/design_doc.pdf) <br> [HDF5 DAOS VOL Connector User's Guide](https://github.com/HDFGroup/vol-daos/blob/master/docs/users_guide.pdf) | help at hdfgroup dot org |
| native| 0 | native | | | help at hdfgroup dot org |
| pass-through| 517 | pass_through_ext| Provides a simple example of a pass-through VOL connector | [https://github.com/hpc-io/vol-external-passthrough](https://github.com/hpc-io/vol-external-passthrough) | Suren Byna (sbyna at lbl dot gov) |

| pass-through| 517 | pass_through_ext | Provides a simple example of a pass-through VOL connector | [https://github.com/hpc-io/vol-external-passthrough](https://github.com/hpc-io/vol-external-passthrough) | Suren Byna (sbyna at lbl dot gov) |
| dset-split | 518 | dset-split | Creates separate sub files for each dataset created and mounts these sub-files as external links in the main file. It enables versioning of HDF5 files at a dataset boundary. | [https://github.com/hpc-io/vol-dset-split](https://github.com/hpc-io/vol-dset-split) | Annmary Justine (annmary dot roy at hpe dot com) |
| PDC-VOL| 519| PDC-VOL | It is a terminal VOL that reads and writes HDF5 objects to the PDC system | [https://github.com/hpc-io/pdc](https://github.com/hpc-io/pdc) [https://github.com/hpc-io/vol-pdc](https://github.com/hpc-io/vol-pdc) | Houjun Tang (htang4 at lbl dot gov) |
| REST | 520| REST| Designed to utilize web-based storage systems by use of the HDF5 REST APIs | [https://github.com/HDFGroup/vol-rest](https://github.com/HDFGroup/vol-rest) | Matthew Larson (mlarson at hdfgroup dot org) |
| LowFive| 521 | LowFive | A new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. | [https://github.com/diatomic/LowFive](https://github.com/diatomic/LowFive) | Tom Peterka (tpeterka at mcs dot anl dot gov) <br> Dmitriy Morozov (dmorozov at lbl dot gov) |
| PDC-VOL | 519 | PDC-VOL | It is a terminal VOL that reads and writes HDF5 objects to the PDC system | [https://github.com/hpc-io/pdc](https://github.com/hpc-io/pdc) [https://github.com/hpc-io/vol-pdc](https://github.com/hpc-io/vol-pdc) | Houjun Tang (htang4 at lbl dot gov) |
| REST | 520 | REST | Designed to utilize web-based storage systems by use of the HDF5 REST APIs | [https://github.com/HDFGroup/vol-rest](https://github.com/HDFGroup/vol-rest) | Matthew Larson (mlarson at hdfgroup dot org) |
| LowFive | 521 | LowFive | A new data transport layer based on the HDF5 data model, for in situ workflows. Executables using LowFive can communicate in situ (using in-memory data and MPI message passing), reading and writing traditional HDF5 files to physical storage, and combining the two modes. | [https://github.com/diatomic/LowFive](https://github.com/diatomic/LowFive) | Tom Peterka (tpeterka at mcs dot anl dot gov) <br> Dmitriy Morozov (dmorozov at lbl dot gov) |

*The Search Name provides a mechanism for searching for a VOL.

Expand Down

0 comments on commit 2da6ca7

Please sign in to comment.