Skip to content
This repository has been archived by the owner on Oct 1, 2024. It is now read-only.

Parallelise IO #57

Open
clbarnes opened this issue Jun 18, 2019 · 3 comments
Open

Parallelise IO #57

clbarnes opened this issue Jun 18, 2019 · 3 comments

Comments

@clbarnes
Copy link
Collaborator

Probably in a separate crate depending on rust-n5, include a ParallelN5Ndarray(Reader|Writer) which parallelises the functions available in https://github.com/aschampion/rust-n5/blob/master/src/ndarray.rs#L121 , using https://github.com/aschampion/rust-n5/blob/master/benches/parallel_write.rs#L69 as an example.

@aschampion
Copy link
Collaborator

Once async lands in stable rust (next release), I'll probably promote the AsyncN5Reader traits from n5-wasm to rust-n5. This could make the the separate crate pretty trivial.

@aschampion
Copy link
Collaborator

See also https://github.com/aschampion/n5gest/blob/master/src/main.rs#L371-L464 for how to use a thread local cache when reading to reduce allocations.

@clbarnes
Copy link
Collaborator Author

Partially implemented (python-side)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants