Skip to content

Single Process Jax like sharding for PyTorch Dtensors

Notifications You must be signed in to change notification settings

abdussamettrkr/SPDTensor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SPDTensor

In PyTorch, DTensor typically requires creating multiple processes that run the same code concurrently. However, in some cases, you might want to avoid starting multiple processes in your main code and instead use this feature directly, similar to Jax Sharding.

About

Single Process Jax like sharding for PyTorch Dtensors

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages