Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history 
mostly testing if new repo works or not
  • Loading branch information
@wanchaol
wanchaol committed Feb 23, 2024
1 parent b4cda94 commit dac3fdd
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,10 @@

Note: This repository is currently under heavy development.

torchtrain contains PyTorch native parallelisms, tools and utilities to train large models.

TorchTrain is a native PyTorch library with PyTorch native parallelisms and various training techniques to train large models.
## Design Principles

TorchTrain is a native PyTorch library with various training techniques. While it utilizes the PyTorch ecosystem for things like data loading (i.e. HuggingFace datasets), the core functionality is written in PyTorch.
While torchtrain utilizes the PyTorch ecosystem for things like data loading (i.e. HuggingFace datasets), the core functionality is written in PyTorch.

* Designed to be easy to understand, use and extend for different training purposes.
* Minimal changes to the model code, when applying 1D/2D or 3D Parallelisms.
Expand Down

0 comments on commit dac3fdd

Please sign in to comment.