Skip to content

Commit

Permalink
Update on "fix periodic integration test and add helper message on to…
Browse files Browse the repository at this point in the history
…rchdata import failure"


1. use the same generic torch CI workflow for periodic integration test, as in #325 for cpu/gpu unit tests.
2. `StatefulDataloader` is not in `torchdata` official release yet. Print helper message if user doesn't have a recent nightly installed.

[ghstack-poisoned]
  • Loading branch information
tianyu-l committed May 22, 2024
1 parent 9e51118 commit f6cc0e0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchtitan/datasets/hf_datasets.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@

try:
from torchdata.stateful_dataloader import StatefulDataLoader
except ModuleNotFoundError as e:
except ImportError as e:
raise ImportError(
"Please install the latest torchdata nightly to use StatefulDataloader via:"
"pip3 install --pre torchdata --index-url https://download.pytorch.org/whl/nightly"
Expand Down

0 comments on commit f6cc0e0

Please sign in to comment.