Skip to content

Commit

Permalink
minor fix to HF mirror script
Browse files Browse the repository at this point in the history
  • Loading branch information
divyashreepathihalli committed Oct 30, 2024
1 parent bd57aed commit afd6921
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion tools/hf_uploaded_presets.json
Original file line number Diff line number Diff line change
Expand Up @@ -145,5 +145,5 @@
"kaggle://keras/t5/keras/flan_base_multi/2",
"kaggle://keras/t5/keras/flan_large_multi/2",
"kaggle://keras/xlm_roberta/keras/xlm_roberta_base_multi/2",
"kaggle://keras/xlm_roberta/keras/xlm_roberta_large_multi/2",
"kaggle://keras/xlm_roberta/keras/xlm_roberta_large_multi/2"
]
2 changes: 1 addition & 1 deletion tools/mirror_weights_on_hf.py
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ def main():

# Step 5: Update JSON file with newly uploaded handles
update_hf_uploads_json(
JSON_FILE_PATH, {latest_kaggle_handles} - {errored_uploads}
JSON_FILE_PATH, list(set(latest_kaggle_handles) - set(errored_uploads))
)
print("uploads for the following models failed: ", errored_uploads)
print("Rest of the models up to date on HuggingFace")
Expand Down

0 comments on commit afd6921

Please sign in to comment.