[Feature][CLI] Support working_dir
is bigger than 500MB for ray job submit
#2717
Labels
working_dir
is bigger than 500MB for ray job submit
#2717
Search before asking
Description
Currently, KubeRay CLI job submission relies on the working_dir API in the runtime environment. However, working_dir is stored in the KV store of GCS, which has a limitation of 500 MB.
Maybe we should support automatically uploading the directory to cloud storage, similar to the method used by the Spark operator.
https://docs.google.com/document/d/1hCJsrCFYPJLS3Zusdr8N_4Y5leWUMy4bQEbsqSQp2mw/edit?tab=t.0
Use case
No response
Related issues
No response
Are you willing to submit a PR?
The text was updated successfully, but these errors were encountered: