Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(dask): make dask autoscaler optional (#834) #834

Open
Alputer opened this issue Sep 20, 2024 · 0 comments · May be fixed by #835, reanahub/reana-server#702 or reanahub/reana-workflow-controller#604
Open

feat(dask): make dask autoscaler optional (#834) #834

Alputer opened this issue Sep 20, 2024 · 0 comments · May be fixed by #835, reanahub/reana-server#702 or reanahub/reana-workflow-controller#604
Assignees
@Alputer
Labels
workflow/dask

Comments

@Alputer
Copy link
Member

Alputer commented Sep 20, 2024

Currently, all dask workflows are executed with autoscaler. However, while experimenting with several examples, autoscaler behaves sometimes weirdly by scheduling more than the maximum number of workers or schedulers not being able to detect some workers, although restarting of the workers solve the issue. Therefore, it is better to decide if this option is enabled to cluster administrators.
@Alputer Alputer self-assigned this Sep 20, 2024
Alputer added a commit to Alputer/reana that referenced this issue Sep 20, 2024
@Alputer
feat(dask): make dask autoscaler optional (reanahub#821)
e3ce610 
closes (reanahub#834)
Alputer added a commit to Alputer/reana-workflow-controller that referenced this issue Sep 20, 2024
@Alputer
feat(dask): make dask autoscaler optional (reanahub#600)
ac5573d 
closes (reanahub/reana#834)
Alputer added a commit to Alputer/reana-server that referenced this issue Sep 20, 2024
@Alputer
feat(dask): update info command to include autoscaler info (reanahub#701
220b542 
)

closes reanahub/reana#834
This was referenced Sep 20, 2024
Open
Open
Open
@Alputer Alputer changed the title Make dask autoscaler optional feat(dask): make dask autoscaler optional (#834) Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Alputer Alputer

Labels
workflow/dask
Projects
Dask
Status: In review
Milestone
No milestone
1 participant
@Alputer