Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set the worker prefetch multiplier to 2 #1524

Open
terrazoon opened this issue Jan 8, 2025 · 0 comments · May be fixed by #1525
Open

Set the worker prefetch multiplier to 2 #1524

terrazoon opened this issue Jan 8, 2025 · 0 comments · May be fixed by #1525
Assignees

Comments

@terrazoon
Copy link
Contributor

terrazoon commented Jan 8, 2025

the default worker_prefetch_multiplier for celery is 4, which is optimal for cpu bound apps. But our app is I/o bound. For I/o bound apps, the optimal setting is 1 or 2. This should reduce latency and memory consumption.

@terrazoon terrazoon converted this from a draft issue Jan 8, 2025
@terrazoon terrazoon moved this from ⬇ Up-Next to 🏗 In progress (WIP: ≤ 3 per person) in Notify.gov product board Jan 8, 2025
@terrazoon terrazoon self-assigned this Jan 8, 2025
@terrazoon terrazoon linked a pull request Jan 8, 2025 that will close this issue
@terrazoon terrazoon moved this from 🏗 In progress (WIP: ≤ 3 per person) to 👀 In review in Notify.gov product board Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 👀 In review
Development

Successfully merging a pull request may close this issue.

1 participant