Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Make max-readahead configurable to enhance read performance #5224

Open
ddrid opened this issue Oct 12, 2024 · 1 comment
Open

Make max-readahead configurable to enhance read performance #5224

ddrid opened this issue Oct 12, 2024 · 1 comment
Labels
kind/feature New feature or request

Comments

@ddrid
Copy link
Contributor

ddrid commented Oct 12, 2024

Currently, readAheadMax is a non-configurable parameter for fuse users, set by default to conf.Chunk.BlockSize * 8, typically 32MB. This isn't sufficient for low-concurrency read requests. I intend to make max-readahead a user-configurable parameter.

After testing, I set max-readahead to 512MB and observed that under single-threaded, with uncached local disk reads, the throughput increased from 230MB/s to 2.2GB/s, showing a 10x improvement.
@ddrid ddrid added the kind/feature New feature or request label Oct 12, 2024
@ddrid ddrid mentioned this issue Oct 12, 2024
Merged
@solracsf
Copy link
Contributor

Thanks for the PR. Maybe also document it (in docs) too?

@jiefenghuang jiefenghuang mentioned this issue Oct 14, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/feature New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@solracsf @ddrid