Skip to content

Pull requests: vllm-project/vllm

New pull request New
481 Open 5,428 Closed
481 Open 5,428 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Kernel] Use self.kv_cache and forward_context.attn_metadata in Attention.forward
#12536 opened Jan 29, 2025 by heheda12345 Loading…
1
1
[WIP][AMD][Kernel][Quantization] Add fp8 and int8 support for Triton FAv2 kernel documentation Improvements or additions to documentation
#12534 opened Jan 29, 2025 by rasmith • Draft
3
[WIP] MLA decode optimizations ci/build
#12528 opened Jan 28, 2025 by LucasWilkinson • Draft
3
Add label if pre-commit passes ci/build
#12527 opened Jan 28, 2025 by hmellor • Draft
3
layerwise KV transfer in PD Disaggregation
#12523 opened Jan 28, 2025 by chenqianfzh Loading…
3
[Kernel] Add ModelOpt NVFP4 Checkpoint Support
#12520 opened Jan 28, 2025 by pavanimajety • Draft
1
[Kernel] Add Kernel Support for NVFP4 ci/build
#12519 opened Jan 28, 2025 by pavanimajety • Draft
12
[RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM
#12518 opened Jan 28, 2025 by youngkent Loading…
@DarkLight1337
2
Fix: Respect sparsity_config.ignore in Cutlass Integration
#12517 opened Jan 28, 2025 by rahul-tuli Loading…
4
[Misc] Raise error when flashinfer is not installed and VLLM_ATTENTION_BACKEND is set
#12513 opened Jan 28, 2025 by NickLucche Loading…
3
[VLM] Implement merged multimodal processor and V1 support for idefics3
#12509 opened Jan 28, 2025 by Isotr0py • Draft
3 tasks
@DarkLight1337
1
[ROCm] [Feature] [Doc] [Dockerfile] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing ci/build documentation Improvements or additions to documentation rocm
#12501 opened Jan 28, 2025 by tjtanaa Loading…
2
[Bugfix] Fix Deepseek V3 Crash When max_num_batched_tokens is Very Large
#12491 opened Jan 28, 2025 by Concurrensee Loading…
2
[BUGFIX] Skip tokenization support for throughtput benchmark
#12489 opened Jan 28, 2025 by maleksan85 Loading…
1
[Core] Handle conflicting features more gracefully frontend
#12484 opened Jan 27, 2025 by russellb Loading…
3
[CI/Build]: bump gguf to 0.11 ci/build
#12483 opened Jan 27, 2025 by cdoern Loading…
4
[CI/Build] Better default num jobs heuristic ci/build ready ONLY add when PR is ready to merge/full CI is needed
#12477 opened Jan 27, 2025 by LucasWilkinson Loading…
3
Bump helm/chart-testing-action from 2.6.1 to 2.7.0 ci/build dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#12463 opened Jan 27, 2025 by dependabot bot Loading…
1
Bump actions/stale from 9.0.0 to 9.1.0 ci/build dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#12462 opened Jan 27, 2025 by dependabot bot Loading…
1
[CI][UT] make device count general
#12461 opened Jan 27, 2025 by MengqingCao • Draft
1
updated
#12459 opened Jan 26, 2025 by robertgshaw2-redhat • Draft
1
whisper-async working poc frontend needs-rebase
#12458 opened Jan 26, 2025 by robertgshaw2-redhat • Draft
2
[VLM] Merged multi-modal processor for GLM4V
#12449 opened Jan 26, 2025 by jeejeelee • Draft
1
@DarkLight1337
1
[Misc] Separate hf dataset sampling function from benchmark_serving.py
#12447 opened Jan 26, 2025 by Isotr0py Loading…
1
[Platform] add pre_register_and_update function
#12432 opened Jan 26, 2025 by wangxiyuan Loading…
1
ProTip! Adding no:label will show everything without a label.