Skip to content

Pull requests: vllm-project/vllm

New pull request New
659 Open 8,481 Closed
659 Open 8,481 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[neuron] fix authorization issue ci/build
#18364 opened May 19, 2025 by liangfu Loading…
1
[Bugfix] fix adding bias twice in ipex GPTQ quantization
#18363 opened May 19, 2025 by rand-fly Loading…
1
Update run_cluster.sh documentation Improvements or additions to documentation
#18361 opened May 19, 2025 by Khalid1G Loading…
1
[Misc] add xgrammar for arm64 ci/build
#18359 opened May 19, 2025 by prashantgupta24 Loading…
1
[Misc] Allow AutoWeightsLoader to skip loading weights with specific substr in name ready ONLY add when PR is ready to merge/full CI is needed
#18358 opened May 19, 2025 by Isotr0py Loading…
4
[Minor] Rename quantization nvfp4 to modelopt_fp4 ready ONLY add when PR is ready to merge/full CI is needed
#18356 opened May 19, 2025 by mgoin Loading…
1
[V1][Metrics] Remove gpu_ prefix from non GPU specific metrics. v1
#18354 opened May 19, 2025 by sahelib25 Loading…
1
fix:Build torch wheel inline rather than picking from nightly ci/build
#18351 opened May 19, 2025 by dilipgb Loading…
1
Remove used KV cache from MooncakeStore to prevent overfill
#18349 opened May 19, 2025 by gronsti-amd Loading…
1
1
[Misc] Call ndarray.tobytes() directly instead of ndarray.data.tobytes() multi-modality Related to multi-modality (#4194) ready ONLY add when PR is ready to merge/full CI is needed
#18347 opened May 19, 2025 by lgeiger Loading…
5
[Core] Add Lora Support to Beam Search frontend
#18346 opened May 19, 2025 by alex-jw-brooks Loading…
1
@jeejeelee
2
[Feature] Expert Parallelism Load Balancer (EPLB) needs-rebase v1
#18343 opened May 19, 2025 by abmfy • Draft
6 tasks
2
[P/D] Fix minor case in example disagg_prefill_proxy_server.py
#18341 opened May 19, 2025 by gc-fu Loading…
1
[Core] hybrid dtype: float32 for weights and activation, float16 or bfloat16 for attention.
#18340 opened May 19, 2025 by noooop • Draft
3
[FEAT][ROCm] Upgrade AITER MLA v1 backend ci/build v1
#18338 opened May 19, 2025 by vllmellm Loading…
5
[WIP] [Core][P/D] CPU connector for PD disagg v1
#18332 opened May 19, 2025 by ApostaC • Draft
1 of 9 tasks
1
Intialize io_thread_pool attribute in the beginning. v1
#18331 opened May 19, 2025 by rabi Loading…
2
[V1] Fix general plugins not loaded in engine for multiproc v1
#18326 opened May 18, 2025 by sarckk Loading…
1
Refactor: Prioritize Prefill Requests in Scheduler Output v1
#18325 opened May 18, 2025 by qiaoli31 • Draft
2
[Model]: Fused MoE for nomic-embed-text-v2-moe
#18321 opened May 18, 2025 by Isotr0py Loading…
1
Update arch overview for v1 codex documentation Improvements or additions to documentation
#18317 opened May 18, 2025 by simon-mo • Draft
3
[Quantization] Add compressed-tensors NVFP4 support quantization ready ONLY add when PR is ready to merge/full CI is needed
#18312 opened May 17, 2025 by dsikka Loading…
7
[Bugfix] Use a different prompt for benchmark_serving.py's test prompt
#18311 opened May 17, 2025 by tlrmchlsmth • Draft
1
[Frontend] Speedup frontend test ci/build v1
#18310 opened May 17, 2025 by ztang2370 Loading…
1
5
[Core] Accelerate startup time v1
#18307 opened May 17, 2025 by jianzs Loading…
4
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.