-
Notifications
You must be signed in to change notification settings - Fork 463
Issues: sgl-project/sglang
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] Got error with awq_marlin quantization args.
#1792
opened Oct 25, 2024 by
liangzelang
5 tasks done
[Feature] Request to 8-bit Quantization of Attention with SageAttention
good first issue
Good for newcomers
#1763
opened Oct 23, 2024 by
Snowdar
2 tasks done
[Bug][minimal reproducible demo] High variability across batch inference runs
bug
Something isn't working
#1729
opened Oct 20, 2024 by
FredericOdermatt
5 tasks done
[Feature] Cascade attention kernels
good first issue
Good for newcomers
#1715
opened Oct 19, 2024 by
merrymercy
[Bug] crash about
c10d::ProcessGroupNCCL::WorkNCCL::checkTimeout
#1693
opened Oct 17, 2024 by
zeng-zc
5 tasks
[Feature] When will a version of S-Lora be available?
#1668
opened Oct 14, 2024 by
kunkunzhang123
2 tasks done
[Feature] Support for GPT-2
good first issue
Good for newcomers
#1643
opened Oct 12, 2024 by
hariharan98m
2 tasks done
[Feature] Using frontend APIs but passing a list of prompts in
run
rather than run_batch
#1624
opened Oct 10, 2024 by
pengye91
2 tasks done
[Feature] Log input text instead of input_ids when using openai chat apis
good first issue
Good for newcomers
#1608
opened Oct 8, 2024 by
CedricHwong
5 tasks done
[doc] Chinese Documentation Translation Available for sglang
#1565
opened Oct 4, 2024 by
khum08
2 tasks done
[Bug] Exception: Capture cuda graph failed: Triton Error [CUDA]: device kernel image is invalid
#1558
opened Oct 3, 2024 by
a136214808
1 of 5 tasks
[Bug] Unable to use gptq or awq with torch.compile (8*A40)
#1522
opened Sep 26, 2024 by
smallstepman
5 tasks done
[Feature] _get_pixel_values needs to return tgt_sizes
#1514
opened Sep 26, 2024 by
huangzl18883
2 tasks done
Previous Next
ProTip!
What’s not been updated in a month: updated:<2024-09-28.