Skip to content

Issues: HabanaAI/vllm-fork

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

10 Open 65 Closed
10 Open 65 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Feature]: Hangs After Model Load, but run_example_tp.py Executes Successfull
#967 opened Mar 26, 2025 by Archmilio
1 task done
2
[Bug]: container image built by Dockerfile.hpu can NOT be run as non-root user bug Something isn't working
#929 opened Mar 19, 2025 by lianhao
1 task done
1
[Feature]: Quantization support in HPU enhancement New feature or request
#904 opened Mar 11, 2025 by pranjalst
1 task done
1
[Feature]: Support Deepseek-r1 671B external Issues or PRs submitted by external users
#809 opened Feb 10, 2025 by Bihan
1 task done
6
[Bug]: The API crashes after sending a chat completion request that includes seed. bug Something isn't working New Model Issue o PR to enable a new model
#773 opened Feb 3, 2025 by ZoneTwelve
1 task done
4
[Doc]: Latest release instructions produce python dependency issues documentation Improvements or additions to documentation
#763 opened Jan 30, 2025 by rofinn
1 task done
3
[Bug]: Meta-Llama-3-3-70B-Instruct Outputs "!!!!" With Context Length above 10k bug Something isn't working New Model Issue o PR to enable a new model
#738 opened Jan 25, 2025 by ppatel-eng
13
[Feature]: SwiftKV cache compression enhancement New feature or request
#719 opened Jan 22, 2025 by pranjalst
1 task done
1
[Feature]: Models Trained on Gaudi Do Not Work enhancement New feature or request external Issues or PRs submitted by external users
#511 opened Nov 16, 2024 by gouki510
1 task done
1
[RFC]: change VLLM_DECODE_BLOCK_BUCKET_* design to fit small AND large batch size at one warmup intel Issues or PRs submitted by Intel
#328 opened Sep 24, 2024 by ccrhx4
1 task done
4
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.