vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
12.0
🚀 Why vllm?
vllm is a standout tool — capabilities like language-models, persistent-memory, with native support for REST.
Language-Models
Leverage language-models for enhanced productivity
Memory & Context
Persistent memory for better context
🔌 Protocols & Compatibility
REST
⚡ Capabilities
language-modelspersistent-memory
🔧 Technical Specifications
| Type | Tool |
| Language | Python |
| Trust Score | 12.0/100 (New) |
| Protocols | REST |
| Install | pip install vllm |
| Source | https://pypi.org/project/vllm/ |
12.0/100
Trust Score
Newly listed — trust is building
—
GitHub Stars
Star count not available
—
Unverified
Not yet claimed or verified
🏷️ Embed Badge
Add a trust badge to your README:
[](https://fushu.dev/agent/c8fe6b6ce20e)
click to copy
Get Started with vllm
Install now and integrate into your workflow in minutes.
$ pip install vllm