vllm-cli — LLM Plugin by Chen-zexi

by Chen-zexi · LLM Plugin · ★ 480

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About vllm-cli

vLLM CLI A command-line interface tool for serving Large Language Models using vLLM. Provides both interactive and command-line modes with features for configuration profiles, model management, and server monitoring. Interactive terminal interface with GPU status and system overview Tip: You can customize the GPU stats bar in settings Features 🎯 Interactive Mode - Rich terminal interface with menu-driven navigation ⚡ Command-Line Mode - Direct CLI commands for automation and scripting 🤖 Model Management - Automatic discovery of local models with HuggingFace and Ollama support 🔧 Configuration Profiles - Pre-configured and custom server profiles for different use cases

llmllm-inferencellm-toolsvllm

Quick Facts

Stars480
Forks26
LanguagePython
CategoryLLM Plugin
LicenseMIT
Quality Score42.75/100
Open Issues3
Last Updated2026-01-25
Created2025-08-14
Platformscli, python
Est. Tokens~431k

Compatible Skills

These tools work well together with vllm-cli for enhanced workflows:

  • LLM-VM — semantic(0.31)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • llm_counts — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (58%)
  • lm-proxy — semantic(0.21)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • Noema-Declarative-AI — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • local-llm-function-calling — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)

vllm-cli alternative? Top 6 similar tools

Looking for a vllm-cli alternative? If you're comparing vllm-cli with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • cascadeflow by lemony-ai · ⭐ 1.8k

    Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

  • mirascope by Mirascope · ⭐ 1.5k

    The LLM Anti-Framework

  • vllm-mlx by waybarrios · ⭐ 1.3k

    OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL,

  • awesome-hacking-lists by taielab · ⭐ 1.3k

    A curated collection of top-tier penetration testing tools and productivity utilities across multiple domains.

  • awesome-hosting by dalisoft · ⭐ 863

    List of awesome hosting sorted by minimal plan price

  • BambooAI by pgalko · ⭐ 776

    A Python library powered by Language Models (LLMs) for conversational data discovery and analysis.

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Python Agent Tools

Frequently Asked Questions

What is vllm-cli?

vllm-cli is A command-line interface tool for serving LLM using vLLM.. It is categorized as a LLM Plugin with 480 GitHub stars.

What programming language is vllm-cli written in?

vllm-cli is primarily written in Python. It covers topics such as llm, llm-inference, llm-tools.

How do I install or use vllm-cli?

You can find installation instructions and usage details in the vllm-cli GitHub repository at github.com/Chen-zexi/vllm-cli. The project has 480 stars and 26 forks, indicating an active community.

What license does vllm-cli use?

vllm-cli is released under the MIT license, making it free to use and modify according to the license terms.

What are the best alternatives to vllm-cli?

The top alternatives to vllm-cli on Agent Skills Hub include cascadeflow, mirascope, vllm-mlx. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse LLM Plugin tools