gpt_server — Agent Tool by shell-nlp

by shell-nlp · Agent Tool · ★ 245

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About gpt_server

gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。

asrembeddingfastchatfunction-callinggptinfinityllamallmlmdeployopenai

Quick Facts

Stars245
Forks21
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score41.7/100
Open Issues4
Last Updated2026-03-05
Created2023-12-16
Platformspython
Est. Tokens~401k

Compatible Skills

These tools work well together with gpt_server for enhanced workflows:

  • voicemode — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • safeclaw — semantic(0.21)+complementary+same_lang+similar_pop+shared_platform (52%)
  • ToolRegistry — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

gpt_server alternative? Top 6 similar tools

Looking for a gpt_server alternative? If you're comparing gpt_server with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • AITreasureBox by superiorlu · ⭐ 793

    🤖 Automatically collected AI repos, tools, websites, papers & tutorials. 实用AI百宝箱 💎

  • cascadeflow by lemony-ai · ⭐ 733

    Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

  • smg by lightseekorg · ⭐ 209

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, O

  • VT.ai by vinhnx · ⭐ 112

    VT.ai - multimodal AI chat app with dynamic conversation routing

  • langtrace by Scale3-Labs · ⭐ 1.2k

    Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, prov

  • vllm-mlx by waybarrios · ⭐ 1.1k

    OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL,

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is gpt_server?

gpt_server is gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。. It is categorized as a Agent Tool with 245 GitHub stars.

What programming language is gpt_server written in?

gpt_server is primarily written in Python. It covers topics such as asr, embedding, fastchat.

How do I install or use gpt_server?

You can find installation instructions and usage details in the gpt_server GitHub repository at github.com/shell-nlp/gpt_server. The project has 245 stars and 21 forks, indicating an active community.

What license does gpt_server use?

gpt_server is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

What are the best alternatives to gpt_server?

The top alternatives to gpt_server on Agent Skills Hub include AITreasureBox, cascadeflow, smg. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse Agent Tool tools