by shell-nlp · LLM Plugin · ★ 253
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
GPT Server [![License][license-shield]][license-url] [![Stars][stars-shield]][stars-url] [![Forks][forks-shield]][forks-url] [![Docker pulls][docker-pulls]][docker-pulls] [![CI Status][ci-shield]][ci-url] [![issue resolution][closed-issues-shield]][closed-issues-url] 本项目依托fastchat的基础能力来提供openai server的能力. 支持Chat、Embedding、ReRanker、text-moderation（文本审核，分类）、ASR、TTS（支持声音克隆）、SD(Stable Diffusion,文生图、文生视频、图片编辑、) 模型的 openai规范 接口服务。 支持HF、vLLM、LMDeploy和SGLang 多种加速推理后端引擎。 多个模型共用openai server的同一个端口进行调用，自动进行模型调度。 如果 GPT Server 对您有帮助，欢迎留下一个 ⭐ Star！ ✨ 功能亮点 ASR(语音
| Stars | 253 |
| Forks | 22 |
| Language | Python |
| Category | LLM Plugin |
| License | Apache-2.0 |
| Quality Score | 41.7/100 |
| Open Issues | 3 |
| Last Updated | 2026-05-09 |
| Created | 2023-12-16 |
| Platforms | python |
| Est. Tokens | ~402k |
These tools work well together with gpt_server for enhanced workflows:
Looking for a gpt_server alternative? If you're comparing gpt_server with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpee
User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!
Home Assistant add-on: Claude Code, OpenAI/GPT, Gemini
A set of tools that gives agents powerful capabilities.
ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports Ope
Agent samples built using the Strands Agents SDK.
Explore other popular llm plugin tools:
gpt_server is gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。. It is categorized as a LLM Plugin with 253 GitHub stars.
gpt_server is primarily written in Python. It covers topics such as asr, embedding, fastchat.
You can find installation instructions and usage details in the gpt_server GitHub repository at github.com/shell-nlp/gpt_server. The project has 253 stars and 22 forks, indicating an active community.
gpt_server is released under the Apache-2.0 license, making it free to use and modify according to the license terms.
The top alternatives to gpt_server on Agent Skills Hub include smg, cai, ha-claude. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.