gpt_server — security grade SAFE, quality 65/100

Security audit verdict: SAFE · quality 65/100

No red flags found in any of the 11 categories — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

by shell-nlp · LLM Plugin · ★ 254

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

🔒 Is gpt_server safe to install? View the security audit →

About gpt_server

GPT Server [![License][license-shield]][license-url] [![Stars][stars-shield]][stars-url] [![Forks][forks-shield]][forks-url] [![Docker pulls][docker-pulls]][docker-pulls] [![CI Status][ci-shield]][ci-url] [![issue resolution][closed-issues-shield]][closed-issues-url] 本项目依托fastchat的基础能力来提供openai server的能力. 支持Chat、Embedding、ReRanker、text-moderation(文本审核,分类)、ASR、TTS(支持声音克隆)、SD(Stable Diffusion,文生图、文生视频、图片编辑、) 模型的 openai规范 接口服务。 支持HF、vLLM、LMDeploy和SGLang 多种加速推理后端引擎。 多个模型共用openai server的同一个端口进行调用,自动进行模型调度。 如果 GPT Server 对您有帮助,欢迎留下一个 ⭐ Star! ✨ 功能亮点 ASR(语音

asrembeddingfastchatfunction-callinggptinfinityllamallmlmdeployopenai

Quick Facts

Stars254
Forks21
LanguagePython
CategoryLLM Plugin
LicenseApache-2.0
Quality Score65.1854709030341/100
Open Issues3
Last Updated2026-05-09
Created2023-12-16
Platformspython
Est. Tokens~402k

Compatible Skills

These tools work well together with gpt_server for enhanced workflows:

  • voicemode — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • safeclaw — semantic(0.21)+complementary+same_lang+similar_pop+shared_platform (52%)
  • ToolRegistry — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

gpt_server alternative? Top 6 similar tools

Looking for a gpt_server alternative? If you're comparing gpt_server with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • smg by smg-project · ⭐ 543

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpee

  • smg by lightseekorg · ⭐ 424

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpee

  • cai by ad-si · ⭐ 202

    User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

  • ha-claude by Bobsilvio · ⭐ 81

    Home Assistant add-on: Claude Code, OpenAI/GPT, Gemini

  • chatgpt-cli by kardolus · ⭐ 954

    ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports Ope

  • samples by strands-agents · ⭐ 852

    Agent samples built using the Strands Agents SDK.

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Python Agent Tools

Frequently Asked Questions

What is gpt_server?

gpt_server is gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。. It is categorized as a LLM Plugin with 254 GitHub stars.

What programming language is gpt_server written in?

gpt_server is primarily written in Python. It covers topics such as asr, embedding, fastchat.

How do I install or use gpt_server?

You can find installation instructions and usage details in the gpt_server GitHub repository at github.com/shell-nlp/gpt_server. The project has 254 stars and 21 forks, indicating an active community.

What license does gpt_server use?

gpt_server is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

What are the best alternatives to gpt_server?

The top alternatives to gpt_server on Agent Skills Hub include smg, smg, cai. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy, covering 11 red-flag categories including credential harvesting, data exfiltration, and curl | sh installers. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse LLM Plugin tools