openjev-sglang: Jev-compatible API endpoint based on open models (prefill-only)

by ekzhang · LLM Plugin · ★ 333

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

Security audit verdict: SAFE · quality 66/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

jevllmstructured-generationsystemone

Quick Facts

Stars333
Forks45
LanguagePython
CategoryLLM Plugin
Quality Score66/100
Open Issues5
Last Updated2026-10-01
Created2026-09-17
Platformspython
Est. Tokens~16k

About openjev-sglang

openjev-sglang A server implementing the TypeSafe/Jev HTTP API with Qwen3.6-35B-A3B on SGLang. Each container one B200 with SGLang 0.5.19's Rust frontend, radix caching, and breakable prefill CUDA graphs. A separate Python API process uses FastAPI, uvloop, the Rust-backed HF tokenizer, and pooled asynchronous HTTP connections to SGLang on localhost.

Compatible Skills

These tools work well together with openjev-sglang for enhanced workflows:

  • reflex — semantic(0.27)+complementary+shared_fw(huggingface)+same_lang+similar_pop+shared_platform (67%)
  • jevmeter — semantic(0.32)+complementary+rare_topics+same_lang+similar_pop+shared_platform (66%)
  • NanoJev — semantic(0.21)+complementary+shared_fw(huggingface)+same_lang+similar_pop+shared_platform (65%)

openjev-sglang alternative? Top 6 similar tools

Looking for a openjev-sglang alternative? If you're comparing openjev-sglang with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • ollaya by ollaya-dev · ⭐ 1.4k

    Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model famili

  • distill by samuelfaj · ⭐ 775

    Get FAR MORE done with FAR FEWER tokens 🔥

  • jevbench by fstandhartinger · ⭐ 331

    JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision accur

  • aiwg by jmagly · ⭐ 228

    Reusable project context and specialist workflows for the AI tools you already use. Agents, skills, rules and

  • neurolink by juspay · ⭐ 157

    The pipe layer of an AI nervous system — one interface connecting provider neurons to your application, across

  • OpenDecision by deepanwadhwa · ⭐ 115

    Free open source alternative for Jev that supports text, documents and images and runs at ~2GB of ram on a CPU

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse LLM Plugin tools