tokuin — LLM Plugin by nooscraft

by nooscraft · LLM Plugin · ★ 138

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About tokuin

🧮 Tokuin A fast, CLI tool to estimate token usage, control API costs, and compress prompts for LLM providers. Built in Rust for performance, portability, and safety. ✨ What's in v0.2.0 Prompt Compression — Reduce prompt tokens by 70-90% using the Hieratic format Quality Metrics — Measure compression fidelity (semantic similarity, critical instruction preservation, structural integrity) LLM-as-a-Judge — Compare outputs from original vs compressed prompts using an LLM judge Incremental Compression — Compress long conversations turn-by-turn without re-processing history Structured Mode — Compression-aware handling of JSON, code blocks, HTML tables, and technical docs Everything from v0.1.x: token counting, cost estimation, multi-model comparison, load testing 🚀 Installation Quick Install (macOS & Linux) Detects your platform, downloads the latest release, verifies its checksum, and installs to (or if root access

llmsprompt-engineeringrusttokenizer

Quick Facts

Stars138
Forks4
LanguageRust
CategoryLLM Plugin
Quality Score69.9414968538784/100
Open Issues1
Last Updated2026-04-21
Created2025-11-06
Platformscli, rust
Est. Tokens~39k

Compatible Skills

These tools work well together with tokuin for enhanced workflows:

  • token_proxy — semantic(0.19)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (68%)
  • claude-code-mux — shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (46%)

tokuin alternative? Top 6 similar tools

Looking for a tokuin alternative? If you're comparing tokuin with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • lilypad by Mirascope · ⭐ 214

    Open-source versioning, tracing, and annotation tooling.

  • MCP-Nest by rekog-labs · ⭐ 651

    A NestJS module to effortlessly create Model Context Protocol (MCP) servers for exposing AI tools, resources,

  • computer-agent by suitedaces · ⭐ 599

    Desktop app to control your computer with AI using your terminal, browser, mouse & keyboard

  • gateway by adaline · ⭐ 592

    The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for ca

  • vestige by samvallad33 · ⭐ 570

    Vestige gives AI agents causal memory: a local-first Rust MCP server that reaches backward through time to fin

  • awesome-rust-llm by jondot · ⭐ 542

    🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Rust Agent Tools

Frequently Asked Questions

What is tokuin?

tokuin is CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, OpenRouter, or custom endpoints.. It is categorized as a LLM Plugin with 138 GitHub stars.

What programming language is tokuin written in?

tokuin is primarily written in Rust. It covers topics such as llms, prompt-engineering, rust.

How do I install or use tokuin?

You can find installation instructions and usage details in the tokuin GitHub repository at github.com/nooscraft/tokuin. The project has 138 stars and 4 forks, indicating an active community.

What are the best alternatives to tokuin?

The top alternatives to tokuin on Agent Skills Hub include lilypad, MCP-Nest, computer-agent. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse LLM Plugin tools