by willkurt · Agent Tool · ★ 207
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
Token Explorer Token Explorer allows you to interactively explore the token generation process of an LLM, using a "video game" style interface. You can use either arrow keys or vim-style navigation (h/j/k/l) along with WASD keys. Token explore allows you to: Choose a starting prompt, or provide your own text file. Step through generation one token at a time using either: Arrow keys to navigate, pop and append tokens Vim-style keys: h/l to pop/append, j/k to move up/down View the token probabilities and entropies. Add a copy of your current prompt to the list of prompts. Cycle through the prompts by pressing and . Add and remove prompts from the list with and . Automatically uses the best available device (CUDA MPS CPU). Running the app Token Explore uses for project management. Please see the uv docs for more information. Once you have installed, you can install the dependencies and run the app with: In the model has a default prompt, but you can provide any text file as an argument to the app. If you're using regex structs, you can precompile them with: Usage When you start the app you will see your prompt as well as a table of the top 30 tokens and their probabilities.
| Stars | 207 |
| Forks | 19 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 68.1146579425714/100 |
| Open Issues | 1 |
| Last Updated | 2025-05-05 |
| Created | 2025-03-13 |
| Platforms | python |
| Est. Tokens | ~191k |
Looking for a token-explorer alternative? If you're comparing token-explorer with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
Supercharge Claude Code with 11 AI agents, 36 commands & 15 skills — the claude-code plugin framework inspired
Skill to give Claude Code (and any coding agent) the ability to generate beautiful and practical Excalidraw di
A collection of Agent skills and Claude Code plugins for HashiCorp products.
A collection of standardized Agent Skills to teach GitHub Copilot, Claude, Gemini and Cursor about modern Andr
Claude Code Skill Factory — A powerful open-source toolkit for building and deploying production-ready Claude
Lightweight registry to discover, install, and manage all public Claude plugins and agent skills for your favo
Explore other popular agent tool tools:
token-explorer is A simple tool that let's you explore different possible paths that an LLM might sample.. It is categorized as a Agent Tool with 207 GitHub stars.
token-explorer is primarily written in Python.
You can find installation instructions and usage details in the token-explorer GitHub repository at github.com/willkurt/token-explorer. The project has 207 stars and 19 forks, indicating an active community.
token-explorer is released under the MIT license, making it free to use and modify according to the license terms.
The top alternatives to token-explorer on Agent Skills Hub include claude-forge, excalidraw-diagram-skill, agent-skills. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.