by Aesthisia · Agent Tool · ★ 97
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
🔒 Is LLMinator safe to install? View the security audit →
LLMinator: Run & Test LLMs directly from HuggingFace Gradio based tool with integrated chatbot to locally run & test LLMs directly from HuggingFace. An easy-to-use tool made with Gradio, LangChain, and Torch. ⚡ Features Context-aware Streaming Chatbot. Inbuilt code syntax highlighting. Load any LLM repo directly from HuggingFace. Supports both CPU & CUDA modes. Enable LLM inference with llama.cpp using llama-cpp-python Convert models(Safetensors, pt to gguf etc) Customize LLM inference parameters(ngpulayers, temperature, maxtokens etc) Real-time text generation via websockets, enabling seamless integration with different frontend frameworks. 🚀 Installation To use LLMinator, follow these simple steps: Clone the LLMinator repository from GitHub & install requirements Build LLMinator with llama.cpp: Using : On Linux or MacOS: On Windows: Download the latest fortran version of [w64devkit](
| Stars | 97 |
| Forks | 19 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 70.6957754669581/100 |
| Last Updated | 2024-06-27 |
| Created | 2024-03-28 |
| Platforms | browser, python |
| Est. Tokens | ~5k |
Looking for a LLMinator alternative? If you're comparing LLMinator with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
VT.ai - multimodal AI chat app with dynamic conversation routing
c4 GenAI Suite
Self-hosted framework for orchestrating fleets of specialist AI agents — ensemble reasoning and a full agentic
A seamless integration of Chainlit with LangGraph. Ideal for fast prototyping multi-LLM chatbot or AI agents.
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market
LLMs and Machine Learning done easily
Explore other popular agent tool tools:
LLMinator is Gradio based tool to run opensource LLM models directly from Huggingface. It is categorized as a Agent Tool with 97 GitHub stars.
LLMinator is primarily written in Python. It covers topics such as chatbot, cpu, cuda.
You can find installation instructions and usage details in the LLMinator GitHub repository at github.com/Aesthisia/LLMinator. The project has 97 stars and 19 forks, indicating an active community.
LLMinator is released under the MIT license, making it free to use and modify according to the license terms.
The top alternatives to LLMinator on Agent Skills Hub include VT.ai, c4-genai-suite, captain-claw. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.