by jondot · Agent Tool · ★ 542
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
Awesome Rust LLM is an awesome style list that keeps track and curates the best Rust based LLM frameworks, libraries, tools, tutorials, articles and more. PRs are welcome! Models & Inference llm - a Rust library for running inference from a number of supported LLMs, loads ggml based models rust-bert - all in one pipelines for for transformer-based models (BERT, DistilBERT, GPT2,...). Good for local embedding, port of (python) llm-chain - chaining LLMs in Rust smartgpt (how it works)- use LLMs with the ability to complete complex tasks using plugins diffusers - Stable Diffusion using Rust, 45% faster than Pytorch postgresml - an amazing Postgres extension to do model fetching, inferen
| Stars | 542 |
| Forks | 26 |
| Category | Agent Tool |
| Quality Score | 63.6948881485811/100 |
| Open Issues | 7 |
| Last Updated | 2024-03-06 |
| Created | 2023-05-21 |
| Est. Tokens | ~1k |
Looking for a awesome-rust-llm alternative? If you're comparing awesome-rust-llm with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
Minimal coding agent written in Rust, optimized for memory footprint and performance
User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!
Tactical AI Workspace Monitor & EDR
Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 V
Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption
Explore other popular agent tool tools:
awesome-rust-llm is 🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI. It is categorized as a Agent Tool with 542 GitHub stars.
You can find installation instructions and usage details in the awesome-rust-llm GitHub repository at github.com/jondot/awesome-rust-llm. The project has 542 stars and 26 forks, indicating an active community.
The top alternatives to awesome-rust-llm on Agent Skills Hub include zerostack, cai, kavach. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.