by sbhjt-gr · Agent Tool · ★ 92
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
InferrLM (Previously Inferra) InferrLM is a mobile application that brings LLMs & SLMs directly to your Android & iOS device and lets your device act as a local server. Cloud-based models like Claude, Gemini and ChatGPT are also supported. File attachments with RAG are also well-supported for local models. If you want to support me and the development of this project, you can donate to me through Ko-fi. Demo Demos of using the Apple Foundation Model and downloading MLX models from HuggingFace and running them on-device. <img src="assets/demo1.gif" alt="Demo 1" h
| Stars | 92 |
| Forks | 24 |
| Language | TypeScript |
| Category | Agent Tool |
| License | AGPL-3.0 |
| Quality Score | 30.25/100 |
| Open Issues | 3 |
| Last Updated | 2026-06-01 |
| Created | 2025-02-09 |
| Platforms | gemini, node |
| Est. Tokens | ~15006k |
These tools work well together with InferrLM for enhanced workflows:
Looking for a InferrLM alternative? If you're comparing InferrLM with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
A high performance C++ SDK for AI Agents
A high performance C++ SDK for AI Agents
A unified interface for various AI model providers
On-device memory layer for AI agents. Claude Code, Hermes and OpenClaw. Hooks + MCP server + hybrid RAG search
The AI Operating System for Delphi. 100% native framework with RAG 2.0, autonomous agents, MCP protocol, and u
Unlock GitHub Copilot as a local API Gateway. Use Copilot with Cursor, LangChain, and any OpenAI-compatible to
Explore other popular agent tool tools:
InferrLM is InferrLM - On-device AI for iOS & Android. It is categorized as a Agent Tool with 92 GitHub stars.
InferrLM is primarily written in TypeScript. It covers topics such as anthropic, document-processing, edge-ai.
You can find installation instructions and usage details in the InferrLM GitHub repository at github.com/sbhjt-gr/InferrLM. The project has 92 stars and 24 forks, indicating an active community.
InferrLM is released under the AGPL-3.0 license, making it free to use and modify according to the license terms.
The top alternatives to InferrLM on Agent Skills Hub include agents.cpp, agents-cpp-sdk, esperanto. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.