InferrLM: On-device AI for iOS & Android

by sbhjt-gr · Agent Tool · ★ 100

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install InferrLM

git clone https://github.com/sbhjt-gr/InferrLM

Taken from the project's README on GitHub.

Security audit verdict: SAFE · quality 71/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours.

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

anthropicdocument-processingedge-aiembeddingsgeminiggufhttp-serverllama-cppllamacpplocal-inference

Quick Facts

Stars100
Forks24
LanguageTypeScript
CategoryAgent Tool
LicenseAGPL-3.0
Quality Score71/100
Open Issues3
Last Updated2026-06-24
Created2025-02-09
Platformsgemini, node
Est. Tokens~16k

About InferrLM

InferrLM (Previously Inferra) InferrLM is a mobile application that brings LLMs & SLMs directly to your Android & iOS device and lets your device act as a local server. Cloud-based models like Claude, Gemini and ChatGPT are also supported. File attachments with RAG are also well-supported for local models.

Compatible Skills

These tools work well together with InferrLM for enhanced workflows:

InferrLM alternative? Top 6 similar tools

Looking for a InferrLM alternative? If you're comparing InferrLM with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • InferrLM by loomax-labs · ⭐ 114

    InferrLM - On-device AI for iOS & Android

  • agents.cpp by RunEdgeAI · ⭐ 113

    A high performance C++ SDK for AI Agents

  • agents-cpp-sdk by RunEdgeAI · ⭐ 77

    A high performance C++ SDK for AI Agents

  • gg-framework by KenKaiii · ⭐ 235

    The coding agent that gets more out of your AI subscription. Fastest and leanest of 20 agents tested, with unl

  • esperanto by lfnovo · ⭐ 220

    A unified interface for various AI model providers

  • SimplerLLM by hassancs91 · ⭐ 219

    Python library for building with LLMs. One interface across 11 providers (OpenAI, Anthropic, Gemini, DeepSeek,

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular TypeScript Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse Agent Tool tools