kani: kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)

by zhudotexe · LLM Plugin · ★ 611

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

How to install kani

pip install "kani[openai]"
pip install "kani[huggingface]" torch

Taken from the project's README on GitHub. Check the security audit before running it.

Security audit verdict: SAFE · quality 67/100

None of the 42 rules matched — no credential harvesting, no data exfiltration, no curl-pipe-shell installer. Scanned against 42 published rules built on the SlowMist agent-security taxonomy, refreshed every 8 hours. Full audit →

The quality score combines nine heuristic checks of the repo and its README: completeness, clarity, specificity, examples, structure, agent readiness, step-by-step content, instruction quality and security notes. It rates how well the project explains itself to an agent, not the code.

chatgptframeworkfunction-callinggpt-4large-language-modelsllamallmsmicroframeworkopenaitool-use

Quick Facts

Stars611
Forks33
LanguagePython
CategoryLLM Plugin
LicenseMIT
Quality Score67/100
Open Issues7
Last Updated2026-10-29
Created2023-07-14
Platformspython
Est. Tokens~17k

About kani

kani (カニ) kani (カニ) is a lightweight and highly hackable framework for chat-based language models with tool usage/function calling. Compared to other LM frameworks, kani is less opinionated and o

kani alternative? Top 6 similar tools

Looking for a kani alternative? If you're comparing kani with other llm plugin tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • bigcodebench by bigcode-project · ⭐ 519

    [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

  • awesome-llm-powered-agent by hyp1231 · ⭐ 2.3k

    Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

  • DemoGPT by melih-unsal · ⭐ 1.9k

    🤖 Everything you need to create an LLM Agent—tools, prompts, frameworks, and models—all in one place.

  • LLMCompiler by SqueezeAILab · ⭐ 1.9k

    [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

  • awesome-gpt-prompt-engineering by snwfdhmp · ⭐ 1.6k

    A curated list of awesome resources, tools, and other shiny things for LLM prompt engineering.

  • spacy-llm by explosion · ⭐ 1.4k

    🦙 Integrating LLMs into structured NLP pipelines

More LLM Plugin Tools

Explore other popular llm plugin tools:

View all LLM Plugin tools →

Popular Python Agent Tools

How this security grade is produced

Grades come from a rule-based scan built on the SlowMist agent-security taxonomy: 42 published rules, covering credential harvesting, data exfiltration, curl | sh installers and more. It is a first-layer scan, not a manual audit — we say so rather than overstate it.

The scale of the problem is documented independently: Liu et al. (2026), in a study of 31,132 agent skills, report that 26.1% contain security vulnerabilities. Our own full-catalog census is published as a citable open dataset.

Sources & who's responsible:

View on GitHub → Browse LLM Plugin tools