llama-cpp-agent — Agent Tool by Maximilian-Winter

by Maximilian-Winter · Agent Tool · ★ 620

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

agentsfunction-callingllamacppllmllm-agentllm-frameworkllmsparallel-function-call

Quick Facts

Stars620
Forks69
LanguagePython
CategoryAgent Tool
Quality Score41.75/100
Open Issues24
Last Updated2026-03-09
Created2023-12-29
Platformspython
Est. Tokens~383k

Compatible Skills

These tools work well together with llama-cpp-agent for enhanced workflows:

  • SimplerLLM — semantic(0.30)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • SimpleLLMFunc — semantic(0.28)+complementary+rare_topics+same_lang+similar_pop+shared_platform (59%)
  • LLMCompiler — semantic(0.51)+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • Agently — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)
  • ai-microcore — semantic(0.19)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)

llama-cpp-agent alternative? Top 6 similar tools

Looking for a llama-cpp-agent alternative? If you're comparing llama-cpp-agent with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • LLMCompiler by SqueezeAILab · ⭐ 1.8k

    [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

  • holmesgpt by HolmesGPT · ⭐ 2.4k

    SRE Agent - CNCF Sandbox Project

  • superglue by superglue-ai · ⭐ 2.0k

    superglue (YC W25) builds integrations and tools from natural language. Get production-grade tools for long ta

  • code-act by xingyaoww · ⭐ 1.6k

    Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi C

  • functionary by MeetKai · ⭐ 1.6k

    Chat language model that can use tools and interpret the results

  • Agently by AgentEra · ⭐ 1.6k

    [GenAI Application Development Framework] 🚀 Build GenAI application quick and easy 💬 Easy to interact with

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is llama-cpp-agent?

llama-cpp-agent is The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured ou. It is categorized as a Agent Tool with 620 GitHub stars.

What programming language is llama-cpp-agent written in?

llama-cpp-agent is primarily written in Python. It covers topics such as agents, function-calling, llamacpp.

How do I install or use llama-cpp-agent?

You can find installation instructions and usage details in the llama-cpp-agent GitHub repository at github.com/Maximilian-Winter/llama-cpp-agent. The project has 620 stars and 69 forks, indicating an active community.

What are the best alternatives to llama-cpp-agent?

The top alternatives to llama-cpp-agent on Agent Skills Hub include LLMCompiler, holmesgpt, superglue. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse Agent Tool tools