by SqueezeAILab · Agent Tool · ★ 1.8k
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
LLMCompiler: An LLM Compiler for Parallel Function Calling [Paper] LLMCompiler is a framework that enables an efficient and effective orchestration of parallel function calling with LLMs, including both open-source and close-source models, by automatically identifying which tasks can be performed in parallel and which ones are interdependent. TL;DR: The reasoning capabilities of LLMs enable them to execute multiple function calls, using user-provided functions to overcome their inherent limitations (e.g. knowledge cutoffs, poor arithmetic skills, or lack of access to private data). While multi-function calling allows them to tackle more complex problems, current methods often require sequential reasoning and acting for each function which can result in high latency, cost, and sometimes inaccurate behavior. LLMCompiler addresses this by decomposing problems into multiple tasks that can be executed in parallel, thereby efficiently orchestrating multi-function calling. With LLMCompiler, the user specifies the tools along with optional in-context examples, and LLMCompiler automatically computes an optimized orchestration for the function calls.
| Stars | 1,827 |
| Forks | 126 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 41.75/100 |
| Open Issues | 6 |
| Last Updated | 2024-07-10 |
| Created | 2023-12-06 |
| Platforms | python |
| Est. Tokens | ~25k |
Looking for a LLMCompiler alternative? If you're comparing LLMCompiler with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allow
Harness LLMs with Multi-Agent Programming
🦙 Integrating LLMs into structured NLP pipelines
SRE Agent - CNCF Sandbox Project
历年ICLR论文和开源项目合集，包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market
Explore other popular agent tool tools:
LLMCompiler is [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling. It is categorized as a Agent Tool with 1.8k GitHub stars.
LLMCompiler is primarily written in Python. It covers topics such as efficient-inference, function-calling, large-language-models.
You can find installation instructions and usage details in the LLMCompiler GitHub repository at github.com/SqueezeAILab/LLMCompiler. The project has 1.8k stars and 126 forks, indicating an active community.
LLMCompiler is released under the MIT license, making it free to use and modify according to the license terms.
The top alternatives to LLMCompiler on Agent Skills Hub include llama-cpp-agent, langroid, spacy-llm. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.