local-llm-function-calling — Agent Tool by rizerphe

by rizerphe · Agent Tool · ★ 437

Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h

About local-llm-function-calling

Local LLM function calling Overview The project is designed to constrain the generation of Hugging Face text generation models by enforcing a JSON schema and facilitating the formulation of prompts for function calls, similar to OpenAI's function calling feature, but actually enforcing the schema unlike OpenAI. The project provides a class that allows users to easily generate text while ensuring compliance with the provided prompt and JSON schema. By utilizing the library, users can conveniently control the output of text generation models. It uses my own quickly sketched project as the enforcer. Features Constrains the generation of Hugging Face text generation models to follow a JSON schema. Provides a mechanism for formulating prompts for function calls, enabling precise data extraction and formatting. Simplifies the text generation process through a user-friendly class. Installation To install the library, use the following command: shell pi

chatgpt-functionshuggingface-transformersjson-schemallmllm-inferenceopenai-function-callopenai-functions

Quick Facts

Stars437
Forks41
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score48.75/100
Open Issues6
Last Updated2024-03-12
Created2023-06-27
Platformspython
Est. Tokens~11k

Compatible Skills

These tools work well together with local-llm-function-calling for enhanced workflows:

  • vllm-cli — semantic(0.16)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • ToolRegistry — semantic(0.19)+complementary+same_lang+similar_pop+shared_platform (52%)
  • SimpleLLMFunc — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (51%)
  • snippy — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (51%)
  • mirascope — semantic(0.16)+complementary+same_lang+similar_pop+shared_platform (50%)

local-llm-function-calling alternative? Top 6 similar tools

Looking for a local-llm-function-calling alternative? If you're comparing local-llm-function-calling with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.

  • Toolio by OoriData · ⭐ 132

    GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool

  • awesome-hacking-lists by taielab · ⭐ 1.3k

    A curated collection of top-tier penetration testing tools and productivity utilities across multiple domains.

  • awesome-hosting by dalisoft · ⭐ 863

    List of awesome hosting sorted by minimal plan price

  • LLM-VM by anarchy-ai · ⭐ 490

    irresponsible innovation. Try now at https://chat.dev/

  • vllm-cli by Chen-zexi · ⭐ 480

    A command-line interface tool for serving LLM using vLLM.

  • edsl by expectedparrot · ⭐ 466

    Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is local-llm-function-calling?

local-llm-function-calling is A tool for generating function arguments and choosing what function to call with local LLMs. It is categorized as a Agent Tool with 437 GitHub stars.

What programming language is local-llm-function-calling written in?

local-llm-function-calling is primarily written in Python. It covers topics such as chatgpt-functions, huggingface-transformers, json-schema.

How do I install or use local-llm-function-calling?

You can find installation instructions and usage details in the local-llm-function-calling GitHub repository at github.com/rizerphe/local-llm-function-calling. The project has 437 stars and 41 forks, indicating an active community.

What license does local-llm-function-calling use?

local-llm-function-calling is released under the MIT license, making it free to use and modify according to the license terms.

What are the best alternatives to local-llm-function-calling?

The top alternatives to local-llm-function-calling on Agent Skills Hub include Toolio, awesome-hacking-lists, awesome-hosting. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.

View on GitHub → Browse Agent Tool tools