by cloudmercato · Agent Tool · ★ 76
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
Ollama Benchmark ollama-benchmark is a handy tool to measure the performance and efficiency of LLMs workloads. .. contents:: Table of Contents :depth: 3 :local: Get started =========== Install Simple as:: pip install https://github.com/cloudmercato/ollama-benchmark/archive/refs/heads/main.zip For monitoring you may install :: pip install https://github.com/cloudmercato/Probes/archive/refs/heads/main.zip Usage ollama-benchmark deliver several workloads: : Evaluate chat speed performance : Evaluate embedding peformance : Evaluate model loading speed : Evaluate answer quality with LLM-as-a-Judge : Live evaluate performance while chatting : Evaluate against LLM attacks Please keep in mind the ollama server configuration during evaluation of results. See for more understanding of Ollama's performance. All the can be configured through command line options. speed @@@@@ This tool allow to run a set of simultaneous requests to the server. The question set is mix of
| Stars | 76 |
| Forks | 8 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 58.3865661364007/100 |
| Open Issues | 1 |
| Last Updated | 2025-04-26 |
| Created | 2024-07-19 |
| Platforms | python |
| Est. Tokens | ~12k |
Looking for a ollama-benchmark alternative? If you're comparing ollama-benchmark with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
LLM Benchmark for Throughput via Ollama (Local LLMs)
[ICLR'25] OpenRCA: Can Large Language Models Locate the Root Cause of Software Failures?
This MCP server provides documentation about Strands Agents to your GenAI tools, so you can use your favorite
This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs.
c4 GenAI Suite
A banchmark list for evaluation of large language models.
Explore other popular agent tool tools:
ollama-benchmark is Handy tool to measure the performance and efficiency of LLMs workloads.. It is categorized as a Agent Tool with 76 GitHub stars.
ollama-benchmark is primarily written in Python. It covers topics such as benchmark, llm, ollama.
You can find installation instructions and usage details in the ollama-benchmark GitHub repository at github.com/cloudmercato/ollama-benchmark. The project has 76 stars and 8 forks, indicating an active community.
ollama-benchmark is released under the MIT license, making it free to use and modify according to the license terms.
The top alternatives to ollama-benchmark on Agent Skills Hub include ollama-benchmark, OpenRCA, mcp-server. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.