Agentic Research
中文
Local Model RuntimeAdvanced

llama.cpp

開源社群macOS · Linux · Windows

A pure C/C++ inference engine — the layer most local solutions build on

Go to official siteCompare with Ollama

Good for

  • Running models on constrained or unusual hardware
  • Understanding low-level quantisation and performance
  • The foundation for a self-built inference service

Not for

  • Anyone avoiding the terminal and compilation
  • Just wanting a model that works after two clicks

We deliberately put “not for” on the same screen — a review that only lists strengths carries no information.

Pricing

Open sourceFree tier

Entirely free and open source; your only cost is hardware.

Amounts not yet manually verified. The above is a qualitative description of the billing model — defer to the official site for numbers.
Official pricing page

Editorial rating

Capability
55/5
Ease of use
11/5
Cost value
55/5
Privacy control
55/5

Editorial opinion, not an aggregated user rating. Data last verified: 2026-09-29.

Two ways in

PATH A · START WITH THIS TOOL

You have picked it and want it running. Install first, understand later — the vocabulary makes more sense once the tool is on your screen.

  1. 1Comparison of Other Inference Frameworks: A Complete Guide to llama.cpp, MLX, and ExLlamaV2
PATH B · SURVEY FIRST, THEN CHOOSE

You are still comparing. See where this tool sits in the landscape before committing an afternoon to it.

Development path

Form factor：local-runtime

No verified timeline events for this tool yet.

First release: not stated. Not derived automatically. The earliest timeline event mentioning this tool may be a version milestone, a different product with the same name, or a passing mention rather than a launch; each needs checking against an official source, so this is left empty.

Our articles about llama.cpp

Tools it is often compared with

Alternatives

Ollama

Ollama

4.8/5

Run open models locally with one command, exposing an OpenAI-compatible API

Local Model RuntimeBeginner
SubscriptionFree tierPrice verified 2026-10-01

Local run free; Pro USD 20/mo (USD 60 credits); Max USD 100/mo (USD 300 credits); Team USD 500/mo; Enterprise custom.

Good for
  • Privacy settings where data cannot leave the network
  • Driving token cost to zero at high call volume
  • Offline or unreliable-network environments
4 site articles1 scenariosOfficial siteView tool

vLLM

開源社群（源於 UC Berkeley）

4.3/5

High-throughput LLM inference server — the default choice for self-hosted production

Local Model RuntimeAdvanced
Open sourceFree tierPrice verified 2026-09-29

Open source and free (Apache-2.0); cost is GPU hardware or cloud rental. This site publishes deployment tests and performance numbers.

Good for
  • Self-hosted inference shared by many users
  • Continuous batching to maximise GPU utilisation
  • An OpenAI-compatible endpoint for existing code
4 site articles2 scenariosOfficial siteView tool

Learning tracks that include this tool

This page is an editorial summary, not an official page. Trademarks and product names belong to their respective owners. If anything here is wrong or out of date, tell us and we will correct it. Last verified: 2026-09-29.