Agentic Research
中文
Local Model RuntimeAdvanced

llama.cpp

開源社群macOS · Linux · Windows

A pure C/C++ inference engine — the layer most local solutions build on

Go to official siteCompare with Ollama

Good for

  • Running models on constrained or unusual hardware
  • Understanding low-level quantisation and performance
  • The foundation for a self-built inference service

Not for

  • Anyone avoiding the terminal and compilation
  • Just wanting a model that works after two clicks

We deliberately put “not for” on the same screen — a review that only lists strengths carries no information.

Pricing

Open sourceFree tier

Entirely free and open source; your only cost is hardware.

Amounts not yet manually verified. The above is a qualitative description of the billing model — defer to the official site for numbers.
Official pricing page

Junze editorial rating

Capability
55/5
Ease of use
11/5
Cost value
55/5
Privacy control
55/5

Editorial opinion, not an aggregated user rating. Data last verified: 2026-09-29.

Our articles about llama.cpp

Tools it is often compared with

Alternatives

Ollama

Ollama

4.8/5

Run open models locally with one command, exposing an OpenAI-compatible API

Local Model RuntimeBeginner
Open sourceFree tierPrice verified 2026-09-29

Entirely free and open source; your only cost is hardware and electricity.

Good for
  • Privacy settings where data cannot leave the network
  • Driving token cost to zero at high call volume
  • Offline or unreliable-network environments
4 site articles1 scenariosOfficial siteView tool

vLLM

開源社群（源於 UC Berkeley）

4.3/5

High-throughput LLM inference server — the default choice for self-hosted production

Local Model RuntimeAdvanced
Open sourceFree tierPrice verified 2026-09-29

Open source and free (Apache-2.0); cost is GPU hardware or cloud rental. This site publishes deployment tests and performance numbers.

Good for
  • Self-hosted inference shared by many users
  • Continuous batching to maximise GPU utilisation
  • An OpenAI-compatible endpoint for existing code
4 site articles2 scenariosOfficial siteView tool

Learning tracks that include this tool

This page is an editorial summary, not an official page. Trademarks and product names belong to their respective owners. If anything here is wrong or out of date, tell us and we will correct it. Last verified: 2026-09-29.