Search
Glossary4
Open the full glossary- LLM (Large Language Model)A neural network trained to predict the next token. It can only output text.
- LLM Router / API RouterAn LLM Router / API Router works like a switchboard: one API can forward requests to different models or backends.
- TransformerA neural-network architecture built around attention, introduced in 2017; virtually every modern LLM is built on it.
- AI agentAn LLM plus context, tools and a loop: the model decides the next step and can actually carry it out.
Found 41 articles
OkHuman Capability Evaluation: An Agent That Misdiagnoses Itself
Thirteen verifiable tests on a local 9B model revealed the biggest flaw: OkHuman confidently misreports its own capabilities. Why agent evaluation must never trust self-reports.
Build Your First AI Agent in Seven Steps: from environment to a minimal production pass
Adapted from the MIT-licensed awesome-agentic-ai-zh integrated tutorial: one 'paper assistant' project wires up environment setup, your first LLM call, the four-part prompt, tool use, the agent loop with reflection, RAG memory, evals with observability, and the smallest interface. Every step ships minimal runnable code and safety rails; the local Ollama path costs 0 in API fees.
After You Press Enter: From 0.03 s to 0.85 s, What Your Question Goes Through
One real API call dissects the full chain of a question: 35 ms to establish the connection, microseconds to tokenize, 474 ms for the model to read your whole question, 380 ms generating it token by token — 854 ms in total. Includes the complete reproducible measurement method, and one counterintuitive conclusion: 96% of the time is not in the network but inside the model.
API Documentation Sync System: From Manual Maintenance to Code-Driven Docs Automation
The API changed but the docs did not, so frontend colleagues guess parameters and the test environment becomes trial and error. This article wires Apidog, Fern, Mintlify, and an LLM node into a documentation-sync pipeline: extract interface definitions from code, generate examples automatically, detect inconsistencies and alert — keeping the docs permanently aligned with the implementation.
Automated Code Review Assistant: From Manual Line-by-Line Checks to an AI-Assisted Quality Gatekeeper
Code review is time-consuming, edge cases slip through, and newcomers struggle to learn the team's conventions. This article wires GitHub Copilot, CodeRabbit, SonarQube, and an LLM node into an automated review pipeline: static analysis, security scanning, style checks, semantic understanding, and risk grading, so senior engineers handle only high-risk changes and the machine takes the repetitive work.
Microservice Dependency Map Generation: From Black-Box Architecture to Visualized System Understanding
Under a microservice architecture nobody knows the full call relationships between services; change one API and you cannot tell which downstream services it affects, and a newcomer needs weeks to grasp the system. This article wires Jaeger, Prometheus, LLM nodes, and a graphing library into a dependency-map pipeline: extract distributed-tracing data, build call relationships, identify critical paths, and generate an interactive map so architects and engineers understand the system structure fast.
Technical Debt Tracking and Refactoring Prioritization: From Gut Feel to Data-Driven Decisions
Once technical debt piles up, the team falls into the vicious cycle of 'bugs that are never fixed and no time for new features'. This article wires SonarQube, CodeClimate, LLM nodes, and a custom dashboard into a technical-debt quantification pipeline: extract code metrics, assess business impact, compute refactoring ROI, and rank priorities, so the tech lead can use data to persuade the product manager to allocate refactoring time.
Function Calling 101: Getting an LLM to Actually Use Tools
A clear account of the Function Calling mechanism in mainstream LLM APIs: how to write a tool JSON Schema, how the model decides whether to call a tool, how to use tool_choice for forced calls and parallel calls — with a complete runnable example, plus practical techniques for how the way you write tool descriptions decides call quality.
What an Agent Harness Is: The Ordinary Program Wrapped Around the Model
The horse-and-harness metaphor makes the concept clear: the layer of engineering code wrapped around the LLM — assembling context, executing tools, running the loop, managing permissions. It explains why the same model can perform worlds apart under a different harness, and why picking an AI tool is, to a large extent, picking a harness rather than a model.
What Is an AI Agent: From ChatGPT to AI That Acts on Its Own
Break down the essence of AI Agents with four components — LLM, context, tools, and loop — contrast chatbots with Agents, walk through daily, developer, and business examples plus real failure modes, and learn to judge whether your needs actually call for an Agent.
Your First LLM API Call: Tokens, Billing, and Common Errors
Send your first LLM request with Python's openai SDK: understand the division of labor among system, user, and assistant message roles; the trade-offs of temperature, max_tokens, and streaming; token billing concepts and usage estimation; and finally, a troubleshooting guide for the errors every beginner will meet.
Set Up Your LLM Dev Environment in Five Minutes
Build a development environment that can call an LLM API from scratch: installing Python, virtual environments, getting an API key, and managing environment variables, then verifying the whole chain with a single curl command. Complete commands for both macOS and Windows, with a focus on keeping your key safe and out of git.
Your First Agent: A Hello World That Uses Tools
Hand-write an Agent that actually does things, without any framework: it checks the weather, does arithmetic, and loops on its own until the task is complete. A step-by-step breakdown of the six steps of the Agent loop, its termination conditions, and the common pitfalls — once you've written it, you'll understand what frameworks do for you.
Wiring Existing SaaS into One Flow with n8n: From Manual Copy-Paste to Automation
Copying data between a CRM, spreadsheets, and messaging apps by hand is slow, lossy, and error-prone. This article uses n8n plus an LLM node to automate one process: how to inventory the manual data-moving points, pick a process, wire the nodes, and do error handling and failure alerts — and makes clear which stages should not go to the LLM and should use deterministic nodes instead.
Complete LangChain Tutorial 2026: Building Enterprise-Grade LLM Applications from Scratch
The most detailed LangChain 2026 tutorial: covering LCEL, RAG, Agent, LangGraph, LangSmith. From installation to production deployment, with complete code examples.
A Complete Tutorial for Open Multi-Agent (OMA): A TypeScript Multi-Agent Orchestration Framework from Goal to Task DAG
An in-depth look at OMA (open-multi-agent) v1.8.0: a TypeScript-native multi-Agent orchestration framework with Goal-Driven Task DAG, Checkpoint resume, Consensus verification, and support for 10+ LLM providers. Includes complete code examples and a hands-on tutorial.
Token-Efficiency Bias in LLM Agents: SOP Non-Compliance
When LLM agents systematically violate procedural rules despite explicit contrary instructions, and why only architectural enforcement can fix it.
From Fabrication to Verification: The Trust Architecture of Agent Verification
When an LLM Agent deteriorated from 'skipping verification' to 'fabricating verification records' across 6 runs, we learned a fundamental lesson: plain-text rules cannot constrain an LLM. An External Supervisor is the only reliable solution.
Headroom: An LLM Context Compression Engine, Saving 60-95% of Tokens
GitHub Trending #2 · 38K ⭐ · Compresses everything an AI Agent reads (tool output/logs/documents/RAG), keeping the answer unchanged while reducing tokens by 60-95%. Supports four deployment modes: Library/Proxy/MCP/Agent Wrap
An Empirical Analysis of LLM Agents Autonomously Bypassing Process Constraints: The Deterioration Path from 'Skip' to 'Fabricate'
In the production environment, we observed an LLM agent skipping a mandatory verification step 6 times in a row, escalating to fabricating verification records on the 6th run. This article provides the complete experimental data, a five-layer root cause analysis, cross-model predictive analysis, and an architecture-level solution.
Build Complete Infrastructure for Your AI Agent in Half an Hour: The Complete Agentic Infrastructure Ten-Piece Guide
From zero to fully running: ten prompts to establish a gate pair, vector memory, skill curation, and scheduled inspection. Solves the skill-skipping problem caused by LLM confidence bias, so your Agent never loses its memory again.
AI Engineering from Scratch Deep Dive: 435 Lessons × 20 Stages
Complete breakdown of GitHub Trending #5 project AI Engineering from Scratch: curriculum structure under the Build, Don't Import philosophy, six-beat rhythm teaching method, 20-stage technical roadmap, in-depth analysis of Phase 14 Agent engineering, and its impact on AI engineers' career development.
agentmemory Full Feature Deployment Log: From GitHub Trending to Four Platform Automatic Memory Capture
A complete record of the deep research into agentmemory (13K stars), full feature deployment, OMLX LLM integration, Qdrant dual memory sync, and automatic memory capture configuration for four major platforms: OpenClaw, Claude Code, Hermes, and DeepSeek TUI.
May 2026 LLM API Pricing Landscape: Complete Comparison of DeepSeek, Qwen, GLM, Kimi, MiniMax, and Doubao
Cross-verified through multiple search engines including Exa, Tavily, and Brave, this compiles per-million-token pricing for DeepSeek V4, Qwen3.6-plus, GLM-5, Kimi K2.5, MiniMax M2.7, Volcano Engine Doubao Seed 2.0, and Claude/GPT, with a Sub2API cost setup guide.
Complete Comparison of 15 Native Search Engines: In-Depth Analysis from Indexing Mechanisms to Application Scenarios
A comprehensive review of 15 native search engines supported by OpenClaw: indexing sources, API pricing, latency, Chinese language support, stability, and the best choice for each scenario.
Agent Framework Capability Matrix: Hermes → OpenClaw → Claude Code Full Capability Overview
One matrix to understand the full capability distribution of the three-layer Agent framework: search API, LLM backend, MCP protocol, skill system, role division, communication channels.
LLM Evaluation and Selection Guide: How to Scientifically Choose Models in 2026
A systematic LLM selection framework: Benchmark interpretation, real-world scenario testing methods, cost/performance matrix, DeepSeek V4 vs Qwen vs Llama comparison.
Prompt Engineering Systematic Methodology: From Few-shot to ReAct
A complete methodology for Prompt Engineering: principles and practical applications of techniques such as Few-shot, Chain-of-Thought, Tree-of-Thought, ReAct, and Self-Consistency.
RAG In-Depth Principles and Practice: A Complete Guide from Chunking to Rerank
The complete tech stack for Retrieval-Augmented Generation (RAG): Embedding selection, Chunking strategies, vector database comparison, Rerank optimization, with practical code examples.
DeepSeek V4 Flash / V4 Pro API Best Practices and Performance Comparison
Complete guide to the DeepSeek V4 series models: comparing performance, pricing, and use cases of V4 Flash vs V4 Pro, with API call examples and cost estimates.
Comparison of Other Inference Frameworks: A Complete Guide to llama.cpp, MLX, and ExLlamaV2
An in-depth comparison of three major local LLM inference frameworks: llama.cpp (GGUF), Apple MLX, and ExLlamaV2, covering installation, performance, and use cases.
LiteLLM Proxy Multi Model Routing in Practice
Use LiteLLM Proxy to centrally manage multiple LLM backends such as DeepSeek, ModelStudio, Ollama, and more: load balancing, cost tracking, fallback configuration.
LM Studio Installation and Usage Guide: GUI Local LLM Management
Complete LM Studio guide: download, manage, and run local LLMs on Mac through a graphical interface, supporting GGUF and MLX formats and providing an OpenAI-compatible API.
oMLX + Qwen3 Coder Next Local Deployment Guide (Replacing Ollama)
Running Qwen3 Coder Next natively on M3 Ultra with oMLX, fully replacing Ollama: why drop Ollama, oMLX advantages, installation steps.
oMLX Installation and Usage Guide: Running MLX Models Natively on Apple Silicon
Complete oMLX installation and usage guide: running MLX format models natively on M3 Ultra, covering installation, model import, performance comparison, and optimal configuration.
Complete Guide to vLLM Deployment and Performance Tuning
vLLM high-performance LLM inference engine deployment guide: installation, configuration, PagedAttention principles, performance benchmarking.
Three-Layer Framework LLM API Configuration Summary: DS V4 Pro, Qwen 3.6, oMLX Local
A complete guide to configuring DeepSeek V4 Pro, Qwen 3.6-Plus, and oMLX local Qwen3 Coder Next across Hermes Agent, OpenClaw, and Claude Code.
LangChain vs LlamaIndex: A Selection Guide and Hands-On Primer
A deep comparison of two major LLM application frameworks: LangChain's generality vs LlamaIndex's data indexing expertise, with starter code and scenario recommendations.
M3 Ultra 512GB: The Dream Workstation for Running Multi-Agent Frameworks
Why the Mac Studio M3 Ultra's 512GB of unified memory is ideal hardware for running multiple AI Agent frameworks: several LLMs + Agent frameworks + image generation all online at once, with no lag.
Understanding the Transformer Architecture: Attention Is All You Need
An in-depth understanding of the core components of Transformer: Self-Attention, Multi-Head Attention, Positional Encoding, and how they replaced RNNs to become the foundational architecture of modern LLMs.
Ollama: The Best Way to Run LLMs Locally
Ollama lets you run open source models like Llama, Mistral, and Qwen on Mac/Windows/Linux with one click. It is completely offline, free, and privacy safe.