Agentic Research

Skills Triggering Deep Dive: Why Your AI Agent Has 200 Skills but Can't Use Even One

2026/06/1057 min readUltraClaw閱讀中文原文
TopicsAgent ArchitectureOpenClawAgentic Infrastructure

Core problem: Your AI Agent has 200+ skills installed, but when you say "make me a website" in Chinese, the Agent has no idea that the Frontend Design skill exists.
Audit scope: 242 OpenClaw skills · 6 languages covered · 56 hours of real-world testing
Key finding: Skill matching mechanisms were never designed with non-English users in mind, even though they make up 75% of AI Agent users.

Preface: One Skill, the "Invisibility" of Seven Languages

In May 2026, we did something very simple: on the Junze Think Tank AI assistant (UltraClaw), we tried to trigger a known installed skill in Chinese, Japanese, Korean, Arabic, and Hindi.

The results were shocking.

LanguageTrigger WordsSkill Hit
🇹🇼 Traditional Chinese"Help me make a website"❌ No match
🇨🇳 Simplified Chinese“Help me make a website”❌ No match
🇯🇵 Japanese"Make me a website"❌ No match
🇰🇷 한국어"웹사이트 만들어줘"❌ Miss
🇸🇦 العربية"اصنع لي موقعاً"❌ No match
🇮🇳 हिन्दी"मेरे लिए एक वेबसाइट बनाओ"❌ Miss
🇬🇧 English"build me a website"✅ Matched

The same skill, the same sentence in six languages, but only English triggers it.

This is not a performance issue. It is not a model issue. This is a complete lack of skill, for all non-English users.

"If a skill cannot be triggered by your language, it does not exist for you."


1. Scale of the Problem: Not Just a Few Skills, but the Entire Ecosystem

After receiving this signal, we conducted a comprehensive audit of all installed OpenClaw skills.

Audit Methodology

DimensionParameter
Audit dateMay 2026
Total skills242
Audit scopeLanguage coverage of the description field, keyword matching performance, non-English trigger success rate
Test languagesTraditional Chinese, Simplified Chinese, Japanese, Korean, Arabic, Hindi + English baseline
Test methodFor each skill, construct typical user queries in seven languages → record whether they match

Key Data

MetricData
Skills with an English-only description230/242 (95.0%)
Skills containing non-English keywords12/242 (5.0%)
Non-English trigger success rate~20%
Fully invisible skills (cannot be triggered in any non-English language)64
Of these, core skills (frequently used and invisible)4

The Four "Invisible Killers"

Skill NameNon-English Trigger RateImpact
Frontend Design0%Any non-English user's "website design" request fails completely
Deploy Vercel0%The hit rate for "help me deploy" is zero
DD Checklist0%Chinese due diligence requests cannot trigger the process
Email Report0%"Help me write an email report" is completely ineffective

These four skills are the most frequently used in our daily work. They are completely invisible to non-English users.

95% of open-source skills have only an English description. Meanwhile, among global AI Agent users, non-native English speakers account for 75%.


2. Root Cause Analysis: AI Agent Platform Skill Matching Mechanisms Have Never Considered Language

How Skills Are 'Discovered'

In AI Agent platforms such as OpenClaw and Claude Code, the skill triggering process is as follows:

User enters query
    ↓
The system reads the SKILL.md of all skills
    ↓
Extracts keywords from the description field of each skill
    ↓
Matches the user query against all description keywords
    ↓
Successfully matched skills → added to the candidate pool
    ↓
LLM selects the most suitable skill from the candidate pool

The critical steps are the third and fourth steps.

Matching depends on word segmentation in description. However, Chinese, Japanese, Korean, Arabic, and Hindi do not use spaces for tokenization. Their vocabulary requires semantic understanding, not simple string matching.

When a user says "website" (website), the system searches for website in the English description → no match → 0 matches.

Technical Details: Why Non-English Keyword Matching Is Bound to Fail

# English description tokenization:
"Production-quality frontend UI engineering with modern design systems"
→ ["production", "quality", "frontend", "ui", "engineering", "modern", "design", "systems"]

# Chinese query tokenization:
"Help me make a website"
→ ["help", "me", "make", "a", "web", "site"]  ← character level
or
→ ["Help me make a website"]  ← whole-sentence matching

Neither case will match any term in the English description.

This is not a text matching problem. This is an architectural design problem. The entire skill discovery mechanism assumes that all users use English. In the 2026 AI Agent ecosystem, this is a structural flaw.


3. Real-World Case: A Complete Record of the "Invisibility" of the Frontend Design Skill

Using the Frontend Design skill as an example, we fully documented every part of its "invisibility."

Original Skill description (Before Fix)

description: "Production-quality frontend UI engineering with modern design systems. 
             Covers Next.js, React, Tailwind CSS, shadcn/ui, Framer Motion. 
             From design brief through deployment."

Real Conversation with a Chinese-Speaking User

User: Help me make a restaurant Landing Page website
Agent: I can help you write HTML/CSS code. What style do you want?
User: (thinking to themselves: Why not use the Frontend Design skill?)

The Agent's response seems reasonable, and it will indeed write code. But the problem is:

  1. No structured process was used: The Frontend Design skill includes a complete design → development → testing → deployment process
  2. No error-prevention mechanism: Raw code writing vs. skill-guided structured output, the quality gap is enormous
  3. Users do not know the skill exists: Users think the Agent is "not smart enough" and switch to another AI tool

This is the cost of an invisible skill, not a missing capability, but a capability that exists yet is never triggered.

description After the Fix

description: "Website design Website building Frontend development Webpage production Landing Page Responsive Webデザイン ウェブサイト フロントエンド 
             웹디자인 웹사이트 만들기 프론트엔드 تصميم مواقع إنشاء صفحات ويب واجهة أمامية 
             वेबसाइट डिज़ाइन फ्रंटएंड विकास Production-quality frontend UI engineering..."

Only one line of multilingual keywords was added. The effect was immediate:

MetricBefore FixAfter Fix
Traditional Chinese trigger rate0%100%
Simplified Chinese trigger rate0%100%
Japanese trigger rate0%100%
Korean trigger rate0%100%
Arabic trigger rate0%100%
Hindi trigger rate0%100%

One line. Six languages. From 0% to 100%.


IV. Solution Architecture: Three-Tier Keyword Strategy

Based on audit findings and remediation experiments, we designed a systematic three-tier keyword strategy:

Architecture Overview

┌──────────────────────────────────────────────────────────────────┐
│                   Three-Tier Keyword Strategy                    │
├──────────────────────┬────────────────────┬──────────────────────┤
│  Layer 1             │  Layer 2           │  Layer 3             │
│  Core Function Words │  User Intent Words │  Domain Terminology  │
├──────────────────────┼────────────────────┼──────────────────────┤
│  The most            │  How users         │  English retained    │
│  intuitive name      │  express their     │  + multilingual      │
│  for the skill       │  needs             │  additions           │
├──────────────────────┼────────────────────┼──────────────────────┤
│  Website design      │  Help me make      │  Frontend            │
│  Site building       │  I want            │  CSS                 │
│  Frontend development│  Make a            │  React               │
│  Responsive          │  Create            │  Tailwind            │
│                      │  Generate          │  shadcn/ui           │
└──────────────────────┴────────────────────┴──────────────────────┘

Layer 1: Core Function Words

Definition: The most intuitive and natural term a user would use as a first reaction to this skill.

These words are not technical terms; they are what users actually say. Someone who has never written code, when asking an Agent to build a website, would say "website design" or "website building," not "React SPA with Next.js App Router." The first layer's task is to put these natural-language labels into the description.

SkillOriginal English NameFirst-Level Keyword Examples
Frontend DesignFrontend DesignWebsite design, website building, frontend development, web page production, Landing Page
Deploy VercelDeploy VercelDeployment, launch, website publishing, Deploy
DD ChecklistDD ChecklistDue Diligence, DD, Due Diligence, Risk Screening
Email ReportEmail ReportEmail Report, Email Report, Email Digest, Weekly Report

Key insight: The source of the first-level keywords is not technical documentation, but real user conversation records. We reviewed 300+ user queries to extract these terms.

Layer 2: User Intent Words

Definition: how a user expresses "I want to do something."

The importance of this layer is easy to underestimate. Pure feature keywords ("website design") can match noun queries ("website design"), but users most often use action-oriented expressions:

Intent ModeVocabulary Examples
Requesting helpHelp me make, help me, please help, Help me
Proactively expressI want, I think, I need, I would like
Action instructionMake one, establish, generate, create

Layer 3: Domain Terminology (Domain Terms)

Definition: Retain the original English technical terms and add the corresponding technical vocabulary for each target language.

LanguageFrontendCSSReactDeployment
🇹🇼 Traditional ChineseFrontendStylesheetReactDeployment
🇨🇳 Simplified ChineseFrontendStylesheetReactDeployment
🇯🇵 JapaneseFrontendCSSReactDeployment
🇰🇷 한국어프론트엔드CSS리액트배포
🇸🇦 العربيةواجهة أماميةCSSReactنشر
🇮🇳 हिन्दीफ्रंटएंडCSSReactडिप्लॉयमेंट

Principle: The description contains whatever the user says. It's that simple.


5. Batch Repair: Automated Six-Language Keyword Injection

Manually modifying 242 skills is impractical. We developed an automated script.

Script Features

python3 skills-triggering.py \
  --skills-dir ~/.openclaw/workspace/skills \
  --languages zh-TW,zh-CN,ja,ko,ar,hi \
  --backup \
  --dry-run
ParameterDescription
--skills-dirSkill directory path
--languagesTarget language list
--backupAutomatically back up original files
--dry-runPreview mode, does not make actual changes

Workflow

1. Scan directory → discover all SKILL.md
2. Read name and description
3. Infer core function words based on skill name
4. Add intent words based on skill category
5. Call translation engine to generate six-language keywords
6. Inject keywords into the front of description
7. Back up original file → write changes

Core Script Logic

# Keyword inference rules (simplified version)
SKILL_KEYWORD_MAP = {
    "frontend": {
        "zh-TW": ["website design", "site building", "frontend development", "web page creation"],
        "zh-CN": ["website design", "site building", "frontend development", "web page creation"],
        "ja": ["Webデザイン", "ウェブサイト", "フロントエンド"],
        "ko": ["웹디자인", "웹사이트", "프론트엔드"],
        "ar": ["تصميم مواقع", "واجهة أمامية", "إنشاء صفحات"],
        "hi": ["वेबसाइट डिज़ाइन", "फ्रंटएंड", "वेब पेज"]
    },
    "deploy": {
        "zh-TW": ["deployment", "launch", "release"],
        "zh-CN": ["deployment", "launch", "release"],
        "ja": ["デプロイ", "配信", "公開"],
        "ko": ["배포", "게시", "공개"],
        "ar": ["نشر", "رفع", "إطلاق"],
        "hi": ["डिप्लॉय", "प्रकाशित", "अपलोड"]
    },
    # ... more skill categories
}

# Intent word templates (generic across skills)
INTENT_PATTERNS = {
    "zh-TW": ["help me make", "I want", "make a", "create", "generate"],
    "zh-CN": ["help me make", "I want", "make a", "create", "generate"],
"ja": ["make", "do", "please", "create"],
    "ko": ["만들어줘", "해줘", "제작", "생성"],
    "ar": ["اصنع لي", "أريد", "أنشئ", "ساعدني"],
    "hi": ["बनाओ", "चाहिए", "करो", "मदद करो"]
}

6. Effectiveness Validation: Before and After Comparison Data

After comprehensive repairs, we re-audited 242 skills:

Overall Metrics

MetricBefore FixAfter FixImprovement
Skill Discovery Rate~35%~90%+157%
Non-English Match Rate~20%~95%+375%
Traditional Chinese Match Rate~18%97%+439%
Simplified Chinese Match Rate~18%97%+439%
Japanese Match Rate~15%93%+520%
Korean Match Rate~15%93%+520%
Arabic Match Rate~10%88%+780%
Hindi Match Rate~10%88%+780%
Number of Completely Invisible Skills640-100%
User complaints that it is "not smart enough"FrequentVery rare-85%

Before and After Comparison of the Four Core Skills

SkillBefore Fix (Multilingual Average)After Fix (Multilingual Average)
Frontend Design0%100%
Deploy Vercel0%100%
DD Checklist0%98%
Email Report0%97%

Four core skills went from collectively invisible to near perfect triggering, with only one line of text changed.

Real Conversation Comparison

Before Fix:

User: Make me a Landing Page
Agent: Sure, I can help you write HTML. What content do you want?
User: (switched to another Agent)

After Fix:

User: Make me a Landing Page
Agent: 🛠️ Found relevant skill: Frontend Design
      Starting Frontend Design process:
      1. Requirements analysis → Determine design style
      2. Component architecture → React + Tailwind
      3. Responsive layout → Mobile First
      4. Animation effects → Framer Motion
      5. Deployment → Vercel
      Please confirm the above process, or tell me your preferences?

7. Why This Is the First Layer of Agentic Infrastructure

In the seven-layer Agentic Infrastructure architecture we propose, Skills Triggering is positioned as the first layer, the discovery layer. This is not accidental.

Logical Order of the Architecture

Layer 1: Skills Triggering  →  Skills can be correctly discovered (prerequisite)
Layer 2: Skill Router       →  Task-matched correct skill combination
Layer 3: Skill Reporting    →  Every step visible
Layer 4: Vector Memory      →  Never forget
Layer 5: Skill Curator      →  Full skill lifecycle management
Layer 6: Agent Evolver      →  Self-evolution
Layer 7: Agent Previsor     →  Risk prediction

If the first layer fails, all six subsequent layers are wasted. A skill that cannot be triggered, no matter how precise its routing, how complete its memory, or how deep its introspection, does not exist for the user.

This is the fundamental bottleneck to the widespread adoption of AI Agents:

75% of AI Agent users worldwide are non-native English speakers, but 95% of skills have only English descriptions. This is not a language barrier; it is 75% of users being systematically excluded from the skill ecosystem.

Supporting Data

Market DataSource
Global AI Agent market reaches USD 47.1 billion in 2026MarketsAndMarkets
Non-native English-speaking AI users account for 75%Statista 2026
40% of AI projects are canceled due to coordination failuresGartner 2026
Transparency is the third-largest barrier to enterprise adoption of AI AgentsDeloitte 2026

Skills Triggering does not solve a small bug; it solves the structural exclusion of non-English-speaking users from the AI Agent ecosystem.


8. One-Line Installation

mkdir -p skills/skills-triggering && curl -sSL https://raw.githubusercontent.com/Bryan-cmf/agentic-infrastructure/main/skills-triggering/SKILL.md -o skills/skills-triggering/SKILL.md

After installation, your Agent will automatically gain:

  • Complete documentation for the three-layer keyword strategy
  • Six-language keyword templates (Traditional Chinese, Simplified Chinese, Japanese, Korean, Arabic, Hindi)
  • Manual refinement guide (for individual skills)
  • Batch script usage instructions (for the entire skill library)

9. Future Direction: From Description Matching to Semantic Understanding

The current three-layer keyword strategy is a transitional solution. It addresses the most urgent problem, but it is not the ultimate answer.

Long-Term Roadmap

PhaseApproachStatus
v1Manual multilingual keyword injection✅ Completed
v2Batch automation script✅ Completed
v3Embedding-based cross-language semantic matching🔄 In development
v4LLM autonomous translation of description📋 Planned

Technical Direction for v3

The current keyword matching is at the lexical level. v3 will use semantic-level matching:

User says, "Make me a webpage"
    ↓
Embedding model encodes as vector [0.23, -0.45, 0.78, ...]
    ↓
Calculate semantic similarity with vectors of all skill descriptions
    ↓
"Website design, site building, front-end development..." → similarity 0.94 ← Match!

This will allow user queries in any language to match the correct skill, without needing to pre-write keywords for all languages in the description.


Conclusion: The One-Line Revolution

We spent 56 hours auditing 242 skills and found a fundamental problem: AI Agent skill discovery mechanisms have never taken non-English users into account.

The solution was surprisingly simple: add multilingual keywords before each skill's description. The principle is "whatever the user says, the description includes."

The results were astonishing: skill discovery rate increased from 35% to 90%, and non-English match rate increased from 20% to 95%. Four core skills went from 0% to 100% with only a one-line change.

This is a story about "seeing." It enables 75% of AI Agent users to be truly seen by the skill system.


This article is based on a real-world audit conducted by the UltraClaw AI Assistant from Junze Think Tank from May to June 2026. Complete data and scripts have been open-sourced at Agentic Infrastructure.