
Exploring MCP Intent Clusters
FreeAnalyze agent goals and tool effectiveness with intent clustering.
Free · Opens the source repo
What Exploring MCP Intent Clusters does
The Exploring MCP Intent Clusters skill provides a comprehensive framework for analyzing how agents interact with tools through intent clustering. By grouping semantically similar agent goals, this skill allows developers and designers to understand what agents are trying to achieve and how effectively they are using the available tools. Each intent cluster is accompanied by detailed metrics, including tool distribution, call counts, and error rates, enabling users to identify which goals are successfully met and which ones are failing. This insight is crucial for optimizing tool performance and enhancing user experience.
The skill operates by embedding free-text $mcp_intent values associated with tool calls and clustering them based on semantic similarity. This means that each call is attributed to its own intent, allowing for accurate tracking of tool effectiveness. Users can retrieve the latest cluster snapshot to view the status, last computed time, and a detailed breakdown of clusters, including their intent and error counts. The tool-centric pivot allows for a reverse analysis, helping users determine which intents drive tool usage and how discoverable their tools are.
This skill is particularly useful when users need to answer questions about agent behavior, such as "What are agents trying to do with the MCP?" or "Which goals fail most often?" It can also assist in identifying overlaps between tools and understanding how well tools are advertised in sessions. The ability to recompute clusters ensures that users always have access to the most current data, making it a valuable asset for ongoing analysis and improvement.
In summary, the Exploring MCP Intent Clusters skill is designed for developers and designers looking to gain deeper insights into agent interactions with tools, enhance tool discoverability, and improve overall tool effectiveness based on real usage data.
When to use it
Use this skill when you need to analyze agent interactions with tools, identify goal failures, or assess tool discoverability.
When not to use it
This skill may not be suitable for real-time tool performance monitoring or for users looking for a simple overview without detailed analytics.
What you can build with it
Analyzing Agent Goals
Use the skill to explore what agents are primarily trying to achieve with the MCP, helping to refine tool offerings.
Identifying Tool Failures
Determine which agent goals are failing most often by examining error rates within intent clusters.
Assessing Tool Discoverability
Evaluate how discoverable your tools are by analyzing the discovery rates and overlaps with competing tools.
How to install Exploring MCP Intent Clusters
View source1. Install with the skills CLI
npx skills add posthog/posthog/exploring-mcp-intent-clusters --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by posthogExploring MCP intent clusters
Intent clustering takes the free-text $mcp_intent values agents attach to
their tool calls, embeds them, and groups semantically similar goals into
clusters. Attribution is per call: each call is credited to its own intent
(calls without one inherit the most recent prior intent in the same session),
so a tool's counts reflect the intent it actually served. Each cluster carries
its tool distribution, call counts, and error rates — answering "what are
people trying to do, and does it work?" rather than "which tool was called".
The snapshot also carries a tool-centric pivot answering the reverse question:
for a given tool, which intents drive its usage, how often do agents find it,
and who does it compete with.
Unlike tool quality and sessions (which ultimately aggregate $mcp_tool_call),
clustering needs embeddings and is not expressible in SQL. It is served by
two typed tools backed by a stored snapshot.
Tools
| Tool | Purpose |
|---|---|
posthog:mcp-analytics-intent-clusters-retrieve | Fetch the latest cluster snapshot for the project |
posthog:mcp-analytics-intent-clusters-recompute | Trigger an async recompute of the snapshot |
Workflow: read the current clusters
posthog:mcp-analytics-intent-clusters-retrieve
{}
Returns a snapshot with status, last_computed_at, computed_with (the
embedding model, clustering parameters, and sample-coverage percentages), a
clusters array, a tools array (the tool pivot), and tool_overlaps. Each
cluster has a label, intent_count, call_count, error_count,
error_rate_pct, routing_entropy, a tool_distribution (which tools that
goal routes to, with per-tool error rates), sample_intents, plus switches
(errored call immediately followed by a different tool for the same intent —
the strongest "agents mix these tools up" evidence) and self_retries
(errored call immediately retried with the same tool — a sign the tool's
error messages aren't helping agents self-correct).
Read clusters by call_count for "what are agents mostly doing", or by
error_rate_pct for "which goals are failing" — a high error rate on a cluster
points at a class of agent goals the tools serve badly.
routing_entropy is how spread-out a cluster's tool usage is: low entropy means
one goal reliably maps to one tool; high entropy means agents are casting around
for the right tool for that goal (often a missing-capability signal).
Workflow: answer "is my tool discoverable?" from the tool pivot
Each entry in tools carries:
clusters— the intent clusters the tool serves, each withcapture_pct(its share of the cluster's calls),rank,top_competitor(the strongest other tool and its share), anddescription_fit(cosine similarity between the tool's description and the cluster centroid; null until descriptions are captured). Entries carry onlycluster_id, not the cluster's own label or totals — join them against the top-levelclustersarray on that idn_clusters_served— how many clusters the tool serves in total. The entry list above is capped, so compare the two before saying "this tool serves N intents"discovery_rate_pct— of the sampled sessions whose$mcp_tools_listcatalog advertised the tool, the share that actually called it; null when the tool was advertised in fewer than 5 sampled sessionscontested_score— call-weighted mean entropy of its clusters: how often its intents are split with other tools
High description_fit with low capture_pct is the discoverability failure:
agents should find the tool for that intent but pick something else. Low fit
with high capture means the description undersells what the tool actually does.
tool_overlaps lists pairs competing for the same intents; use
sessions_with_both vs sessions_with_either to separate workflows (used
together) from confusion (one or the other).
Read coverage before quoting numbers: computed_with.sampled_sessions /
session_coverage_pct say how much of the window the corpus represents, and
advertisement_coverage_pct bounds what discovery rates can see. Only sessions
with an observed tools-list catalog enter discovery denominators, and sessions
in exec-wrapper mode advertise only the wrapper, so per-tool discovery is
measured on full-catalog sessions.
computed_with is not a completeness check for everything, though. Only the
top-level tool and overlap-pair caps report what they dropped, via
dropped_tools and dropped_overlap_pairs. The per-cluster lists are capped
silently, so treat a cluster showing 10 switches or 5 self-retries as "at least
that many", not "exactly". A tool's cluster entries are capped too, but there
n_clusters_served gives you the real count.
Clustering reads events only. The on-demand session summaries
(MCPSession.intent, what "generate intent" writes) are deliberately left out:
a summary describes a whole session, and spreading it across that session's
calls is the mis-attribution the per-call corpus exists to remove. So a session
whose intent was only ever summarised is not in any cluster — check
intent_coverage_pct for how much of the window that leaves out, and read
session summaries directly when you need them.
Workflow: handle an empty or stale snapshot
- Empty / idle with no clusters (
status: idle,clusters: []): no run has happened yet. Trigger one (below) and tell the user it computes in the background. - Stale
last_computed_at: offer to recompute.
Workflow: recompute
posthog:mcp-analytics-intent-clusters-recompute
{}
Returns immediately with status: computing (HTTP 202); the work runs in the
background. Poll posthog:mcp-analytics-intent-clusters-retrieve until status
returns to idle (done) or error. Don't block waiting — tell the user to
re-ask in a minute.
Constructing UI links
- Intent clustering:
https://app.posthog.com/project/<project_id>/mcp-analytics/intent-clustering
Tips
- Clusters are only as good as the
$mcp_intentcoverage — if few calls carry an intent, clusters will be sparse; cross-check intent coverage with a quickcountIf(toString(properties.$mcp_intent) != '')over$mcp_tool_call - A cluster with high
error_rate_pctplus highrouting_entropyis the strongest "the tools don't serve this goal well" signal — worth a closer look at itssample_intentsandtool_distribution - Recompute is throttled to one run at a time per project; a 202 while already computing just re-confirms the in-flight run
Related skills
exploring-mcp-tool-quality— per-tool error rates and latencyexploring-mcp-sessions— the individual runs behind the intents
Frequently asked questions about Exploring MCP Intent Clusters
Similar skills
Power BI Semantic Modeling
Optimize your Power BI data models with best practices.
Data Context Extractor
Tailor data analysis skills to your company's needs.
Power BI Performance Troubleshooting
Systematic guidance for optimizing Power BI performance.
Power BI Model Design Review
Optimize your Power BI data models with expert reviews.
Power BI DAX Formula Optimizer
Optimize your DAX formulas for better performance and clarity.
Fabric Lakehouse
Optimize your data solutions with Lakehouse best practices.
