
BiasCheck
FreeConduct thorough bias audits on any source material.
Free · Opens the source repo
What BiasCheck does
BiasCheck is a specialized tool designed to perform a comprehensive three-layer bias analysis on various types of content, including URLs, files, or raw text. This skill automatically fetches the content and any cited studies, enabling users to scrutinize the biases present in the data, conflicts of interest from the source, and distortions introduced by journalism. By separating what the data genuinely supports from editorialized content, BiasCheck provides a structured and repeatable analysis that enhances the credibility of the findings.
The skill operates by examining three critical layers: first, it assesses biases inherent in the data itself, such as funding sources, sampling methods, and potential methodological flaws. Next, it evaluates the source organization to identify any conflicts of interest that may influence the conclusions drawn. Lastly, it analyzes the journalism surrounding the data, looking for distortions introduced by headlines or commentary that may misrepresent the original findings. This layered approach ensures that users receive a detailed and nuanced understanding of the biases at play.
BiasCheck is particularly useful for researchers, journalists, and anyone engaged in critical analysis of information sources. It addresses the common issue of vague bias claims that lack concrete evidence and provides a systematic way to identify and document specific biases. The output is formatted in a clear and organized manner, making it easy for users to understand the basis of the analysis and the conclusions drawn.
However, it is important to note that BiasCheck is not intended for psychological author analysis or comprehensive research synthesis. Instead, it focuses specifically on the biases related to data and sources, making it a valuable tool for fact-checking and evaluating the credibility of claims made in various forms of media.
When to use it
Use BiasCheck when you need to audit the credibility of a source, study, or article for biases and distortions.
When not to use it
This skill is not suitable for psychological analyses of authors or for synthesizing research findings across multiple studies.
What you can build with it
Auditing a News Article
A user inputs a URL of a news article citing a study. BiasCheck fetches the article and the study, then conducts a three-layer bias audit.
Evaluating a Research Paper
A user pastes the abstract of a research paper. BiasCheck analyzes the data and source organization, providing insights into potential biases.
Checking a PDF Report
A user specifies a file path to a PDF report. BiasCheck reads the file, identifies cited sources, and performs a structured bias analysis.
How to install BiasCheck
View source1. Install with the skills CLI
npx skills add danielmiessler/lifeos/BiasCheck --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by danielmiesslerCustomization
Before executing, check for user customizations at:
~/.claude/LIFEOS/USER/CUSTOMIZATIONS/SKILLS/BiasCheck/
If this directory exists, load and apply any PREFERENCES.md or additional reference files found there. These override default behavior. If the directory does not exist, proceed with skill defaults.
BiasCheck
Voice Notification
When executing a workflow, do BOTH:
-
Send voice notification:
curl -s -X POST http://localhost:31337/notify \ -H "Content-Type: application/json" \ -d '{"message": "Running the Check workflow in the BiasCheck skill to audit the source"}' \ > /dev/null 2>&1 & -
Output text notification:
Running the **Check** workflow in the **BiasCheck** skill to audit the source...
What It Does
Runs a three-layer bias audit on any source — a URL, a file path, or raw text. It fetches the content plus any study it cites, then checks (1) biases inside the data, (2) conflicts of interest in the source organization, and (3) distortions the journalism added on top. The output separates what the data actually supports from what got editorialized.
The Problem
Most "this is biased" arguments are vibes — a feeling about a source, with nothing concrete underneath. They're not repeatable and they don't tell you where the distortion lives. The other failure is analyzing an article without ever reaching the study it cites, so you critique the headline and never see that the underlying data was fine (or that it was junk). A fixed taxonomy and a fixed output shape fix both: the analysis is repeatable, the gaps are visible, and every claim ties to a specific tell.
How It Works
The skill operates on three layers:
- The data itself — biases inside the underlying study, paper, or dataset (funding, sampling, instrument design, demand characteristics, self-report distance from behavior, causal inflation, missing benchmark, publication availability)
- The source organization — who paid for or produced the work, what they sell, what conclusion would be inconvenient
- The journalism on top — what the reporter/commentator added: headline-to-source distortion, frame escalation, echo-chain amplification, causal claims layered over correlational data
Output cleanly separates what the data actually supports from what was editorialized on top. Confidence is anchored to specifics — no vibes-based "this seems biased."
Workflow Routing
| Workflow | Trigger | File |
|---|---|---|
| Check | "bias check", "analyze bias on", "check this study/source/article" | Workflows/Check.md |
Quick Reference
- Input: one argument — URL, file path, raw text, or any combination.
- Always tries to find the primary source. If the input is journalism citing a study, the skill fetches the study itself, not just the article. If the primary source can't be located, that's a finding.
- Three-layer output — never collapse layers; the distortion usually lives in the layer the source is least transparent about.
- Hard separation between supported and editorialized — this is the deliverable shape.
- Bias taxonomy reference:
BiasTaxonomy.md(load on demand for the full category catalog with definitions and tells).
Examples
Example 1: Article citing a vendor study
User: "bias check https://futurism.com/some-article-citing-a-mercer-survey"
→ Invokes Check workflow
→ Fetches the article, identifies the cited Mercer study, fetches Mercer's source
→ Runs three-layer audit: vendor conflict-of-interest, sample/question-design biases, journalism's headline-vs-source swap
→ Returns structured bias report + supported-vs-editorialized split
Example 2: Raw paste of a study abstract
User: "bias check this abstract: [pastes 4 paragraphs from a paper]"
→ Invokes Check workflow
→ Skips Layer 3 (no journalism on top — input IS the primary source)
→ Audits Layers 1 + 2 only: funding disclosure, sample, methodology, conflict-of-interest
→ Notes if abstract is insufficient to assess methodology (publication availability bias)
Example 3: File path
User: "bias check ~/Downloads/some-report.pdf"
→ Invokes Check workflow
→ Reads file
→ Identifies if report cites further upstream sources; fetches what it can
→ Three-layer audit with specifics
Output Requirements
- Format: Markdown with the fixed section structure defined in
Workflows/Check.md. - Length: Scales with source complexity. A single-claim tweet gets ~200 words; a vendor-funded study + viral article gets 800–1500.
- Tone: Plain. Specific. No vibes. Every bias claim ties to a concrete tell — a quoted phrase, a sample-frame fact, a missing disclosure.
- Must Include: Methodology line (sample, dates, instrument availability), the three layers, the supported-vs-editorialized split, a one-paragraph bottom line, sources list with URLs.
- Must Avoid: Hedging ("could potentially be biased"). Diagnose or don't. The reader gets to disagree — but they should know what the analyst actually thinks.
Gotchas
- Always try to find the primary source. The single biggest failure mode is analyzing an article without ever reaching the underlying study. If the input cites a study/report/paper/dataset, the skill MUST attempt to fetch it. Inability to locate the primary source is itself a finding (publication availability bias) and goes in the output.
- An impossibly high consensus number is a tell about the question. When a survey claims 95%+ agreement on a substantive question, that almost always means the question was a low-bar yes/no. Note it explicitly even when the instrument is hidden.
- Vendor research is research; treat it that way. Don't dismiss a Mercer/McKinsey/PwC/Gartner report because they sell consulting. Their funding bias is a multiplier on the analysis, not an automatic disqualifier. Specific finding > generic "vendor bias."
- Don't conflate Layer 1 and Layer 3. A bad headline doesn't make the underlying data bad. A flawed study doesn't make the journalism dishonest. Keep them separate even when both have problems.
- Headlines travel; bodies don't. Most readers see only the headline. A headline-to-source mismatch is the most consequential journalism bias and should always be flagged when present.
- "Charitable reading" is required. Before concluding the source is misleading, articulate what the data DOES support. This anchors the critique in specifics.
- Don't go beyond the source you fetched. No drive-by claims about Mercer's other reports if you only read one. No "they always do X" — stick to what's in the artifact.
- Pure opinion piece with no data? This skill is the wrong tool — redirect to a psychological author-analysis skill for a psychological author read. BiasCheck needs claims with empirical scaffolding.
- Author background is out of scope. This skill audits the source artifact, not the author's biography. If you need "who is this writer and what's their track record," use Research or a dedicated OSINT/entity-investigation skill.
Execution Log
echo '{"ts":"'$(date -u +%Y-%m-%dT%H:%M:%SZ)'","skill":"BiasCheck","workflow":"Check","input":"8_WORD_SUMMARY","status":"ok|error","duration_s":SECONDS}' >> ~/.claude/LIFEOS/MEMORY/SKILLS/execution.jsonl
Frequently asked questions about BiasCheck
Similar skills
Eyeball
Analyze documents with visual proof.
Account Research
Efficiently gather insights on companies using Common Room data.
Last 30 Days Research
Analyze recent community and social trends in 30 days.
Last 30 Days
Research trending discussions across platforms in the last month.
NotebookLM Research Assistant
Query Google NotebookLM for precise, citation-backed answers.
Customer Research
Streamline multi-source customer inquiries with confidence scoring.
