
Exa Web Toolkit
FreePowerful web search and content extraction for research.
Free · Opens the source repo
What Exa Web Toolkit does
The Exa Web Toolkit is designed for researchers and developers who need a robust solution for web-based information retrieval. It leverages Exa's advanced capabilities to perform semantic lookups and fetch high-quality content from the web. This toolkit is particularly beneficial for users focusing on scientific and technical topics, as it allows for precise searches that can filter results based on academic criteria.
With the Exa Web Toolkit, users can execute two main functions: web search and URL extraction. The web search capability is optimized for finding current information and conducting research, with an option to prioritize scholarly articles and papers. By using specific parameters like --category "research paper", users can ensure that the results are skewed towards academic sources, making it an invaluable asset for anyone in the research community.
The URL extraction feature allows users to fetch content from specific web pages, articles, or academic PDFs. This is particularly useful for batch processing multiple URLs, which can save time and streamline workflows. The toolkit is built to handle both individual queries and larger extraction tasks, making it versatile for various research needs.
Overall, the Exa Web Toolkit is a powerful addition for developers and researchers seeking to enhance their web search capabilities, particularly in academic and technical domains. Its ability to filter for high-quality sources and extract relevant content efficiently makes it a strong choice for anyone needing reliable information from the web.
When to use it
Use this toolkit when you need to conduct thorough research or fetch specific content from URLs, especially in academic contexts.
When not to use it
This skill may not be suitable for casual browsing or non-technical queries where academic filtering is unnecessary.
What you can build with it
Conducting Academic Research
Use the Exa Web Toolkit to search for peer-reviewed articles and papers on specific scientific topics.
Batch URL Content Extraction
Fetch multiple academic PDFs or articles in one command to streamline your research process.
Semantic Lookups for Technical Queries
Leverage the semantic search capabilities to find precise information on complex technical subjects.
How to install Exa Web Toolkit
View source1. Install with the skills CLI
npx skills add k-dense-ai/scientific-agent-skills/exa-search --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by k-dense-aiExa Web Toolkit
A skill for web-powered research tasks backed by Exa: web search and URL extraction. Exa's index combines high-quality keyword and semantic retrieval, which makes it well-suited to scientific, technical, and conceptual queries.
Routing — pick the right capability
Read the user's request and match it to one of the capabilities below. Read the corresponding reference file for detailed instructions before running commands.
| User wants to... | Capability | Where |
|---|---|---|
| Look something up, research a topic, find current info | Web Search | references/web-search.md |
| Fetch content from a specific URL (webpage, article, PDF) | Web Extract | references/web-extract.md |
| Install or authenticate | Setup | Below |
Decision guide
- Default to Web Search for topic lookups, research questions, or "what is X?" queries. When the topic is scientific or technical, pass
--category "research paper"to bias toward scholarly sources, and/or an academic--include-domainsallowlist. Seereferences/web-search.mdfor the two-pass academic strategy. - Use Web Extract when the user provides a URL or asks you to read/fetch a specific page. Prefer this over the built-in WebFetch for batch extraction (multiple URLs in one call) and for academic PDFs.
Academic source priority
For technical or scientific queries, prefer academic and scientific sources:
- Peer-reviewed journal articles and conference proceedings over blog posts or news
- Preprints (arXiv, bioRxiv, medRxiv) when peer-reviewed versions aren't available
- Institutional and government sources (NIH, WHO, NASA, NIST) over commercial sites
- Primary research over secondary summaries
Two levers to steer Exa toward scholarly content:
--category "research paper"biases retrieval toward scholarly sources.--include-domainswith a scholarly allowlist (arxiv.org, nature.com, pubmed.ncbi.nlm.nih.gov, etc.) restricts the domain pool.
Combine both for strictly academic results. See references/web-search.md for the full pattern.
When citing academic sources, include author names and publication year where available (e.g., Smith et al., 2025) in addition to the standard citation format. If a DOI is present, prefer the DOI link.
Setup
This skill uses the exa-py Python SDK. The scripts in scripts/ declare their dependencies via PEP 723 inline metadata, so you can run them directly with uv run without a separate install step:
uv run --with exa-py python "$SKILL_PATH/scripts/exa_search.py" --help
If you prefer a persistent install:
uv pip install "exa-py>=1.14.0"
Authentication
All commands read the API key from the EXA_API_KEY environment variable. Get your Exa API key at dashboard.exa.ai/api-keys.
First, check if a .env file exists in the project root and contains EXA_API_KEY. If so, load it:
dotenv -f .env run -- uv run --with exa-py python "$SKILL_PATH/scripts/exa_search.py" "your query"
If dotenv isn't available, install it: uv pip install python-dotenv[cli].
If there's no .env, export the key for the session:
export EXA_API_KEY="your-key"
Verify by running any script with --help — it will exit cleanly if the key is set and auth-check runs only when a real query is made.
Tracking header
Every script in this skill sets the x-exa-integration request header to k-dense-ai--scientific-agent-skills so Exa can attribute usage from the K-Dense AI scientific-agent-skills repo to this integration. Do not remove or rename this header when adapting the scripts.
Files in this skill
SKILL.md— this file (routing and setup)references/web-search.md— detailed web search reference with academic strategyreferences/web-extract.md— URL content extraction referencescripts/exa_search.py— CLI wrapper aroundclient.search_and_contentsscripts/exa_extract.py— CLI wrapper aroundclient.get_contents
Frequently asked questions about Exa Web Toolkit
Similar skills
Scientific Problem Selection
Streamline your research problem selection process.
Nextflow Development
Run nf-core bioinformatics pipelines with ease.
Nature Reviewer Assessment
Simulate peer review for scientific manuscripts.
Research Writing Pipeline
Streamline your scientific writing with structured proposal-first methodologies.
Nature Literature Downloader
Efficiently download academic literature from various sources.
Auto Research
Streamline your NeMo-RL experiments with automated workflows.
