
X Twitter Scraper
OfficialFreeIntegrate Xquik for Twitter data scraping and automation.
Free · Opens the source repo
What X Twitter Scraper does
X Twitter Scraper is a skill designed for developers and data engineers who need to integrate Xquik's capabilities into their applications, scripts, or data workflows. It leverages the X API and provides a comprehensive set of tools for scraping Twitter data, including tweet searches, user lookups, and media downloads. This skill is particularly useful for those looking to automate data collection processes or enhance their applications with real-time Twitter data.
The skill supports a variety of use cases, such as fetching tweet details, reading timelines, and exporting follower lists. Users can initiate extraction jobs for various types of Twitter interactions, including replies, reposts, and likes. Additionally, X Twitter Scraper allows for the creation of account monitors and the verification of HMAC-signed webhook events, ensuring that users can maintain security and integrity in their data workflows.
For developers familiar with multiple programming languages, X Twitter Scraper offers flexibility by allowing integration through various SDKs, REST endpoints, and Apify Actors. This means that whether you are working with TypeScript, Python, Go, or any other supported language, you can easily implement the skill to suit your project's requirements. Furthermore, the skill provides guidance on best practices for authentication, data handling, and error management, making it a reliable choice for both novice and experienced developers.
Overall, X Twitter Scraper is an essential tool for anyone looking to harness the power of Twitter data through Xquik's API. Its extensive functionality and support for multiple programming environments make it a valuable addition to any developer's toolkit, especially for those focused on data extraction and automation tasks.
When to use it
Use this skill when you need to automate Twitter data extraction or integrate Xquik's API into your application.
When not to use it
This skill may not be suitable for projects that do not require Twitter data or for users unfamiliar with API integrations.
What you can build with it
Automating Tweet Collection
Set up a scheduled job to automatically fetch tweets based on specific keywords or hashtags, streamlining data analysis.
User Relationship Analysis
Use the skill to look up user relationships and export follower data for insights into audience engagement.
Webhook Event Handling
Implement webhook handlers to receive notifications about Twitter events, ensuring timely responses to user interactions.
How to install X Twitter Scraper
View source1. Install with the skills CLI
npx skills add github/awesome-copilot/x-twitter-scraper --agent claude-code2. Or install it manually
Download the skill folder and drop it into ~/.claude/skills/ for all projects, or .claude/skills/ to scope it to one repo. Restart Claude Code so it picks up the new skill.
Anthropic's agentic coding CLI, and the reference implementation of Agent Skills. Drop a skill folder into ~/.claude/skills and Claude Code loads it automatically whenever a task matches the skill's description. Claude Code docs
Inside SKILL.md
Written by githubX Twitter Scraper
Use this skill when a user wants to integrate Xquik into an app, script, data pipeline, or AI agent workflow for X API and Twitter scraper tasks.
Use Cases
- Search tweets, fetch tweet details, read timelines, and download media.
- Look up users, check relationships, and export followers or following.
- Start extraction jobs for replies, reposts, quotes, likes, lists, communities, articles, and search results.
- Create account monitors and verify HMAC-signed webhook events.
- Add TypeScript, Python, Go, Java, Kotlin, C#, Ruby, PHP, CLI, or Terraform clients.
- Run hosted tweet and audience collection through Apify Actors.
- Connect agent runtimes through the Xquik MCP server.
- Install TweetClaw when the workflow belongs inside OpenClaw and needs plugin-managed approvals for X account actions.
Source Checks
Before writing code, inspect the current Xquik source material:
- REST API docs: https://docs.xquik.com/api-reference/overview
- SDK index: https://docs.xquik.com/sdks
- OpenAPI spec: https://xquik.com/openapi.json
- MCP server docs: https://docs.xquik.com/mcp/overview
- Skill repo: https://github.com/Xquik-dev/x-twitter-scraper
- TweetClaw OpenClaw plugin: https://github.com/Xquik-dev/tweetclaw
- TweetClaw npm registry metadata: https://registry.npmjs.org/@xquik%2Ftweetclaw
- X Tweet Scraper Actor: https://apify.com/xquik/x-tweet-scraper
- X Follower Scraper Actor: https://apify.com/xquik/x-follower-scraper
Do not invent endpoint names, request fields, response fields, scopes, pricing, limits, or package names. Read the relevant SDK README and API reference page first.
Implementation Flow
- Identify the workflow: search, lookup, extraction, monitor, webhook, media, write action, billing, or MCP.
- Choose the integration surface: generated SDK for application code, REST for custom clients, Apify Actors for hosted collection, MCP for agents, TweetClaw for OpenClaw plugin workflows, or webhooks for event delivery.
- Confirm authentication requirements from the docs and use environment variables for API keys.
- Use typed request and response models when an SDK exists for the user's language.
- Add retries and pagination according to the SDK or API docs.
- Add explicit user confirmation before write actions, payment flows, or long-running monitoring.
- Keep webhook verification server-side and compare HMAC signatures before processing events.
- Return structured data to the caller instead of scraping generated UI output.
SDK Pattern
When application code is involved, match the SDK to the user's project language:
- Inspect project files and package manifests to identify the language and framework.
- Open the SDK index, then read the matching SDK README before choosing install commands, package names, imports, or client methods.
- Prefer the official SDK for the detected language when one exists.
- Use REST only when the project language has no suitable official SDK or the user asks for a custom client.
- Keep API keys in environment variables or the project's existing secret manager.
Use project-native typed request and response models. Keep network calls in server-side code unless the SDK docs explicitly support browser use.
Apify Actor Pattern
Use the Apify path when a workflow needs hosted runs, datasets, schedules, or Apify-native orchestration.
| Need | Actor | REST ID |
|---|---|---|
| Tweets, search, timelines, lists, articles, replies, quotes, threads, retweeters, or best-effort favoriters | xquik/x-tweet-scraper | xquik~x-tweet-scraper |
| Followers, following, verified followers, list members, list subscribers, or community members | xquik/x-follower-scraper | xquik~x-follower-scraper |
Authenticate with an Apify API token. Keep it in APIFY_API_TOKEN. Fetch the current input schema from the relevant Actor page before selecting fields.
Start a bounded tweet run:
curl --fail --silent --show-error --request POST \
"https://api.apify.com/v2/actors/xquik~x-tweet-scraper/runs" \
--header "Authorization: Bearer ${APIFY_API_TOKEN}" \
--header "Content-Type: application/json" \
--data '{"twitterHandles":["apify"],"outputVariant":"rich","maxItems":25}'
Start a bounded follower run:
curl --fail --silent --show-error --request POST \
"https://api.apify.com/v2/actors/xquik~x-follower-scraper/runs" \
--header "Authorization: Bearer ${APIFY_API_TOKEN}" \
--header "Content-Type: application/json" \
--data '{"twitterHandles":["apify"],"relation":"followers","outputMode":"compact","maxItems":50}'
Record the returned run ID. Poll the Actor run with a bounded retry loop. Stop on SUCCEEDED, FAILED, ABORTED, or TIMED-OUT. On success, read defaultDatasetId, then fetch its dataset items.
Treat maxItems as the cap for the entire tweet run, including runs with several search terms. Keep follower target metadata when attribution matters. Treat rows with resultType: "diagnostic" as status information, not scraped records. Inspect any run-report row before trusting an incomplete result.
Review each Actor's live Apify pricing box before every paid run. Apify platform usage may apply separately. Start with a small maxItems value and ask before raising the cap.
Webhook Pattern
When adding webhook handlers:
- Read the documented signing header name and payload format.
- Verify the HMAC signature before parsing business logic.
- Reject missing, malformed, or mismatched signatures.
- Make handlers idempotent because webhook delivery can retry.
- Store only the fields needed for the product workflow.
MCP Pattern
Use the MCP server when the user wants an agent to explore or call Xquik tools directly. Keep application code on REST or SDK clients when the app needs stable typed contracts, tests, or internal abstractions.
OpenClaw Plugin Pattern
Use TweetClaw when the user is working in OpenClaw, wants installable plugin metadata, or needs an approval-reviewed path for account-changing X actions. Keep application services on REST or SDK clients when the project needs typed contracts, server-side abstractions, or long-lived backend jobs outside OpenClaw.
Before suggesting install commands or tool names, read the TweetClaw README and package metadata. Do not assume the published npm version matches source HEAD.
Treat create, reply, quote, like, bookmark, retweet, follow, delete, media, and monitor actions as approval-worthy unless the current TweetClaw docs state a narrower policy. Keep read-only tweet search, reply search, profile lookup, follower export, and evidence collection low risk, while still respecting rate limits and account authorization.
Safety And Accuracy
- Keep language neutral and technical.
- State that Xquik is a third-party X data and automation API.
- Do not claim affiliation with X Corp.
- Do not bypass access controls or platform policies.
- Do not expose API keys, webhook secrets, account cookies, tokens, or raw signatures.
- Do not hard-code credentials in examples or tests.
- Never put Apify API tokens in URL query parameters.
- Do not document private infrastructure details.
- Prefer official Xquik docs, SDK READMEs, and the OpenAPI spec over memory.
Xquik is an independent third-party service. Not affiliated with X Corp. "Twitter" and "X" are trademarks of X Corp.
Frequently asked questions about X Twitter Scraper
Similar skills
WinMD API Search
Easily find and explore Windows desktop APIs.
WebMCPify
Transform any web app into an agent-ready platform.
Phoenix Tracing
Instrument LLM applications with OpenInference tracing.
Foundry Hosted Agent CopilotKit
Guidance for developing agentic web apps on Azure.
Power Automate Foundation
Connect AI agents to Power Automate seamlessly.
Power Automate Flow Builder
Efficiently build and deploy Power Automate flows programmatically.
