Tutorial 2026-07-03 8 min read

How to Scrape Twitter/X Data with Apify (2026 Guide)

Twitter/X remains a primary platform for real-time conversations, brand mentions, and trend discovery. Monitoring what people say about your brand, competitors, and industry is essential for marketing intelligence. Apify's Twitter/X Scraper actors make this data accessible without API limitations or expensive enterprise tools.

This guide covers how to use Apify to scrape Twitter/X data for brand monitoring, sentiment analysis, competitive intelligence, and trend discovery.

Quick answer: what can you scrape from Twitter/X?

Apify's Twitter/X Scraper actors extract: tweets (text, date, likes, retweets, replies), user profiles (bio, follower count, following count, verified status), hashtags, mentions, URLs in tweets, and search results by keyword or hashtag. You can monitor brand mentions, track competitor activity, analyze sentiment, and discover trending topics — all without Twitter's expensive API ($100-$2,500/month).

For marketing teams, this means real-time brand monitoring and competitive intelligence at a fraction of Twitter API costs.

🤖

Apify

4.7Verified partner

Web scraping and automation platformFree / $49/mo Starter

Step-by-step: scraping Twitter/X with Apify

Here is the complete workflow:

  1. Create a free Apify account at apify.com — Create a free Apify account at apify.com
  2. Go to Apify Store and search for "Twitter Scraper" or "X Scraper" — look for well-maintained actors with high star ratings — Go to Apify Store and search for "Twitter Scraper" or "X Scraper" — look for well-maintained actors with high star ratings
  3. Click "Try for free" to open the actor configuration — Click "Try for free" to open the actor configuration
  4. Choose your search type "Search" (tweets matching a keyword/hashtag), "Profile" (tweets from a specific user), or "Followers" (follower list of a user)
  5. For keyword search Enter your search query, e.g., "yourbrand OR @yourbrand" to capture all mentions. Add hashtags: "#yourindustry"
  6. Set parameters max results (start with 100 for testing), date range (last 7 days, 30 days, or custom), language filter
  7. Click "Start" — the actor begins scraping. 100 tweets takes ~1-2 minutes — Click "Start" — the actor begins scraping. 100 tweets takes ~1-2 minutes
  8. Export data Download as JSON, CSV, or Excel from the Dataset tab
  9. Analyze Open in Excel/Google Sheets or feed into ChatGPT for sentiment analysis

Set up scheduled runs in Apify to monitor brand mentions daily. Go to the actor → Schedules → Create schedule → Set to run every 24 hours with the same search query. Results accumulate in the dataset for trend analysis.

Data fields available from Twitter/X scraper

The Apify Twitter/X Scraper extracts these fields per tweet:

  • Tweet text: Full text of the tweet including emojis and links
  • Tweet URL: Direct link to the tweet
  • Date: Timestamp of when the tweet was posted
  • Author: Username, display name, bio, follower count, verified status
  • Engagement metrics: Like count, retweet count, reply count, quote tweet count, view count
  • Hashtags: All hashtags used in the tweet
  • Mentions: All @mentions in the tweet
  • URLs: All links shared in the tweet
  • Media: URLs of images or videos attached to the tweet
  • Conversation ID: Thread identifier for grouping replies
  • Language: Detected language of the tweet
  • Geo (if available): Location data if the user opted to share it

Marketing use cases for Twitter/X scraping

Twitter/X data powers several marketing intelligence workflows:

  • Brand monitoring: Search for your brand name, product names, and @handle. Track mention volume, sentiment, and engagement over time
  • Competitor monitoring: Search for competitor names and handles. Compare mention volume and sentiment to your brand
  • Influencer identification: Scrape tweets about your industry. Identify users with high engagement who frequently post about your topic
  • Trend discovery: Scrape trending hashtags in your industry. Spot emerging topics before they peak
  • Customer feedback: Search for "yourbrand" + "love" OR "hate" OR "broken" OR "amazing". Collect real customer sentiment
  • Content research: Scrape popular tweets in your niche. Identify what content formats and topics generate the most engagement
  • Crisis detection: Set up real-time monitoring for negative sentiment spikes. Alert your team when mention volume or negativity increases
  • Hashtag research: Scrape tweets with industry hashtags. Find related hashtags and optimal posting times

Sentiment analysis with AI

Raw tweet data is just text. To make it actionable, run sentiment analysis using AI:

  • Export tweets as CSV from Apify
  • Import into ChatGPT or Claude with the prompt: "Analyze the sentiment of these tweets about [your brand]. Categorize each as positive, negative, or neutral. Summarize the key themes."
  • For larger datasets (1,000+ tweets): Use a sentiment analysis API like OpenAI's API or Google Cloud Natural Language API
  • Track sentiment over time: Run weekly scrapes, analyze sentiment, and chart the trend. A sudden negative spike indicates a PR issue
  • Identify key themes: Group tweets by topic (product quality, customer service, pricing, features). This reveals what drives positive vs negative sentiment
  • Competitor comparison: Run the same sentiment analysis on competitor tweets. Benchmark your sentiment ratio against theirs
  • Action items: Convert negative themes into action items. If 30% of negative tweets mention "slow customer service", that is a clear operational priority

Combine Apify Twitter scraping with ChatGPT for sentiment analysis. Export 500 tweets about your brand, paste into ChatGPT with "Categorize sentiment and identify top 3 complaints and top 3 praises." This takes 5 minutes and replaces expensive social listening tools.

Scheduled monitoring setup

For ongoing brand monitoring, set up scheduled Apify runs:

  • Go to your Twitter Scraper actor in Apify
  • Click "Schedules" → "Create schedule"
  • Set frequency: Every 24 hours for daily monitoring, every 6 hours for real-time monitoring
  • Set the search query: "yourbrand OR @yourbrand OR #yourbrand"
  • Set max results: 200-500 per run is sufficient for daily monitoring
  • Enable notifications: Apify can email you when each run completes
  • Export accumulated data: Download the full dataset weekly or monthly for trend analysis
  • Set up alerts: Use Apify webhooks to trigger a notification (Slack, email) when mention volume exceeds a threshold

Cost comparison: Apify vs Twitter API

The cost difference is significant:

  • Twitter/X API Basic: $100/month — limited to 10,000 tweets/month read
  • Twitter/X API Pro: $5,000/month — 1,000,000 tweets/month read
  • Apify free tier: $5/month included — enough for ~2,000-5,000 tweets/month
  • Apify Starter: $49/month — enough for ~25,000-50,000 tweets/month
  • Apify Scale: $499/month — enough for ~500,000+ tweets/month
  • Savings: Apify Starter ($49) vs Twitter API Basic ($100) = 51% cheaper with 2.5-5x more data
  • Savings: Apify Scale ($499) vs Twitter API Pro ($5,000) = 90% cheaper
  • Social listening tools (Brandwatch, Mention): $800-$2,000/month. Apify + ChatGPT = $49-100/month
🤖

Apify

4.7Verified partner

Web scraping and automation platformFree / $49/mo Starter

Apify's Twitter/X Scraper is the most cost-effective way to monitor brand mentions, track competitors, and analyze sentiment on Twitter/X. For $49/month (Apify Starter), you get 25,000-50,000 tweets per month — 51% cheaper than Twitter's own API and 94% cheaper than enterprise social listening tools. The workflow is simple: search by brand name or keyword, scrape tweets with engagement metrics, export, and run sentiment analysis with ChatGPT. Set up scheduled daily runs for ongoing brand monitoring. Use the data to identify influencers, track sentiment trends, detect PR crises early, and benchmark against competitors. For marketing teams that need Twitter/X intelligence without the $100-$5,000/month API cost or $800-$2,000/month social listening tool cost, Apify is the clear choice.

FAQ

Can I scrape Twitter/X with Apify?

Yes. Apify's Twitter/X Scraper actors extract tweets, user profiles, hashtags, mentions, and engagement metrics (likes, retweets, replies). Search by keyword, hashtag, or username. Export as JSON, CSV, or Excel. 500 tweets takes ~5 minutes and costs ~$0.50 in compute.

Is scraping Twitter/X legal?

Scraping publicly available tweets is generally legal. Twitter's Terms of Service restrict automated access, but enforcement focuses on large-scale commercial scraping, not individual monitoring. Use the data for legitimate marketing intelligence (brand monitoring, sentiment analysis) and do not republish tweet content publicly. Respect rate limits.

How much does it cost to scrape Twitter/X with Apify?

Apify's free tier ($5/month) covers ~2,000-5,000 tweets/month. Starter plan ($49/month) covers ~25,000-50,000 tweets/month. Compare to Twitter API Basic at $100/month (10,000 tweets) or Pro at $5,000/month. Apify is 51-90% cheaper with more data capacity.

Can I monitor brand mentions on Twitter/X with Apify?

Yes. Search for your brand name, @handle, and hashtags. Set up scheduled runs (daily or every 6 hours) to monitor continuously. Export tweets and run sentiment analysis with ChatGPT. This replaces social listening tools like Brandwatch ($800+/month) at a fraction of the cost.

How do I analyze sentiment from scraped tweets?

Export tweets as CSV from Apify, then paste into ChatGPT or Claude with "Categorize sentiment as positive, negative, or neutral. Identify top complaints and praises." For larger datasets (1,000+ tweets), use OpenAI's API or Google Cloud Natural Language API. Track sentiment over time with weekly scrapes.

Tools mentioned in this article

Affiliate links — we may earn a commission at no cost to you.

🤖

Apify

4.7Verified partner

Web scraping and automation platformFree / $49/mo Starter

Keep reading