Guide 2026-06-29 9 min read

Apify Proxy Guide: Residential, Datacenter & Rotating Proxies Explained

Proxies are the backbone of web scraping. Without them, your scraper gets blocked after a few dozen requests. With the right proxies, you can scrape thousands of pages without detection. Apify includes built-in proxy infrastructure — residential, datacenter, and rotating — but understanding which type to use for which task is the difference between successful scraping and wasted compute.

This guide explains Apify's proxy options, when to use each type, how to configure them, and how to avoid common proxy mistakes that get scrapers blocked.

Quick answer: which Apify proxy should I use?

Use residential proxies for scraping social media, e-commerce, and sites with aggressive anti-bot protection. Use datacenter proxies for scraping simple websites, APIs, and sites without anti-bot measures. Apify automatically selects the best proxy type for most actors, but manual configuration gives you more control and lower costs.

Apify includes proxy usage in all plans. Free tier includes limited residential proxies. Paid plans ($49+/month) include generous residential proxy pools.

🤖

Apify

4.7Verified partner

Web scraping and automation platformFree / $49/mo Starter

Proxy types in Apify: explained

Apify offers three proxy types. Here is what each does:

  • Residential proxies: IP addresses from real ISP-assigned home connections. They look like real users. Hard to detect and block. Best for social media, e-commerce, Google, and sites with Cloudflare/Datadome. More expensive per GB
  • Datacenter proxies: IP addresses from data centers (AWS, Google Cloud, etc.). Fast and cheap but easily detected by anti-bot systems. Best for simple websites, APIs, and sites without anti-bot protection
  • Rotating proxies: Automatically change IP address per request or per session. Prevents a single IP from making too many requests. Apify rotates both residential and datacenter proxies automatically
  • Static/sticky proxies: Keep the same IP for a session (e.g., 30 minutes). Useful for login flows or multi-page scraping where you need session continuity

When to use residential vs datacenter proxies

Choose proxy type based on the target website's anti-bot protection:

  • Social media (Twitter, Instagram, Facebook, LinkedIn): Residential — these platforms aggressively block datacenter IPs
  • Google (Search, Maps, Shopping): Residential — Google blocks datacenter IPs quickly
  • E-commerce (Amazon, eBay, Shopify stores): Residential — anti-bot protection is standard
  • News sites and blogs: Datacenter — most have no anti-bot protection
  • Public APIs: Datacenter — APIs do not check IP reputation
  • Government/opendata sites: Datacenter — usually no anti-bot protection
  • Real estate sites (Zillow, Realtor.com): Residential — aggressive anti-bot
  • Job sites (LinkedIn, Indeed): Residential — aggressive anti-bot
  • Review sites (Yelp, TripAdvisor): Residential — moderate anti-bot
  • Simple company websites: Datacenter — usually no anti-bot protection

When in doubt, use residential. It costs more but works on virtually any site. Datacenter is only safe for simple sites with no anti-bot protection. If your scraper is getting blocked, switch from datacenter to residential.

Configuring proxies in Apify actors

Most Apify actors have a proxy configuration option. Here is how to set it:

  1. Open the actor configuration page in Apify — Open the actor configuration page in Apify
  2. Find the "Proxy configuration" section (usually under Advanced options) — Find the "Proxy configuration" section (usually under Advanced options)
  3. Choose "Apify Proxy" (recommended) or "Custom proxies" (your own proxy list) — Choose "Apify Proxy" (recommended) or "Custom proxies" (your own proxy list)
  4. Select proxy type "Residential" or "Datacenter" (if the actor supports selection)
  5. Set proxy rotation "Per request" (new IP per request) or "Per session" (same IP for a session)
  6. For login-required sites Use "Per session" with a session ID to maintain login state across requests
  7. For bulk scraping Use "Per request" to distribute requests across many IPs
  8. Click "Start" — the actor uses the configured proxy automatically — Click "Start" — the actor uses the configured proxy automatically

Avoiding proxy blocks: best practices

Even with residential proxies, you can get blocked if you scrape aggressively. Follow these practices:

  • Respect rate limits: Do not send more than 1-2 requests per second per session. Apify actors usually handle this automatically
  • Add delays: Set minConcurrency low (1-3) and maxConcurrency moderate (5-10). Higher concurrency = more simultaneous requests = more likely to get blocked
  • Rotate sessions: Use different session IDs for each batch of requests. This distributes traffic across multiple IP addresses
  • Respect robots.txt: Check the target site's robots.txt before scraping. Some sections may be disallowed
  • Use realistic user agents: Apify actors set realistic user agents automatically. Do not override with custom ones unless necessary
  • Avoid scraping during peak hours: Scrape during off-peak hours (nighttime in the target site's timezone) to reduce detection risk
  • Handle captchas: Some sites serve captchas when they detect scraping. Apify actors with anti-captcha integration can solve them automatically
  • Monitor success rates: If your actor's success rate drops below 80%, you may be getting blocked. Reduce concurrency or switch to residential proxies

If you see 403 Forbidden or 429 Too Many Requests errors in your Apify actor logs, you are being blocked. Immediately reduce concurrency, switch to residential proxies, and add delays between requests.

Apify proxy costs by plan

Proxy usage is included in Apify plans, but residential proxies consume more compute:

  • Free tier: $5/month compute. Residential proxies available but limited. Enough for small scraping tasks (~1,000-2,000 requests)
  • Starter ($49/month): $49 compute. Residential proxies included. Enough for ~10,000-20,000 residential proxy requests/month
  • Scale ($499/month): $499 compute. Generous residential proxy pool. Enough for ~100,000+ residential proxy requests/month
  • Residential proxy cost: ~$4-8 per GB of traffic (included in compute costs)
  • Datacenter proxy cost: ~$0.5-1 per GB of traffic (much cheaper)
  • Cost optimization: Use datacenter for simple sites, residential only for protected sites. This can reduce costs by 80%+
🤖

Apify

4.7Verified partner

Web scraping and automation platformFree / $49/mo Starter

Custom proxies vs Apify proxies

You can use your own proxies in Apify actors instead of Apify's built-in proxy pool. When to consider custom proxies:

  • Use Apify proxies when: You want simplicity, no proxy management, automatic rotation, and built-in residential pool. Best for 90% of users
  • Use custom proxies when: You have an existing proxy subscription (Bright Data, Smartproxy, Oxylabs) with better rates, or you need proxies in specific countries not covered by Apify
  • To use custom proxies: In the actor config, select "Custom proxies" and enter your proxy list (format: protocol://username:password@host:port)
  • Hybrid approach: Use Apify residential for protected sites and custom datacenter for simple sites. This optimizes cost
  • Quality check: Test custom proxies before large runs. Free proxy lists are unreliable and often already blocked

Proxies are the difference between successful scraping and getting blocked after 20 requests. Apify's built-in proxy infrastructure handles 90% of use cases: use residential for social media, e-commerce, Google, and sites with anti-bot protection. Use datacenter for simple websites and APIs. The key practices are: respect rate limits (1-2 requests/second), rotate sessions, keep concurrency low (5-10), and monitor success rates. If you see 403 or 429 errors, reduce concurrency and switch to residential. For cost optimization, use datacenter proxies for simple sites and residential only for protected sites — this can reduce proxy costs by 80%+. Apify's proxy pools are included in all plans, with the free tier covering small tasks and the Starter plan ($49/month) covering most marketing scraping needs. For advanced users with existing proxy subscriptions, Apify supports custom proxy integration. For everyone else, Apify's built-in residential proxies are the simplest and most reliable option.

FAQ

Does Apify include proxies?

Yes. Apify includes residential and datacenter proxies in all plans. The free tier ($5/month) includes limited residential proxy access. The Starter plan ($49/month) includes generous residential proxy pools. Most Apify actors use proxies automatically — no configuration needed. You can also use custom proxies if you have an existing subscription.

What is the difference between residential and datacenter proxies?

Residential proxies use IP addresses from real ISP-assigned home connections — they look like real users and are hard to detect. Use them for social media, e-commerce, and sites with anti-bot protection. Datacenter proxies use IP addresses from data centers — they are fast and cheap but easily detected. Use them for simple websites and APIs without anti-bot protection.

How do I avoid getting blocked while scraping?

Use residential proxies, keep concurrency low (5-10), respect rate limits (1-2 requests/second), rotate sessions, add delays between requests, and monitor success rates. If you see 403 or 429 errors, reduce concurrency immediately and switch to residential proxies. Scrape during off-peak hours when possible.

How much do Apify proxies cost?

Apify proxies are included in your plan's compute costs. Residential proxies cost ~$4-8 per GB of traffic. Datacenter proxies cost ~$0.5-1 per GB. The free tier includes $5 of compute (enough for ~1,000-2,000 residential requests). The Starter plan ($49/month) includes enough for ~10,000-20,000 residential proxy requests.

Can I use my own proxies with Apify?

Yes. In the actor configuration, select "Custom proxies" and enter your proxy list (format: protocol://username:password@host:port). This is useful if you have an existing subscription to Bright Data, Smartproxy, or Oxylabs with better rates. Test custom proxies before large runs — free proxy lists are unreliable.

Tools mentioned in this article

Affiliate links — we may earn a commission at no cost to you.

🤖

Apify

4.7Verified partner

Web scraping and automation platformFree / $49/mo Starter

Keep reading