All posts

Best Twitter profile scrapers for X profile data

November 8, 2026

Profile lookups are the most common X data job: enrich a lead list, vet an influencer, monitor competitors, or check that accounts are real. This post compares the tools and gives you a checklist for judging a profile from public data.

What a profile lookup returns

Most tools return the same core: handle, display name, bio, avatar, banner, location, website, follower count, following count, post count, verified status and the join date. Recent posts usually need a second call.

The options and the cost of 10,000 profiles

ToolPrice as listed10,000 profiles
X API (official)$0.010 per user source$100
TwitterAPI.io$0.18 per 1,000 single lookups source$1.80
SocialData$0.20 per 1,000 items source$2
Bright Data$1.50 per 1,000 records source$15
ScrapeIO1 credit per profile$9.90 to $18.80

The X API deduplicates repeat reads of the same user within a UTC day, so refreshing the same list twice in a day is not charged twice. source

Strengths of each

  • X API: official, with a contract and support for writes. It is the only choice if you also need to follow, post or DM.
  • TwitterAPI.io: cheap single lookups and batch lookups for 100 or more users. source
  • SocialData: cheap, and failed or empty lookups are not billed. It also sells checks like "does user A follow user B". source
  • Bright Data: profile scrapers by URL or by user name, delivered as JSON or CSV to storage. source
  • ScrapeIO: the same profile fields on X, TikTok, Instagram, YouTube and LinkedIn, so one creator's footprint is one loop. Not the cheapest for X alone.

A checklist for judging a profile

  1. Age: join date. Very new accounts with large followings deserve a closer look.
  2. Follower to following ratio. Accounts that follow far more people than follow them back are often growth-hacking.
  3. Activity: post count divided by days since joining, and the date of the latest post.
  4. Reach per post: median views on the last 20 posts divided by followers. On X, views are public on posts, which makes this one of the best fake-follower checks.
  5. Engagement rate: (likes + replies + reposts) / views, median over recent posts.
  6. Replies vs originals: an account that only replies is a commenter, not a publisher.
  7. Links: the website and bio links tell you who is behind it.

A worked example for item 4: an account with 80,000 followers whose last 20 posts have a median of 1,200 views reaches 1.5% of its followers per post. Compare that with similar accounts in the same niche; a figure far below its peers suggests inactive or bought followers.

Handling a list

  • Normalize handles: strip @, URLs and trailing slashes, lower-case them.
  • Deduplicate before you call. Every tool charges per lookup.
  • Record "not found" and "suspended" separately from errors, so you do not retry dead accounts.
  • Stay under the rate limit: ScrapeIO allows 300 requests a minute per key.
  • Refresh on a schedule that matches the use. Lead enrichment can be quarterly; influencer vetting should be within a week of the decision.
  • Keep the pull date with every row, since follower counts change daily.

Common mistakes

  • Judging an account by followers alone. Reach per post and engagement rate say more.
  • Comparing accounts from different niches. News accounts and meme accounts have very different normal rates.
  • Forgetting renamed handles. Store the account ID too, because a handle can change while the ID stays the same.

Doing it with ScrapeIO

The X profile API returns bio, avatar, followers, following and post count. For checklist items 4 to 6, pull recent posts with the X user posts API, which includes views, likes, reposts, replies and bookmarks. Not-found and private accounts are not charged.

curl "https://scrapeio.com/v1/twitter/profile?handle=nasa" -H "x-api-key: YOUR_KEY"

Sources

Checked on 8 November 2026 from each vendor's own pages. Prices and limits change; follow the links before you decide.

100 free credits, no card. Credits never expire.

Get API key