Best Twitter profile scrapers for X profile data
Profile lookups are the most common X data job: enrich a lead list, vet an influencer, monitor competitors, or check that accounts are real. This post compares the tools and gives you a checklist for judging a profile from public data.
What a profile lookup returns
Most tools return the same core: handle, display name, bio, avatar, banner, location, website, follower count, following count, post count, verified status and the join date. Recent posts usually need a second call.
The options and the cost of 10,000 profiles
| Tool | Price as listed | 10,000 profiles |
|---|---|---|
| X API (official) | $0.010 per user source | $100 |
| TwitterAPI.io | $0.18 per 1,000 single lookups source | $1.80 |
| SocialData | $0.20 per 1,000 items source | $2 |
| Bright Data | $1.50 per 1,000 records source | $15 |
| ScrapeIO | 1 credit per profile | $9.90 to $18.80 |
The X API deduplicates repeat reads of the same user within a UTC day, so refreshing the same list twice in a day is not charged twice. source
Strengths of each
- X API: official, with a contract and support for writes. It is the only choice if you also need to follow, post or DM.
- TwitterAPI.io: cheap single lookups and batch lookups for 100 or more users. source
- SocialData: cheap, and failed or empty lookups are not billed. It also sells checks like "does user A follow user B". source
- Bright Data: profile scrapers by URL or by user name, delivered as JSON or CSV to storage. source
- ScrapeIO: the same profile fields on X, TikTok, Instagram, YouTube and LinkedIn, so one creator's footprint is one loop. Not the cheapest for X alone.
A checklist for judging a profile
- Age: join date. Very new accounts with large followings deserve a closer look.
- Follower to following ratio. Accounts that follow far more people than follow them back are often growth-hacking.
- Activity: post count divided by days since joining, and the date of the latest post.
- Reach per post: median views on the last 20 posts divided by followers. On X, views are public on posts, which makes this one of the best fake-follower checks.
- Engagement rate: (likes + replies + reposts) / views, median over recent posts.
- Replies vs originals: an account that only replies is a commenter, not a publisher.
- Links: the website and bio links tell you who is behind it.
A worked example for item 4: an account with 80,000 followers whose last 20 posts have a median of 1,200 views reaches 1.5% of its followers per post. Compare that with similar accounts in the same niche; a figure far below its peers suggests inactive or bought followers.
Handling a list
- Normalize handles: strip
@, URLs and trailing slashes, lower-case them. - Deduplicate before you call. Every tool charges per lookup.
- Record "not found" and "suspended" separately from errors, so you do not retry dead accounts.
- Stay under the rate limit: ScrapeIO allows 300 requests a minute per key.
- Refresh on a schedule that matches the use. Lead enrichment can be quarterly; influencer vetting should be within a week of the decision.
- Keep the pull date with every row, since follower counts change daily.
Common mistakes
- Judging an account by followers alone. Reach per post and engagement rate say more.
- Comparing accounts from different niches. News accounts and meme accounts have very different normal rates.
- Forgetting renamed handles. Store the account ID too, because a handle can change while the ID stays the same.
Doing it with ScrapeIO
The X profile API returns bio, avatar, followers, following and post count. For checklist items 4 to 6, pull recent posts with the X user posts API, which includes views, likes, reposts, replies and bookmarks. Not-found and private accounts are not charged.
curl "https://scrapeio.com/v1/twitter/profile?handle=nasa" -H "x-api-key: YOUR_KEY"
Sources
Checked on 8 November 2026 from each vendor's own pages. Prices and limits change; follow the links before you decide.
- https://docs.x.com/x-api/getting-started/pricing
- https://twitterapi.io/pricing
- https://docs.socialdata.tools/getting-started/pricing/
- https://brightdata.com/products/web-scraper/twitter
100 free credits, no card. Credits never expire.
Get API key