All templates
Web ScrapingIntermediate
Twitter Profile Scraper
Robomotion•Updated 3 days ago
Overview
Reads an X profile: the name, handle, bio, location, join date, following and followers counts and the number of posts, into a CSV.
Twitter Profile Scraper
Reads an X profile: the name, handle, bio, location, join date, following and followers counts and the number of posts, into a CSV.
What it extracts
- fullName
- handle
- bio
- location
- joined
- following
- followers
- postsCount
How it works
- Log in to X once in Chrome, in the profile you will use for the robot.
- In Setup Vars, set
profile_dirto that Chrome profile folder. Chrome cannot open a profile another Chrome window has open: close Chrome before the run, or use a profile of its own. - Run the flow and enter the page URL (for example
https://x.com/BillGates) when prompted. - The flow opens the page with your login, reads each field, and saves the result as
twitter-profile-scraper.csvin your home folder.
The selectors were made with Robomotion's Web Inspector and tested on pages they were not made on. They name sections by their headings and fields by their labels, never by the values they read.
More web scraping templates
See all 124 →- Amazon Product Search ScraperSearches Amazon from its search box and exports the products it finds (title, product link, price, rating, image) into a CSV, going through the result pages with Next.
- LinkedIn Company URL FinderFinds the LinkedIn company pages for a company name with LinkedIn's own company search: each result's page URL, name, industry and location, into a CSV.
- LinkedIn Job ScraperReads a LinkedIn job: its title, company, location and the About the job text, into a CSV.
- LinkedIn Post Commenter and Liker ScraperCollects the people who commented on a LinkedIn post and the people who reacted to it into one CSV: name, profile link, headline, and whether each one commented and/or reacted.
- LinkedIn Post Commenters ExportExports the people who commented on a LinkedIn post (name, profile link, headline, comment) into a CSV, scrolling for more.
- LinkedIn Post Likers ExportExports the people who reacted to a LinkedIn post (name, profile link, headline) into a CSV, from the post's reactions list.