Tagged web-scraping

Scrape Amazon bestseller category pages into ranked product lists

Scrape Amazon search and category pages into per-item product cards

Turn website exploration into reusable scraper skills with scripts

Scrape Etsy category pages into paginated product listings

Scrape Etsy keyword search results into paginated product listings

Scrape a full Etsy shop catalog into paginated product listings

Scrape Facebook group posts with reactions, comments and authors

Scrape posts and engagement metrics from public Facebook Pages

Scrape Facebook Page and profile timelines with full reaction breakdowns

Scrape Goofish second-hand search results with price and location

Scrape Google Maps business data and contacts by city and category

Extract Google SERP organic results, ads, related searches and AI Overviews

Scrape Indeed job listings with salaries, company ratings and apply links

Scrape Instagram posts by hashtag with captions and engagement counts

Scrape Instagram posts tagged at a location with captions and counts

Scrape posts from an Instagram profile with captions, media and counts

Scrape Product Hunt leaderboard launches with maker profiles and websites

Scrape Taobao and Tmall keyword search results into product cards

Scrape TikTok videos by hashtag with metadata, music and stats

Scrape TikTok profile info and video lists with engagement metadata

Scrape TikTok videos from keyword searches with author and engagement data

Scrape Trustpilot reviews for a company domain with star and date filters

Extract Walmart category listings with prices, ratings and sellers

Extract Walmart keyword search results with prices and ratings

Extract Walmart product reviews with ratings, dates and helpful votes

Extract full Markdown content from any website or article link

Crawl a whole website into LLM-ready markdown pages with metadata

Collect every tweet in an X conversation thread with replies and metadata

Scrape tweets from an X profile timeline by handle with media and metrics

Scrape tweets from any X URL, search, profile or list timeline

Scrape X tweets by search query, handle or URL with full metrics

Fetch Xiaohongshu note details, engagement and comments by note ID

Reach 2,000+ AI models and API tools through one MCP interface for search and scraping

Scrape public profiles, posts and comments from 27+ social platforms via API

Control your running Chrome over CDP to automate, scrape or test pages

Build sourced JSON dossiers on people, companies or topics from many sites

Scrape websites, LinkedIn, GitHub, X and YouTube through DeepAPI endpoints

Crawl a website to find broken internal and outbound links with source pages

Audit XML sitemaps for crawl-budget waste, broken URLs and indexing issues

Audit whether AI answer engines can crawl, find and cite your website

Check whether robots.txt lets AI answer engine crawlers read your site

Extract X tweets, followers and trends and monitor accounts with webhooks

Scrape Instagram, TikTok, LinkedIn, Google Maps and 15+ other platforms with Apify

Fetch web page content as Markdown through fallback services when crawlers are blocked

Research the web with Tavily and Firecrawl, reading pages and crawling sites

Run Apify scraping actors, track costs and diff results across scrapes locally

Check Bing query performance, crawl errors and sitemap status with a local store

Pull website intelligence, brand data, screenshots and crawls from Context.dev

Run Firecrawl web scraping and crawling jobs through its API from the command line