Scraping & Extraction

Crawl websites at scale and extract answers from pages with the Olostep API

Extract products, prices, categories and stock from e-commerce storefronts

Extract web data into a JSON schema with nested arrays, pagination and validation

Convert workspace files, PDFs and video URLs into Markdown with the FileX CLI

Search Xiaohongshu image posts by keyword and save results as CSV or JSON

Search YouTube videos and fetch video details, saving results as CSV or JSON

Download TikTok or Douyin videos and traffic metrics via the TikHub API

Scrape X timelines and home feeds by user or keyword into RSS, JSON or Markdown

Scrape Xiaohongshu search results into lists and full note text as JSON or Markdown

Build OCR pipelines in MATLAB to read text from signs, meters and documents

Pull YouTube transcripts, metadata and search results without API quotas

Browse a YouTube channel's uploads, search inside it and resolve handles

Fetch structured YouTube metadata, upload history and playlist contents

Fetch WeChat Official Account articles and convert them to clean Markdown

Extract text from PDFs, images and scanned documents with pymupdf or cloud OCR

Extract clean article text from any URL with trafilatura and no API key

Extract entities, relations and clauses from scientific and legal documents

Correct OCR errors in historical newspaper and book transcriptions

Extract entities, methods and results from scientific papers as structured data