← Tools

Firecrawl

Scrape/crawl/extract API for pages that fight plain fetch. Its X postprocessor is the only reliable way I read tweets programmatically.

Why

When the job is to get the content, not to click through a UI. A page that blocks a plain fetch, a whole site I want as markdown, a structured field I want pulled out. If the job needs a login or real clicking, I reach for agent-browser instead.

What I like

Its X postprocessor is the only reliable way I read tweets programmatically.

Try

npx -y firecrawl-cli@latest

Sourcefirecrawl.dev