Skip to content

Scrape response shape

The scrape response is a document-first payload with metadata plus a normalized _meta billing block.

{
"url": "https://stripe.com/pricing",
"title": "Pricing & Fees",
"description": "Stripe pricing details",
"favicon": "https://stripe.com/favicon.ico",
"language": "en",
"meta": {
"og:title": "Pricing & Fees"
},
"links": [
{ "url": "https://stripe.com/payments", "text": "Payments" }
],
"images": [
{ "url": "https://stripe.com/hero.png", "alt": "Stripe dashboard" }
],
"text": "Plain-text extraction...",
"html": "<main>...</main>",
"statusCode": 200,
"contentType": "text/html; charset=utf-8",
"method": "direct-fetch",
"_meta": {
"requestId": "req_abc123",
"platform": "web",
"action": "scrape",
"cost": 0.0005,
"method": "direct-fetch",
"responseTimeMs": 842
}
}

Fields to watch

  • text: safest universal output for downstream systems
  • html: useful when you need DOM-rich output
  • links and images: useful for follow-up crawl decisions
  • _meta.cost: final billed amount for this request
  • _meta.method: the path FairCrawl actually used to complete the scrape

Response-shape repro

```bash curl https://api.faircompany.ai/v1/crawl/web/scrape \ -X POST \ -H "Authorization: Bearer fc_live_xxx" \ -H "Content-Type: application/json" \ -d '{ "url": "https://stripe.com/pricing", "format": "markdown", "only_main_content": true }' ```