Scrapingdog
HomePricingSupportLogin
  • Documentation
  • Web Scraping API
    • Request Customization
      • Javascript Rendering
        • Wait when rendering Javascript
      • Custom Headers
      • Premium Residential Proxies
      • Geotargeting
      • Sessions
  • POST Request
  • Google Search Scraper API
    • Google Country Parameter: Supported Google Countries
    • Supported Google Countries via cr parameter
    • Google Domains Page
    • Google Language Page
    • Google LR Language Page
  • Google AI Overview API
  • Google Maps API
    • Google Maps Posts API
    • Google Maps Photos API
    • Google Maps Reviews API
    • Google Maps Places API
  • Google Trends API
    • Google Trends Autocomplete API
    • Google Trends Trending Now API
  • Google Images API
  • Google News API
    • Google News API 2.0
  • Google Shopping API
  • Google Product API
  • Google Videos API
  • Google Shorts API
  • Google Autocomplete API
  • Google Scholar API
    • Google Scholar Profiles API
    • Google Scholar Author API
      • Google Scholar Author Citation API
    • Google Scholar Cite API
  • Google Finance API
  • Google Lens API
  • Google Jobs API
  • Google Local API
  • Google Patents API
    • Google Patent Details API
  • Bing Search Scraper API
  • Amazon Scraper API
    • Amazon Product Scraper
    • Amazon Search Scraper
    • Amazon Reviews API
    • Amazon Autocomplete Scraper
  • Instagram Scraper API
  • Linkedin Scraper API
    • Person Profile Scraper
    • Company Profile Scraper
  • Linkedin Jobs Scraper
    • Scrape Linkedin Jobs
    • Scrape LinkedIn Job Overview
  • Yelp Scraper API
  • Twitter Scraping API
    • X Scraping API 2.0
  • Indeed Scraper API
  • Zillow Scraper API
  • Youtube Scraper API
    • Youtube Search API
    • YouTube Transcripts API
    • YouTube Channel API
  • Walmart Scraper API
    • Walmart Product Scraper
    • Walmart Search Scraper
    • Walmart Reviews Scraper
  • Screenshot API
  • Webhook Integration
  • Datacenter Proxies
  • Account API
Powered by GitBook
On this page
  1. Web Scraping API

Request Customization

Scrapingdog offers various functionalities and features like changing the origin of the request, passing custom headers, JS rendering, etc.

PreviousWeb Scraping APINextJavascript Rendering

Last updated 1 month ago

By passing these additional parameters you can customize the request to our web scraping api according to your demands.

Parameter
Description

dynamic

You can use this parameter for JS rendering. It is a boolean so you have to use it like this dynamic=true. Our servers will render JavaScript for that page and will return you the resulting HTML code. The cost of using this param is 5 credits with normal proxies and if you want to use it with premium residential proxies then 25 credits.

premium

When you want to use the premium residential proxy instead of the normal rotating proxy then you can use this param. This is also a boolean so you can access it by setting it to premium=true. This feature will use a USA residential proxy by default. The cost of using this feature is 10 credits and 25 credits if used with JS rendering dynamic=true

custom_headers

When you set custom_header=true our server allows you to pass your own headers.

wait

wait parameter is a time in milliseconds that can be used with the combination of dynamic=true in order to wait and load the website completely. The value of wait can be any whole number between 0 and 35000. Example - wait=5000

country

This parameter helps you access the geotargeting feature. You can pass any country's in order to send a request from that location. Like country=gb will use United Kingdom proxies.

session_number

You can this parameter if you want to reuse the same proxy for multiple requests. You can set any string value to session_number while making the request. Cost does not change when you use this feature.

image

You can use this parameter if you want to scrape image URLs. Type - Boolean

markdown

This parameter is used to get HTML data in the markdown format. Type - Boolean

ai_query

This parameter is used to pass the user prompt to get the AI-optimized response. Example - get me the price of the product

ai_extract_rules

This parameter is used to extract data from pages without parsing the HTML yourself, you can include AI extraction rules in your API request. Example - {"price": "$4"}

ISO code