Decodo Web Scraping · Tutorial 01

Choose the right Decodo scraping route

Start with the smallest Decodo product that fits the job: MCP for an assistant, Web Scraping API for code, or a proxy product for your own scraper.

Hand-cut paper workflow showing a public web page passing through a Decodo MCP bridge into an AI agent and a checked research table.
Reading time
9 min
Last updated
August 2026

0 of 11 complete

Complete & next →

Decodo is not one scraper. It offers several ways to reach public web data. Beginners usually lose time by starting too low in the stack: they configure proxies when an MCP tool could already complete the job.

Use this rule:

  • Talking to an AI assistant: start with the Decodo MCP server.
  • Building an app, scheduled job, or data pipeline: use the Web Scraping API.
  • Maintaining your own browser or scraper: consider Site Unblocker or a proxy product.

This course concentrates on MCP and the Web Scraping API because they remove most proxy rotation, rendering, parsing, and retry work.

Decodo Web Scraping API dashboard showing target templates for Web, Google, Amazon, Target, Walmart, Reddit, ChatGPT, Perplexity, Google Travel, Google AI Mode, Google Lens, and Bing.
Decodo target templates shown in Ron’s June 30, 2026 walkthrough. The dashboard changes over time; use the current template catalog as the source of truth.

What each route is for

RouteBest first useWhat you control
MCP serverAsk Claude, Cursor, Windsurf, Hermes, or another MCP client to collect current evidenceToolsets, prompt, geography, rendering, device, output limit
Web Scraping APIPut scraping inside code or automationEndpoint, target template, request mode, browser actions, response formats
Site UnblockerSend traffic from your own scraper through managed anti-bot handlingProxy-style connection, location, session, headers, rendering
Residential/mobile/ISP/datacenter proxiesRun a custom network stack with direct IP controlPool, location, rotation, sticky sessions, protocol

Do not begin with proxies because they sound more powerful. Begin with the output you need.

MCP toolsets in plain English

Decodo groups its MCP tools into five toolsets. Enabling only relevant toolsets keeps the assistant’s choices clear.

  1. web — any public URL as Markdown, or a PNG screenshot.
  2. search — Google Search, Google Ads, Google Lens, Google Travel Hotels, and Bing Search.
  3. ecommerce — Amazon, Walmart, Target, and TikTok Shop search/product tools.
  4. social_media — Reddit posts, subreddits and users; TikTok posts; YouTube search, channels, metadata, and subtitles.
  5. ai — ChatGPT, Perplexity, and Google AI Mode results.

All 30 current MCP tools appear across later tutorials. You do not need all 30 enabled for every conversation.

Step-by-step: define one useful job

Before opening the dashboard, write four lines:

  1. Target: one public URL, query, product ID, channel, or post.
  2. Deliverable: exact fields or decision you need.
  3. Freshness: when the information must have been observed.
  4. Budget: maximum Decodo requests and retry count.

Example:

Target: the five leading pages for “best compact espresso machine”.
Deliverable: rank, title, URL, domain, snippet, and observed date.
Freshness: collect today.
Budget: 1 Google Search request; no automatic retries.

That is a scraping job. “Research espresso machines” is only a topic.

Choose a route

Use this quick test:

  • Need one answer inside a chat? MCP.
  • Need the same job every day? Prove it with MCP, then move the stable request to the API.
  • Need clicks, typed inputs, waits, or XHR capture? Web Scraping API browser actions.
  • Need raw network control for custom code? Site Unblocker or proxies.

What success looks like

A successful first scrape includes:

  • the exact Decodo tool or API target used;
  • source URL or query;
  • observation time and requested geography;
  • structured fields, not a loose paragraph;
  • honest empty fields instead of invented values;
  • request count and any retries;
  • a human check against the source.

Safety boundary

Keep this course to public or authorized data. Do not use it for post-login content, private user information, bypassing access controls, or collecting more personal data than the task needs. Website terms, privacy rules, and local law still apply.

Next: connect one MCP client and prove that it can see Decodo’s tools.

Official references