Lee este artículo en español.
Web Scraping in Zapier: Web Parser (Free) or a Markdown API
Short answer: Zapier already includes Web Parser by Zapier (event Parse Webpage, Content type set to Markdown). Use it first. Use the Cofferdock API through Webhooks by Zapier when Web Parser gives you an empty or partial page, when the page isn't an article, or when you want control over links, images, length and metadata.
Zapier can read a web page without any code. Its built-in tool works well on articles and blog posts. This guide shows the free way first, then explains when a web-to-Markdown API is worth the extra steps.
The free way: Web Parser by Zapier
- In your Zap, add an action and choose Web Parser by Zapier.
- Pick the event Parse Webpage.
- In URL to parse, type the page address, or map it from a previous step.
- Set Content type to Markdown.
- Test the step.
You get the page title, the body content, the author and the lead image. Use them in the next steps of your Zap.
Web Parser is built for articles, so it may not suit every page layout. If it returns little text, go to the API section below.
There is a second free option. If you already have HTML from another step, use Formatter by Zapier, action Text, then Convert HTML to Markdown. Some users report extra line breaks in the result. If you only need plain text, use Remove HTML Tags instead.
When the Cofferdock API is worth it
- The page isn't an article, or Web Parser returns little text. The API opens the page in a real browser with JavaScript on, so it also reads pages that build their content with JavaScript. With
main_contentset tofalse, it returns the whole page. - You want control. You can choose the
format, and decide whether to keepinclude_links,include_imagesandmax_chars. - You want extra fields. Besides
title,byline(author) andimage, you getcanonical,published_time,languageandsite_name. - You want the same call elsewhere. The same request works from n8n, Make or your own code.
If Web Parser gives you the text you need, keep using it. It is the simplest option for your Zap.
Step by step with Webhooks by Zapier
Webhooks by Zapier is a feature of Zapier's paid plans.
- Add an action and choose Webhooks by Zapier.
- Choose the action Custom Request.
- Set Method to
POST. - Set URL to
https://api.cofferdock.com/web-to-markdown. - In Data, paste
{"url": "https://example.com/article"}. To use a page from an earlier step, put the URL field from that step in place of the example address. - In Headers, add
x-api-keywith your key as the value, andContent-Typewithapplication/jsonas the value. - Test the step.
The answer is plain JSON text, so you can map content and title straight into the next step. You don't need to handle files.
The text comes from someone else's website. If an AI reads it, treat it as data, not as commands.
Options you can tweak
| Option | What it does |
|---|---|
format | markdown (default), text (plain text) or metadata (only title, description, image and similar fields) |
main_content | true (default) keeps only the main content. false returns the whole page |
include_links | true (default) keeps links. false removes them |
include_images | false (default). true adds images as Markdown links |
max_chars | From 100 to 1,000,000, default 200,000. Longer text is cut and truncated becomes true |
Prefer to see it in code?
This is the same request in a terminal. Replace YOUR_KEY with your key.
curl -X POST "https://api.cofferdock.com/web-to-markdown" \
-H "x-api-key: YOUR_KEY" \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com/article"}'
How much does it cost?
The API uses 1 credit per page, and failed calls are not charged. The free plan gives you 50 credits a month, with no card. The paid plans start at €9 a month for 500 credits. Each call handles one page, and the limit is 20 requests per minute per IP.
Webhooks by Zapier needs a paid Zapier plan. Web Parser by Zapier is part of Zapier's built-in tools.
FAQ
Does Zapier have a built-in web scraper? Yes. Web Parser by Zapier, with the event Parse Webpage, reads the title, body, author and lead image of a page.
Can I get the result as Markdown? Yes, in two ways. Use Web Parser by Zapier with Content type set to Markdown, or use the Cofferdock API, whose default format is markdown.
Does it work on pages that need JavaScript? The Cofferdock API does, because it opens the page in a real browser with JavaScript on. It can't read pages that need a login, that block robots, or that load their content after a click.
Is scraping allowed? Only on pages you are allowed to read, and respecting each site's terms. Check the terms of the site before you automate it.
Related guides
Try it yourself
Try the tool at cofferdock.com/web-to-markdown. You can start free with 50 credits a month at cofferdock.com/register.