Visual Web Scraping Workflows in Flowise
Drag and drop live web extraction into your Flowise AI canvas. Connect FlyCrawl with conversational agents, vector databases, and multi-agent systems with zero puppeteer setup.
How Flowise Nodes Coordinate with FlyCrawl
From visual node placement to autonomous web research in under 400 milliseconds.
3 Simple Steps to Integrate with Flowise
Add live web browsing to any Flowise Chatflow in less than 90 seconds.
Create Custom Tool
In your Flowise dashboard, go to Tools in the left sidebar and click 'Add New'. Name it 'flycrawl_web_scraper'.
Paste JavaScript Handler
Paste the fetch snippet into the Javascript function box. Replace YOUR_FLYCRAWL_API_KEY with your live key.
Connect to Agent Node
Open any Chatflow, drag the new Custom Tool onto the canvas, and wire it to the 'Allowed Tools' socket of your Agent node.
Flowise Custom Tool Implementation
const fetch = require('node-fetch');
const response = await fetch('https://api.flycrawl.net/v1/scrape', {
method: 'POST',
headers: {
'Authorization': 'Bearer YOUR_FLYCRAWL_API_KEY',
'Content-Type': 'application/json'
},
body: JSON.stringify({
url: $input,
formats: ['markdown'],
onlyMainContent: true
})
});
const data = await response.json();
if (data && data.data && data.data.markdown) {
return data.data.markdown;
}
return 'Error: Could not retrieve webpage markdown content.';
Frequently Asked Questions
Everything you need to know about running FlyCrawl inside Flowise canvases.
Upgrade Your Flowise AI Workflows Today
Start scraping and browsing the web visually with 100 free credits. Fast integration in under 2 minutes.