Instructs the AI agent to navigate to similar types of sub-pages, especially when direct links are not available (e.g., in a product catalog).
Open sub-pages
block is a specialized navigation tool designed for iterating through a list of similar items (like products in a catalog or articles in a list) when these items do not have direct, standard <a> tag links
. This block is used when clicks are handled by JavaScript, and the agent needs to understand the goal of opening each item to proceed.
Instead of finding and following direct URLs, you provide a goal, and the AI agent intelligently interacts with the page elements to open each item sequentially for processing by subsequent blocks. This block itself does not extract any data; it only handles the navigation.
Open sub-pages
block to navigate through a list of items where standard link-finding is not applicable:
<a href="...">
link.Extract Data
block can process each opened page.<a>
tags with href
attributes), the combination of Find Links + Follow Links
is faster and more precise. Use Open sub-pages
for more complex, JavaScript-based list navigation.open each product from the list
, navigate to each job posting shown on the page
.
10
, the agent will open a maximum of the first 10 items that match your criteria. The default is typically 5
.
Extract Data
block.
Extract Data
block will run on each one, creating a separate row in your results for each page.Screenshot: Open sub-pages block configuration panel
Open Websites
).Open sub-pages
block is executed. The AI agent identifies clickable elements that match your description (e.g., “each product in the catalog”).Extract Data
block is triggered to perform the actual data collection from that page. The Open sub-pages block itself does not output any data.
Open Websites Block:
https://example-shop.com/catalog/shoes
Open sub-pages Block (added next):
open each product from the catalog
12
Multiple rows, one per page
Extract Data Block (added next - MANDATORY for data collection):
product_name
, price
, etc.Extract Data
block will then run on each of those pages, creating a result row for each product with the specified details.
must be followed by an Extract Data block
to be useful for data collection.Prefer the Find Links + Follow Links pattern
for all standard navigation tasks involving <a>
tags.Open sub-pages
block is an advanced navigation tool for handling modern, JavaScript-heavy websites where traditional link-finding methods may not apply.