Learn to collect user reviews from websites like Trustpilot, handling pagination and structuring the data.
Open Websites
Paginate a list
Extract Data
Open Websites
and Extract Data
. We will add the Paginate a list
block manually.Open Websites
BlockOpen Websites
block.https://www.trustpilot.com/review/asana.com
https://www.trustpilot.com/review/monday.com
https://www.trustpilot.com/review/clickup.com
Screenshot: Open Websites block configured with Trustpilot URLs
Paginate a list
BlockOpen Websites
block, we need to tell the agent to go through multiple pages of reviews for each company.Paginate a list
.+
icon below the Open Websites
block to add this block.Paginate a list
block to configure it.
3
. This means for each company, the agent will try to load and process up to 3 pages of reviews (the initial page plus two “Next” page actions). This block handles clicking “Next page” buttons or similar pagination controls.Paginate a list block configured for 3 pages
Extract Data
BlockOpen Websites
and processed by the Paginate a list
blocks.
Extract Data
block (it should be after Paginate a list
).
A list of items
, as each page will contain multiple reviews.
NAME | EXAMPLE VALUE OR A LONGER DESCRIPTION |
---|---|
reviewer_name | The name of the person who wrote the review, e.g., Jane D. |
review_date | The date the review was published or experienced, e.g., Jan 15, 2024 |
rating_stars | The star rating given by the user, as a number (1-5), e.g., 5 |
review_title | The title or headline of the review. |
review_text | The full body text of the user's review. |
company_name | The name of the company being reviewed (extract from page or use variable if available from input). |
Extract all user reviews visible on the current page. If a field is not present for a review, leave it empty. Ensure review_text captures the complete review.
Screenshot: Extract Data block configured for extracting review details
Paginate a list
block will take over, loading up to 3 pages of reviews for that company.Extract Data
block will scrape all the reviews according to your schema.