Replace Page List Actions
April 27, 2018
Here is a quick tutorial on how to get your Mozenda web scraping agents to automatically click on the “next page” button, on the websites you are extracting web data from, to be able to continue your data extraction project without interruption. We name this process “pagination” or “creating page lists.” Sometimes the page list feature will not work on a website. When this happens you can look to see if it is possible to load the next page of a site using a load page and a parameter.
All websites are not programmed the same. Some are more complex than others. In this tutorial, you will learn how to use a parameter and a load page to replace the page list action and how to dynamically capture the total amount of pages for a multiple list site.