Fixing A Page List In The Agent Builder - Mozenda

Fixing A Page List In The Agent Builder

March 21, 2018

Here is a quick tutorial on how to get your Mozenda web scraping agents to automatically click on the “next page” button, on the websites you are extracting web data from, to be able to continue your data extraction project without interruption. We name this process “pagination” or “creating page lists.”

Basic Setup:
Below are two help tutorials that will show you how to easily set page lists:
Creating A Page List Using The Next Page Button
Creating A Page List Using Number Links

Advanced Setup:
All websites are not programmed the same. Some are more complex than others. If your agent isn’t setting page lists by following the instructions above, you can use a more advanced method named Xpath to get it to work. Click below to watch the video tutorial on how to use Xpath paginate or create page lists.