Fixing A Page List In The Agent Builder
March 21, 2018
Here is a quick tutorial on how to get your Mozenda web scraping agents to automatically click on the “next page” button, on the websites you are extracting web data from, to be able to continue your data extraction project without interruption. We name this process “pagination” or “creating page lists.”
All websites are not programmed the same. Some are more complex than others. If your agent isn’t setting page lists by following the instructions above, you can use a more advanced method named Xpath to get it to work. Click below to watch the video tutorial on how to use Xpath paginate or create page lists.