Splitting Up Your Agents
March 21, 2018
The Job Sequencer feature introduced splitting up agents as a new best practice for efficiency and speed. Splitting up your agents allows you to capture URLs of specific categories and then create concurrent jobs to scrape the data you need. This saves time when scraping large amounts of data.
Create a basic web scraping Agent and use concurrent jobs.
Learn How To Create Multiple Jobs In An Agent
The process of data extraction through one linear type of agent could take a longer than expected when scraping large amounts of data. Click below to watch the video tutorial to learn how to save time by splitting up agents.