Customizing Your Mozenda Data Results
July 14, 2017
Based on your business or personal needs, you may need your data in a variety of different ways. Within your settings, there are a number of different changes that you can make to customize the data that you receive.
Our default settings allow you to build an agent and run it all the way through without any issues. We have recently added “Maximize Browser Window” as one of our default settings. For those of you who have been with us for a while, you will want to make sure that this box is checked within your settings. This is done through the Web Console, in Harvesting Settings, under the Advanced tab. We found that the majority of agents needed this feature checked, so we made the default change to better help you be successful with our tool.
If you are looking to customize your data, you may want to consider exploring the different options within the settings of your agents. First off, you will want to learn how to adjust your harvesting settings. It is important to recognize that the harvesting settings will always impact your data results. Any small change can make a big difference, so make sure that you are aware of the changes you are making.
For example, your error handling settings will directly change the results of your data. When your agent starts to error, the default setting under “When an agent error occurs” tells Mozenda to attempt to ignore the error and keep going. As we said before, this is done to allow you to run your agent all the way through without any issues. With that being said, if 100% accuracy in your data set is essential or if you are looking for one output per input, you will want to change this setting to “Stop Agent.” This will tell Mozenda to stop your agent anytime that an error occurs, which gives you the chance to identify the error and fix it. While this may be tedious, it will ensure that your data set is complete and accurate once it finishes.
It is important to notice that these errors are usually caused by changes in website format or development. Websites change all of the time, and it often can be the case that once these changes happen, your agent will run into errors. It may be that the website was updated, a format change occurred, or someone slightly altered the code. When this happens, you may need to make small changes to your agent. It’s not that Mozenda doesn’t work, it’s that Mozenda recognizes the change and can’t continue with the original set-up of the agent. Unfortunately, we cannot control what other developers are doing with their sites, but we do the best that we can to help you be aware of the change before it effects your data set.
As far as the settings under “When a website error occurs” goes, we recommend that you keep “Let the system decided what to do.” We say this because behind the scenes we have predetermined what website errors should be ignored, and what website errors need to be fixed in order to access the data that we are scraping. So, letting the system decide what to do is usually the best option.
Mozenda is a very powerful tool. It allows you to get the data that you need, even though there are many websites with many differences. Over the last 10 years, Mozenda has done a great job of developing an effective and impressive solution that will help you to extract this information as quickly as possible.