801.995.4550 Free 30-Day Trial Login

Mozenda Glossary of Terms

Web Crawling

See also Page Scraping, Website Scraping, Screen Scraping Software, Data Harvesting


Web crawling refers to the systematic way an automated data extraction program will navigate from one page to another, and often from one domain to another, within the internet.


See how easy Web Crawling can be!



Why Mozenda?

Search engines do a fabulous job of helping people find all kinds of information. Mozenda brings a new level of usability and power to capturing data, with point-and-click technology, users can extract the information they need from the web without technical training, or a team of engineers. All you need is to know. A crawler is generally limited to very specific information, but Mozenda is better than a crawler. By focusing on a single domain or website, users can collect any and all information, including context data, which adds more value to the target data.


The Mozenda Advantage

There is no better way to collect information from the website than the Mozenda Agent Builder. The Agent Builder is your tool suite that includes an intuitive UI and a browser based instruction set. Setting up your crawler is as simple as pointing and clicking to navigate pages and capture the information you want. If you ever run into a problem with a particular website, Mozenda’s support staff is standing by to get you moving again. It’s like instant roadside assistance but FREE. You’ll save more time and money by using Mozenda.



There are several alternative techniques to web scraping which are human labor intensive or require advanced computer or programming skills. These methods are primarily ad hoc techniques used to find and isolate data elements within the HTML of a web page. Although these techniques can be useful and are still performed by many companies, they are time consuming to develop and difficult to maintain. Some of these techniques include:

  • Human Copy & Paste
  • Text Grepping
  • HTTP Programming
  • HTML Parsing
  • DOM Parsing
  • Computer Vision web page analyzing


Mozenda Training Videos


Title Length
Play Button Capture Text 0:43
Play Button Input Text Into a Form 0:44
Play Button Click the “Next” Button to Load the Next Page of Results 1:58
Play Button Schedule an Agent to Run Regularly 1:08
Play Button Combine the Contents of Two Fields 1:16


More information on Web Crawling

Need more information?

We are anxious to answer any questions you may have about our products and services. Please feel free to send us a request and we will respond immediately.

Thanks for your submission.