Changing the way you receive insight through tools and analytics
Continues learning of on-going lifetime risk in keyword
Niche/market monitoring and prioritization
Early detection of anomalies of Google SERPs

cmlabs Crawling System Detail

The cmlabs keyword tracker has a robot that works to crawl data at an exact time. The data crawling process into three times, such as Tomorrow, Early Week, and Monthly. This page will explain a complete discussion of detailed crawling on cmlabs Keyword Tracker.


Our robot will crawl the SERP data every midnight. If there is a new keyword, your data will appear the next day when the keyword data has through the crawling process.

This process occurs automatically without any request from the user. After the data crawling process is complete, the cmlabs bot will automatically calculate the data to get insights such as keyword ranking, tracked keywords, and rank distribution.

Sections through daily data crawling :

  • Quick overview
  • Rank distribution
  • Tracked keyword
  • Category tag
  • Ranking history
  • Keyword ranking
  • Archived SERP
  • HTML

Early week

The weekly SERP crawling system is a process that will only occur when users do "Add keywords" or add new keywords. cmlabs bot will manage the new keywords entered. Then at the end of the week, the system will retrieve search volume data and display it on a graph in the early week.

Weekly crawl results when adding new keywords:

  • Market share
  • Google search volume
  • Market update
  • Search volume
  • Competitive landscape

Note : New keywords will have a weekly crawl process to display the above section. Furthermore, it will be updated daily.


We will update the search volume of added keywords monthly. The Google search volume crawling process is carried out at the end of the month to display new demand data. The search volume data will be valid for one month before the monthly crawling process is done again.

If you're having trouble with our crawling system, please send your questions to business@cmlabs.co, and our team will assist you.

Do you find this article helpful?
it's helpful
I need better one

You may be sent through cmlabs.co or cmlabs Analytics links to other websites or content belonging to or originating from third parties or links to websites and features in banners or other advertising. Such external links are not investigated, monitored, or checked for accuracy, adequacy, validity, reliability, availability or completeness by us. We do not warrant, endorse, guarantee, or assume responsibility for the accuracy or reliability of any information offered by third-party websites

Last updated 2020-06-26 UTC.