Ernst K. Simader - Web Services - Bot Checker
More and more traffic to web pages come from
Via the User Agent string in the HTTP header these spies can usually be distinguished from real visitors,
unless they mask themselves by false information.
The current User Agent: CCBot/2.0 (https://commoncrawl.org/faq/)
This query can e.g. be installed at the start of a web session to identify or eliminate "bot hits" in the web site statistics. The service is available either as SOAP web service or RESTful web service.