Ernst K. Simader - Web Services - Bot Checker

Ernst K. Simader

Web Services - Bot Checker

More and more traffic to web pages come from Web crawlers. Via the User Agent string in the HTTP header these spies can usually be distinguished from real visitors, unless they mask themselves by false information.
The current User Agent: CCBot/2.0 (https://commoncrawl.org/faq/)

This query can e.g. be installed at the start of a web session to identify or eliminate "bot hits" in the web site statistics. The service is available either as SOAP web service or RESTful web service.



User Agent string missing!