Problem / Goal
Automated bots visiting Skyscanner’s website and retrieving data from the servers generated significant costs in equipment and in charges for Internet traffic.
We designed and executed a prototype tool for analyzing the current traffic on the website (25+ million visitors per month) and subsequently detecting and blocking bots. The system made it possible to collect and analyze bot behavioral patterns, as well as to detect suspicious IP addresses that generated unwanted traffic on the website. This knowledge in turn enabled blocking bots automatically.
Upon implementation, it turned out that a very significant amount of website traffic was generated by unauthorized bots. Their elimination helped Skyscanner to save millions of dollars over the long term, while increasing speed and availability of the service for regular users.