3. ROBOT BIAS

We propose ΔP(r), a measure of the favoribility of robots across a sample of robots.txt files, to measure the degree to which specific robots are favored (or disfavored) by a set of websites. A formal definition of the robot bias (favored or disfavored) is described below.

Sub section 3.1