|
We propose ΔP(r), a measure of the favoribility of
robots across a sample of robots.txt files, to measure the
degree to which specific robots are favored (or disfavored)
by a set of websites. A formal definition of the robot bias
(favored or disfavored) is described below.
Sub section 3.1
|