# All robots will spider the domain User-agent: * Disallow: # Disallow directory /brackley/ User-agent: * Disallow: /brackley/ Disallow: /buckingham/ Disallow: /towcester/ Disallow: /weedon/ Disallow: /woodford/ Disallow: /aspnet_client/ Disallow: /cgi-bin/ Disallow: /control/ Disallow: /include/ Disallow: /styles/ Disallow: /undefined/ Disallow: webControl.mdb Disallow: webRecords.mdb