# Tells Scanning Robots Where They Are And Are Not Welcome # User-agent: can also specify by name; "*" is for everyone # Disallow: if this matches first part of requested path, # forget it User-agent: * # applies to all robots Disallow:cgi-bin Disallow:CFIDE Disallow:education-and-languages/includes Disallow:/socialsciences/diasporas/bbc/ Disallow: /ccig/emergentpublics/ Disallow: /ccig/futureevents/ Disallow: /ccig/pastevents/ Disallow: /ccig/system/ Disallow: /cciglive/ Disallow: /socialsciences/__assets/ Disallow: /socialsciences/capabilities/ Disallow: /socialsciences/includes/ Disallow: /socialsciences/psychosocial/ Disallow: /choose/inspiringlearning/html/ Disallow: /makingbritain*/ Disallow: /study/choosinglevel1 Disallow: /socialsciences/psychology/cogpsypanel/ Disallow: /about/annual-report Disallow: /socialimage/ Disallow: /parle/ Disallow: /socialsciences/par/