# /robots.txt for http://www.maths.usyd.edu.au:8000/ # See http://info.webcrawler.com/mak/projects/robots/exclusion.html # Jim Richardson User-agent: * Disallow: /WebCT/ # local copies of documentation Disallow: /comp/magma # obsolete: use /u/magma instead Disallow: /loc/ # documents for local access only Disallow: /s/cldisc # class discussions Disallow: /s/coms # local command index Disallow: /s/lscnitm/ # local news items by CGI Disallow: /s/duman/ # Digital manual pages Disallow: /s/sccal # calendar: changes rapidly Disallow: /s/i2w # info-to-WWW Disallow: /s/membsel?sursub= # surname search from pub-seek?aux Disallow: /u/malcolmq/R/ # data etc Disallow: /s/pub-seek?rg= # numerous duplicate publication lists Disallow: /u/rupert/reddoc/ # Reduce documentation Disallow: /ub/hughl/ # MX exchange etc Disallow: /w/loc/ # local-access documents on adw Disallow: /w/~timetbl/ # course timetables Disallow: /w/tt/ # course timetables Disallow: /u/gart/accommodation.html Disallow: /iw/ # internal wiki Disallow: /u/texdoc # TeX documentation