# /robots.txt file for http://webcrawler.com/ # mail site@leejordan.org.uk for constructive criticism User-agent: * Disallow: /lj/ Disallow: /lj/video/ Disallow: /podcasts/ Disallow: /music/ Disallow: /audio/ Disallow: /contacts/ Disallow: /v2/leejordan.sql Disallow: /v2/images/ Disallow: /v2/wp-content/themes/v2/ Disallow: /home/leejordan.sql Disallow: /home/images/