# Robots.txt file from http://sr.ju690.com # All robots will spider the domain User-agent:* Disallow: / Disallow:/static/ #Disallow:/meme/ Disallow:/meme/content_ajax Disallow:/meme/latest Disallow:/meme/share Disallow:/meme/srcbacks Disallow:/meme/random User-agent:* #Disallow:/m Disallow:/m/e/ Disallow:/m/a/ Disallow:/m/p/ #Disallow:/people/ #Disallow:/author/ User-agent: Spinn3r Disallow: / User-agent: MLBot Disallow: / User-agent: Slurp Disallow:/ #User-agent: YodaoBot #Disallow:/ #User-agent: Sosospider #Disallow:/ User-agent: twiceler. Disallow:/ User-agent: Sogou Disallow:/ User-agent: sogou spider Disallow:/ User-agent: sogou web spider Disallow:/ User-agent: psbot Disallow:/ User-agent: Yeti Disallow:/ User-agent: msnbot-media Disallow:/ User-agent: msnbot Disallow:/ User-agent: MJ12bot Disallow: / Sitemap:http://sr.ju690.com/sitemap.xml # End robots.txt file