## Google
User-Agent: Mediapartners-Google
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
Disallow: /b/

User-Agent: Googlebot
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
Disallow: /b/

## Google mobile (http://googlejapan.blogspot.com/2008/05/google.html)
User-Agent: Googlebot-Mobile
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/

## Yahoo Inc
User-Agent: Slurp
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
Disallow: /b/
crawl-delay:2

## Yahoo! (http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)
User-agent: Y!J-SRD/1.0
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
crawl-delay:2

User-agent: Y!J-MBS/1.0
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
crawl-delay:2

## moba-crawler (http://crawler.dena.jp/)
User-agent: moba-crawler
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/

## livedoor mobile (http://helpguide.livedoor.com/help/search/qa/grp627)
User-agent: LD_mobile_bot
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/

## msn
User-agent: msnbot
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
Disallow: /b/
crawl-delay:120

## Baidu
User-Agent: Baiduspider
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
Disallow: /b/
crawl-delay:120

User-Agent: *
Disallow: /Publisher/
Disallow: /Info/
Disallow: /img/
Disallow: /news_check.html
Disallow: /Support/
Disallow: /b/

User-Agent : *
Sitemap : http://agw.st/sitemap.xml