Skip to content
My Blog
My WordPress Blog
Home
About Us
Contact Us
Custom Sitemap Generator
Disclaimer
Google Index Checker
Privacy Policy
Robots.txt Generator
Sample Page
Terms and Conditions
What is My IP Address
Whois Lookup
Word Count Tool
facebook.com
twitter.com
t.me
instagram.com
youtube.com
Subscribe
Robots.txt Generator
Robots.txt Generator
Default - All Robots are:
Allow
Disallow
Crawl-Delay:
5 seconds
10 seconds
15 seconds
20 seconds
25 seconds
30 seconds
35 seconds
40 seconds
45 seconds
50 seconds
55 seconds
60 seconds
65 seconds
70 seconds
75 seconds
80 seconds
85 seconds
90 seconds
95 seconds
100 seconds
105 seconds
110 seconds
115 seconds
120 seconds
Sitemap URL:
Include Example Rules
Search Robots:
Google:
Same as Default
Allow
Disallow
Google Image:
Same as Default
Allow
Disallow
Google Mobile:
Same as Default
Allow
Disallow
MSN Search:
Same as Default
Allow
Disallow
Yahoo:
Same as Default
Allow
Disallow
Yahoo MM:
Same as Default
Allow
Disallow
Yahoo Blogs:
Same as Default
Allow
Disallow
Ask/Teoma:
Same as Default
Allow
Disallow
GigaBlast:
Same as Default
Allow
Disallow
DMOZ Checker:
Same as Default
Allow
Disallow
Nutch:
Same as Default
Allow
Disallow
Alexa/Wayback:
Same as Default
Allow
Disallow
Baidu:
Same as Default
Allow
Disallow
Naver:
Same as Default
Allow
Disallow
MSN PicSearch:
Same as Default
Allow
Disallow
Restricted Directories:
Disallow Paths (one per line):
Allow Paths (one per line):
Scroll to Top