Robot | Path | Permission |
GoogleBot | / | ✔ |
BingBot | / | ✔ |
BaiduSpider | / | ✔ |
YandexBot | / | ✔ |
Title | The Web Robots Pages |
Description | N/A |
Keywords | N/A |
WebSite | www.robotstxt.org |
Host IP | 93.93.131.3 |
Location | United Kingdom |
Site | Rank |
seeme-media.com | #1,198,258 |
weareinfront.com | #1,204,329 |
thesearchguru.com | #348,228 |
deepcrawl.com | #33,503 |
search.gov | #665,908 |
salarycalculator.sinaapp.com |
snap.com |
tapinto.net |
timebucks.com |
trackingmore.com |
tradeease.net |
trans.eu |
trivago.hk |
tvmost.com.hk |
upaiyun.com |
ohiorcrc.org |
ohyasmineats.com |
US$61,243
Last updated: Sep 12, 2021
Robotstxt.org has global traffic rank of 478,814 and ranks the 33,274th in United States. Its global rank has gone down by 417,418 positions since 3 months ago. Robotstxt.org has an estimated worth of US$ 61,243, based on its estimated Ads revenue. Robotstxt.org receives approximately 6,579 unique visitors each day. Its web server is located in United Kingdom, with IP address 93.93.131.3. According to SiteAdvisor, robotstxt.org is safe to visit. |
Purchase/Sale Value | US$61,243 |
Daily Ads Revenue | US$33 |
Monthly Ads Revenue | US$1,006 |
Yearly Ads Revenue | US$12,248 |
Daily Unique Visitors | 6,579 |
Note: All traffic and earnings values are estimates. |
Global Rank | 478,814 |
Delta (90 Days) | ⬇️ 417,418 |
Most Popular In Country | United States |
Country Rank | 33,274 |
Host | Type | TTL | Data |
robotstxt.org | A | 3600 | IP: 93.93.131.3 |
robotstxt.org | AAAA | 3600 | IPv6: 2a00:1098:0:86:1000:0:0:33 |
robotstxt.org | MX | 3600 | Priority: 10 Target: mx.mythic-beasts.com. |
robotstxt.org | NS | 21600 | Target: ns2.mythic-beasts.com. |
robotstxt.org | NS | 21600 | Target: ns1.mythic-beasts.com. |
robotstxt.org | TXT | 300 | TXT: google-site-verification=FuTkdKut4zpT5f61O29qfjnWKg3u5iA292tOglYwZuo |
robotstxt.org | TXT | 300 | TXT: v=spf1 include:_spf.mythic-beasts.com ~all |
robotstxt.org | SOA | 21600 | MNAME: ns2.mythic-beasts.com. RNAME: hostmaster.mythic-beasts.com. Serial: 2010011863 Refresh: 21600 Retry: 7200 Expire: 604800 Minimum TTL: 3600 |
HTTP/1.1 301 Moved Permanently Date: Sun, 12 Sep 2021 09:55:54 GMT Server: Apache/2.4.38 (Debian) Location: http://www.robotstxt.org/ Cache-Control: max-age=3600 Expires: Sun, 12 Sep 2021 10:55:54 GMT Content-Length: 312 Content-Type: text/html; charset=iso-8859-1 HTTP/1.1 200 OK Date: Sun, 12 Sep 2021 09:55:54 GMT Server: Apache/2.4.38 (Debian) Vary: User-Agent,Accept-Encoding Last-Modified: Sun, 03 May 2020 13:29:25 GMT ETag: "110b-5a4be6736ce42" Accept-Ranges: bytes Content-Length: 4363 Content-Type: text/html |
Domain Name: ROBOTSTXT.ORG Registry Domain ID: D34003338-LROR Registrar WHOIS Server: whois.tucows.com Registrar URL: http://www.tucows.com Updated Date: 2019-09-03T13:01:02Z Creation Date: 2000-09-04T14:43:31Z Registry Expiry Date: 2022-09-04T14:43:31Z Registrar Registration Expiration Date: Registrar: Tucows Inc. Registrar IANA ID: 69 Registrar Abuse Contact Email: domainabuse@tucows.com Registrar Abuse Contact Phone: +1.4165350123 Reseller: Domain Status: ok https://icann.org/epp#ok Registrant Organization: none Registrant State/Province: Norfolk Registrant Country: GB Name Server: NS1.MYTHIC-BEASTS.COM Name Server: NS2.MYTHIC-BEASTS.COM DNSSEC: signedDelegation URL of the ICANN Whois Inaccuracy Complaint Form https://www.icann.org/wicf/) |