OK
https://s.gr-assets.com/robots.txt
Websites
Runtime: 1.9s
On September 19, 2024, 01:39 AM UTC, https://s.gr-assets.com/robots.txt was accessible when tested on AS12812 in Lebanon.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
172.253.228.154
Query:
IN A s.gr-assets.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
18.161.114.233
TCP Connections
Connection to 18.161.114.233:443 succeeded.
HTTP Requests
URL
GET https://s.gr-assets.com/robots.txt
Response Headers
Cache-Control:max-age=0, private, must-revalidateContent-Type:text/plain; charset=utf-8Date:Thu, 19 Sep 2024 01:39:32 GMTEtag:W/"51daa575e4eff4ac6dc66635520415a3"Server:ServerStrict-Transport-Security:max-age=63072000; includeSubDomains; preloadVary:Accept-EncodingVia:1.1 830a57eccbd3fe5dbe1beff515179f28.cloudfront.net (CloudFront)X-Amz-Cf-Id:A0KYT46t_eXA6RVbAVFVKz87w1OGHO-2UvGXtYA8XSrY59azpx8XKA==X-Amz-Cf-Pop:MRS52-P4X-Amz-Rid:S6VN1MKPG10A07PS9GDRX-Cache:Miss from cloudfrontX-Content-Type-Options:nosniffX-Frame-Options:ALLOWALLX-Request-Id:S6VN1MKPG10A07PS9GDRX-Runtime:0.017979X-Xss-Protection:1; mode=block
Response Body
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * Allow: /work/editions Allow: /work/quotes Disallow: /about/team_member/ Disallow: /admin Disallow: /api Disallow: /blog/list_rss Disallow: /book/reviews/ Disallow: /book_link/follow/ Disallow: /buy_buttons/ Disallow: /ebooks Disallow: /event/show/ Disallow: /friend/add_as_friend Disallow: /home/index_rss Disallow: /oggiPlayerLoader.htm Disallow: /photo/group/ Disallow: /quotes/list_rss Disallow: /quotes/tag Disallow: /reader Disallow: /review/list Disallow: /review/list_rss Disallow: /review/rate Disallow: /review/show Disallow: /search Disallow: /shelf/user_shelves Disallow: /story Disallow: /tooltips Disallow: /track Disallow: /trivia/answer Disallow: /user/updates_rss Disallow: /user/year_in_books Disallow: /videos/ Disallow: /work Disallow: /*reviewFilters Sitemap: https://www.goodreads.com/siteindex.author.xml Sitemap: https://www.goodreads.com/siteindex.author_community_question.xml Sitemap: https://www.goodreads.com/siteindex.award.xml Sitemap: https://www.goodreads.com/siteindex.blog.xml Sitemap: https://www.goodreads.com/siteindex.book_community_question.xml Sitemap: https://www.goodreads.com/siteindex.genre.xml Sitemap: https://www.goodreads.com/siteindex.giveaway.xml Sitemap: https://www.goodreads.com/siteindex.group.xml Sitemap: https://www.goodreads.com/siteindex.index.xml Sitemap: https://www.goodreads.com/siteindex.interview.xml Sitemap: https://www.goodreads.com/siteindex.list.xml Sitemap: https://www.goodreads.com/siteindex.quote.xml Sitemap: https://www.goodreads.com/siteindex.quote_tag.xml Sitemap: https://www.goodreads.com/siteindex.related_work.xml Sitemap: https://www.goodreads.com/siteindex.topic.xml Sitemap: https://www.goodreads.com/siteindex.user.xml User-agent: EtaoSpider Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: /
Resolver
Resolver ASN
AS15169
Resolver IP
172.253.228.154
Resolver Network Name
Google LLC
Report ID
20240919T012541Z_webconnectivity_LB_12812_n1_df2VBQjV5eoje0Ul
Platform
android
Software Name
ooniprobe-android-unattended (3.9.0)
Measurement Engine
ooniprobe-engine (3.23.0)