OK
https://scontent.cdninstagram.com/robots.txt
Websites
Runtime: 262ms
On September 15, 2024, 05:52 PM UTC, https://scontent.cdninstagram.com/robots.txt was accessible when tested on AS42455 in Isle of Man.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
172.217.32.30
Query:
IN A scontent.cdninstagram.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
157.240.225.63
Query:
IN AAAA scontent.cdninstagram.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
AAAA
2a03:2880:f266:c4:face:b00c:0:43fe
TCP Connections
Connection to 2a03:2880:f266:c4:face:b00c:0:43fe:443 was blocked.
Connection to 157.240.225.63:443 succeeded.
HTTP Requests
URL
GET https://scontent.cdninstagram.com/robots.txt
Response Headers
Content-Security-Policy:default-src 'self' 'unsafe-inline' data: blob: https://*.cdninstagram.com https://*.fbcdn.net;block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;require-trusted-types-for 'script';Content-Type:text/plain; charset=utf-8Cross-Origin-Embedder-Policy:require-corpCross-Origin-Opener-Policy:same-origin-allow-popups;report-to="coop_report"Cross-Origin-Resource-Policy:same-originDate:Thu, 05 Sep 2024 15:38:24 GMTDocument-Policy:force-load-at-topExpires:Fri, 06 Sep 2024 15:38:24 +0000Origin-Agent-Cluster:?1Permissions-Policy:accelerometer=(), attribution-reporting=(), autoplay=(), bluetooth=(), camera=(), ch-device-memory=(), ch-downlink=(), ch-dpr=(), ch-ect=(), ch-rtt=(), ch-save-data=(), ch-ua-arch=(), ch-ua-bitness=(), ch-viewport-height=(), ch-viewport-width=(), ch-width=(), clipboard-read=(), clipboard-write=(), compute-pressure=(), display-capture=(), encrypted-media=(), fullscreen=(self), gamepad=(), geolocation=(), gyroscope=(), hid=(), idle-detection=(), interest-cohort=(), keyboard-map=(), local-fonts=(), magnetometer=(), microphone=(), midi=(), otp-credentials=(), payment=(), picture-in-picture=(), private-state-token-issuance=(), publickey-credentials-get=(), screen-wake-lock=(), serial=(), shared-storage=(), shared-storage-select-url=(), private-state-token-redemption=(), usb=(), unload=(self), window-management=(), xr-spatial-tracking=();report-to="permissions_policy"Report-To:{"max_age":2592000,"endpoints":[{"url":"https:\/\/www.facebook.com\/browser_reporting\/coop\/?minimize=0"}],"group":"coop_report","include_subdomains":true}, {"max_age":21600,"endpoints":[{"url":"https:\/\/www.facebook.com\/ajax\/browser_error_reports\/"}],"group":"permissions_policy"}Reporting-Endpoints:coop_report="https://www.facebook.com/browser_reporting/coop/?minimize=0", permissions_policy="https://www.facebook.com/ajax/browser_error_reports/"Strict-Transport-Security:max-age=15552000; includeSubDomainsVary:Accept-EncodingX-Content-Type-Options:nosniffX-Fb-Debug:bSBKscfAAKRFjXvazCdFEYeUrZ6hsnUWY2b43s8a8w/TwSDcZLFf9rAMpfV7zUz6KA8Yaod4aULgWJRMu0VYGA==X-Fb-Server-Load:72X-Frame-Options:DENYX-Xss-Protection:0
Response Body
# Notice: Collection of data on Instagram through automated means is # prohibited unless you have express written permission from Instagram # and may only be conducted for the limited purpose contained in said # permission. User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: PetalBot Disallow: / User-agent: viberbot Disallow: / User-agent: YaK Disallow: / User-agent: Yandex Disallow: / User-agent: Applebot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Bingbot Disallow: /*/c/ Disallow: /*/comments/ Disallow: /*/liked_by/ Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Discordbot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: DuckDuckBot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: facebookexternalhit Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Googlebot Disallow: /*/c/ Disallow: /*/comments/ Disallow: /*/liked_by/ Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Googlebot-Image Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: LinkedInBot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: msnbot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Naverbot Disallow: /*/c/ Disallow: /*/comments/ Disallow: /*/liked_by/ Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Pinterestbot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Screaming Frog SEO Spider Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: seznambot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Slurp Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: teoma Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: TelegramBot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Twitterbot Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: Yeti Disallow: /ajax/ Disallow: /client_error/ Disallow: /direct/ Disallow: /logging/ Disallow: /publicapi/ Disallow: /qp/batch_fetch_web/ Disallow: /query/ User-agent: * Disallow: /
Resolver
Resolver ASN
AS15169
Resolver IP
172.217.32.30
Resolver Network Name
Google LLC
Report ID
20240915T175126Z_webconnectivity_IM_42455_n1_oNnDYLfDmvZiV7Lz
Platform
android
Software Name
ooniprobe-android (3.9.0)
Measurement Engine
ooniprobe-engine (3.23.0)