OK
https://external-content.duckduckgo.com/robots.txt
Websites
Runtime: 678ms
On September 19, 2024, 03:51 PM UTC, https://external-content.duckduckgo.com/robots.txt was accessible when tested on AS47172 in Netherlands.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
172.71.97.149
Query:
IN A external-content.duckduckgo.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
52.142.125.222
TCP Connections
Connection to 52.142.125.222:443 succeeded.
HTTP Requests
URL
GET https://external-content.duckduckgo.com/robots.txt
Response Headers
Accept-Ranges:bytesCache-Control:max-age=31536000Content-Length:382Content-Security-Policy:default-src 'none' ; connect-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; manifest-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; media-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; script-src blob: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com 'unsafe-inline' 'unsafe-eval' ; font-src data: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; img-src data: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; style-src https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com 'unsafe-inline' ; object-src 'none' ; worker-src blob: ; child-src blob: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; frame-src blob: https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; form-action https://duckduckgo.com https://*.duckduckgo.com https://duckduckgogg42xjoc72x3sjasowoarfbgcmvfimaftt6twagswzczad.onion/ https://spreadprivacy.com ; frame-ancestors 'self' https://html.duckduckgo.com; base-uri 'self' ; block-all-mixed-content ;Content-Type:text/plain; charset=UTF-8Date:Thu, 19 Sep 2024 15:52:24 GMTEtag:"64f0c5eb-17e"Expect-Ct:max-age=0Expires:Fri, 19 Sep 2025 15:52:24 GMTLast-Modified:Thu, 31 Aug 2023 16:55:07 GMTPermissions-Policy:interest-cohort=()Referrer-Policy:originServer:nginxStrict-Transport-Security:max-age=31536000Vary:Accept-EncodingX-Content-Type-Options:nosniffX-Duckduckgo-Locale:en_USX-Frame-Options:SAMEORIGINX-Xss-Protection:1;mode=block
Response Body
User-agent: * Disallow: /lite Disallow: /html # No search result pages Disallow: /*? # chrome new tab page Disallow: /chrome_newtab # Email Protection Disallow: /email/ Allow: /email/$ Allow: /email/privacy-guarantees Allow: /email/privacy-terms # Old Privacy page Disallow: /2012-privacy-policy User-agent: ia_archiver Disallow: / Sitemap: https://duckduckgo.com/sitemap.xml
Resolver
Resolver ASN
AS13335
Resolver IP
172.71.97.149
Resolver Network Name
Cloudflare Inc
Report ID
20240919T154842Z_webconnectivity_NL_47172_n1_nqdhcoARZenCQgsd
Platform
macos
Software Name
ooniprobe-desktop-unattended (3.17.5)
Measurement Engine
ooniprobe-engine (3.17.5)