generated: '2026-07-19' method: probed source: live HTTP probes of https://knotel.com notes: >- knotel.com is a Next.js application that returns HTTP 200 with the marketing HTML shell for ANY unmatched path (a soft 404). Status code alone is therefore meaningless on this host. Every probe below was verified by content-type and by comparing the response body and against a known-bad control path (/nonexistent-xyz-123). The soft-404 shell is identifiable by the title "Knotel | Flexible Workscapes for the Modern Workplace" (note "Workscapes"), which differs from the real homepage title ("Workspaces"). control: path: /nonexistent-xyz-123 status: 200 content_type: text/html result: soft-404 shell endpoints: - path: /.well-known/security.txt status: 200 content_type: text/html present: false result: soft-404 shell, not a security.txt - path: /.well-known/openid-configuration status: 200 content_type: text/html present: false result: soft-404 shell, not OIDC metadata - path: /.well-known/oauth-authorization-server status: 200 content_type: text/html present: false result: soft-404 shell, not OAuth AS metadata - path: /.well-known/api-catalog status: 200 content_type: text/html present: false result: soft-404 shell - path: /.well-known/ai-plugin.json status: 200 content_type: text/html present: false result: soft-404 shell - path: /openapi.json status: 200 content_type: text/html present: false result: soft-404 shell, no OpenAPI published - path: /llms.txt status: 200 content_type: text/plain present: true file: ../llms/knotel-llms.txt result: REAL — verbatim llms.txt published, captured as an artifact - path: /robots.txt status: 200 content_type: text/plain present: true result: REAL — robots.txt published - path: /sitemap.xml status: 200 content_type: application/xml present: true result: REAL — 180 URLs, no developer/API/legal pages among them robots: url: https://knotel.com/robots.txt sitemap: https://knotel.com/sitemap.xml disallowed: - /api/* - /admin/* - /_next/* - '/*.json' - /testing/* - /knoteworthy-old ai_user_agents_addressed: - GPTBot - Google-Extended - PerplexityBot - ClaudeBot - CCBot - Applebot-Extended ai_posture: >- All named AI crawlers are explicitly Allowed at the root with the same Disallow set as the generic agent — Knotel permits AI crawling of its public marketing content while blocking its internal /api/* and /admin/* routes.