generated: '2026-07-19'
method: probed
source: live HTTP probes of https://knotel.com
notes: >-
knotel.com is a Next.js application that returns HTTP 200 with the marketing
HTML shell for ANY unmatched path (a soft 404). Status code alone is therefore
meaningless on this host. Every probe below was verified by content-type and by
comparing the response body and
against a known-bad control path
(/nonexistent-xyz-123). The soft-404 shell is identifiable by the title
"Knotel | Flexible Workscapes for the Modern Workplace" (note "Workscapes"),
which differs from the real homepage title ("Workspaces").
control:
path: /nonexistent-xyz-123
status: 200
content_type: text/html
result: soft-404 shell
endpoints:
- path: /.well-known/security.txt
status: 200
content_type: text/html
present: false
result: soft-404 shell, not a security.txt
- path: /.well-known/openid-configuration
status: 200
content_type: text/html
present: false
result: soft-404 shell, not OIDC metadata
- path: /.well-known/oauth-authorization-server
status: 200
content_type: text/html
present: false
result: soft-404 shell, not OAuth AS metadata
- path: /.well-known/api-catalog
status: 200
content_type: text/html
present: false
result: soft-404 shell
- path: /.well-known/ai-plugin.json
status: 200
content_type: text/html
present: false
result: soft-404 shell
- path: /openapi.json
status: 200
content_type: text/html
present: false
result: soft-404 shell, no OpenAPI published
- path: /llms.txt
status: 200
content_type: text/plain
present: true
file: ../llms/knotel-llms.txt
result: REAL — verbatim llms.txt published, captured as an artifact
- path: /robots.txt
status: 200
content_type: text/plain
present: true
result: REAL — robots.txt published
- path: /sitemap.xml
status: 200
content_type: application/xml
present: true
result: REAL — 180 URLs, no developer/API/legal pages among them
robots:
url: https://knotel.com/robots.txt
sitemap: https://knotel.com/sitemap.xml
disallowed:
- /api/*
- /admin/*
- /_next/*
- '/*.json'
- /testing/*
- /knoteworthy-old
ai_user_agents_addressed:
- GPTBot
- Google-Extended
- PerplexityBot
- ClaudeBot
- CCBot
- Applebot-Extended
ai_posture: >-
All named AI crawlers are explicitly Allowed at the root with the same
Disallow set as the generic agent — Knotel permits AI crawling of its public
marketing content while blocking its internal /api/* and /admin/* routes.