https://gitlab.synchro.net/main/sbbs/-/commit/3b577bc35cbed5e6200f16ed
Modified Files:
exec/txt_handler.js
Log Message:
txt_handler.js: serve robots.txt as text/plain, not the HTML viewer
The .txt web handler wrapped every *.txt request (including /robots.txt)
in the HTML "LIST"-style viewer, returning Content-Type: text/html. A robots.txt served as HTML is unparseable by crawlers, which then treat
the site as having no robots.txt and crawl everything -- defeating the
file entirely.
Serve robots.txt as raw text/plain (same path as the existing ?raw
output), while still rendering all other *.txt in the HTML viewer.
Co-Authored-By: Claude Opus 4.8 <
noreply@anthropic.com>
---
þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.net