Forums Bug Reports Thread

Crawler config files (robots.txt, sitemap) must be tenant-specific

Patrick Bass · May 26 · 22 · 1 Locked
[Major] [High Priority] [Bug Fixed] [Always Reproduces]
🚀 OP May 26, 2026 9:09am

What happens: Under /admin/branding?tab=crawlers, changes to crawler configuration (robots.txt, sitemap settings) may affect the entire system rather than being scoped to the individual tenant.

Expected: Each tenant's crawler files should be isolated. Changes to one tenant's robots.txt or sitemap must not affect any other tenant.

Impact: Tenant isolation violation — one tenant's crawler config changes could break SEO for others.


Patrick Bass
@mobieus

🚀 May 26, 2026 9:16am

Investigation: Crawler files (robots.txt, llms.txt) are already tenant-isolated. Each tenant has its own config/app.ini that stores the seo.robots_txt_body and seo.llms_txt_body overrides. The SeoController reads from the tenant's own config at request time. Changes to one tenant's crawler settings cannot affect any other tenant.

Status: No code change needed. Verified working as designed.


Patrick Bass
@mobieus

Log in or register to reply to this thread.