Benjamin Admin c702260ec1 fix: 5 regex bugs + text extraction scroll + GT update ...

Root cause: Spiegel DSI text was truncated (lazy-loading) — the
rights/DSB/complaints sections at the bottom were never extracted.

Fixes:
1. Text extraction: scroll to bottom before innerText (dsi_discovery.py)
2. V.i.S.d.P.: add "verantwortlicher i.s.v." + "§18 Abs. N MStV" pattern
3. USt-IdNr: add "umsatzsteuer-id" + "DE 212 442 423" (with spaces)
4. Profiler: remove generic "anwalt"/"praxis" (false positive on Spiegel
   "Redaktionsanwalt"), keep only "rechtsanwalt", "kanzlei" etc.
5. Section splitter: auto_fill_from_dsi() fills empty Cookie/Social-Media
   rows from sections found in the DSI text

Ground Truth 06-spiegel.md fully rewritten with verified data from
live website — 3 L1 False Negatives identified (DSB, Beschwerderecht,
Betroffenenrechte all present on website but not in extracted text).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-13 01:20:55 +02:00

..

document_templates

fix(quality): Ruff/CVE/TS-Fixes, 104 neue Tests, Complexity-Refactoring

2026-03-07 19:00:33 +01:00

__init__.py

feat: IAB TCF 2.2 — TC String encoder + purpose mapping + UI

2026-05-04 07:01:37 +02:00

_http_errors.py

refactor(backend/api): extract AuditSession service layer (Step 4 worked example)

2026-04-07 18:16:50 +02:00

agent_analyze_routes.py

fix: derive intake flags from DETECTED SERVICES, not from text content

2026-05-02 08:37:51 +02:00

agent_compare_routes.py

feat: Phase 6-8 — PDF export, recurring scans, multi-website compare

2026-04-29 15:27:51 +02:00

agent_compliance_check_routes.py

fix: 5 regex bugs + text extraction scroll + GT update

2026-05-13 01:20:55 +02:00

agent_doc_check_report.py

feat(compliance-check): profile extraction + scenario classification

2026-05-12 17:34:33 +02:00

agent_doc_check_routes.py

feat(compliance-check): profile extraction + scenario classification

2026-05-12 17:34:33 +02:00

agent_history_routes.py

feat: Phase 6-8 — PDF export, recurring scans, multi-website compare

2026-04-29 15:27:51 +02:00

agent_notification_routes.py

fix: relax email validation for .local domains in agent notify endpoint

2026-04-27 23:39:16 +02:00

agent_recurring_routes.py

feat: Phase 6-8 — PDF export, recurring scans, multi-website compare

2026-04-29 15:27:51 +02:00

agent_scan_helpers.py

fix: resolve all merge conflict markers from feat/zeroclaw-compliance-agent

2026-05-11 12:15:07 +02:00

agent_scan_models.py

fix: resolve all merge conflict markers from feat/zeroclaw-compliance-agent

2026-05-11 12:15:07 +02:00

agent_scan_routes.py

fix: resolve all merge conflict markers from feat/zeroclaw-compliance-agent

2026-05-11 12:15:07 +02:00

ai_routes.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

assertion_routes.py

feat: Anti-Fake-Evidence System (Phase 1-4b)

2026-03-23 17:15:45 +01:00

audit_routes.py

tech-debt: mypy --strict config + integration tests for audit routes

2026-04-07 18:39:40 +02:00

audit_trail_utils.py

feat: Anti-Fake-Evidence System (Phase 1-4b)

2026-03-23 17:15:45 +01:00

banner_ab_routes.py

feat: A/B Testing + Compliance Report PDF (F5 + F8)

2026-05-03 21:42:50 +02:00

banner_analytics_routes.py

feat: Vendor-level consent + Consent analytics (F4 + F6)

2026-05-03 20:58:06 +02:00

banner_routes.py

feat(cmp): timezone→geo_country mapping + timezone parameter

2026-05-12 14:43:13 +02:00

canonical_control_routes.py

fix: fehlende SessionLocal, HTTPException, text Imports in canonical_control_routes

2026-04-25 23:23:08 +02:00

change_request_engine.py

fix(quality): Ruff/CVE/TS-Fixes, 104 neue Tests, Complexity-Refactoring

2026-03-07 19:00:33 +01:00

change_request_routes.py

fix(quality): Ruff/CVE/TS-Fixes, 104 neue Tests, Complexity-Refactoring

2026-03-07 19:00:33 +01:00

company_profile_routes.py

refactor(backend/api): extract CompanyProfileService (Step 4 — file 4 of 18)

2026-04-07 19:47:29 +02:00

compliance_report_routes.py

feat: A/B Testing + Compliance Report PDF (F5 + F8)

2026-05-03 21:42:50 +02:00

compliance_scope_routes.py

fix: migrate deployment from Hetzner to Coolify (#1)

2026-03-13 10:45:35 +00:00

consent_template_routes.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

control_generator_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

crosswalk_routes.py

fix: adapt batch dedup to NULL pattern_id — group by merge_group_hint

2026-03-24 07:24:02 +01:00

crud_factory.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

dashboard_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

db_utils.py

feat(sdk): API-Referenz Frontend + Backend-Konsolidierung (Shared Utilities, CRUD Factory)

2026-03-07 17:07:43 +01:00

document_review_routes.py

feat: Academy integration — training gap detection after document approval (F7)

2026-05-03 22:03:25 +02:00

dsfa_routes.py

fix: EvidenceService Import + get_workflow_service Factory

2026-04-25 23:01:44 +02:00

dsr_routes.py

feat: Art. 11 DSGVO — reject DSR when data subject not identifiable

2026-05-03 23:30:18 +02:00

einwilligungen_routes.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

email_template_routes.py

refactor(backend/api): extract Email Template services (Step 4 — file 10 of 18)

2026-04-08 22:39:19 +02:00

escalation_routes.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

evidence_check_routes.py

feat: add compliance modules 2-5 (dashboard, security templates, process manager, evidence collector)

2026-03-14 21:03:04 +01:00

evidence_routes.py

feat(dsms): Stufe 2+3 — Evidence/TechFile → DSMS + Version Chains + Audit Timeline

2026-05-12 13:55:07 +02:00

extraction_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

generation_routes.py

fix(backend): SQLAlchemy text() fuer alle raw SQL + UI-Verbesserungen

2026-03-08 22:53:29 +01:00

import_routes.py

fix: migrate deployment from Hetzner to Coolify (#1)

2026-03-13 10:45:35 +00:00

incident_routes.py

refactor(backend/api): extract Incident services (Step 4 — file 11 of 18)

2026-04-09 08:35:57 +02:00

isms_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

legal_document_routes.py

refactor(backend/api): extract LegalDocumentConsentService (Step 4 — file 12 of 18)

2026-04-09 08:47:56 +02:00

legal_template_routes.py

feat: DSR Prozessbeschreibungen Art. 15-21 mit Swim-Lane-Diagrammen

2026-04-28 19:25:38 +02:00

llm_audit_routes.py

feat: Anti-Fake-Evidence System (Phase 1-4b)

2026-03-23 17:15:45 +01:00

loeschfristen_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

module_routes.py

fix: Vorbereitung-Module auf 100% — Feld-Fixes, Backend-Persistenz, Endpoints

2026-03-02 12:02:40 +01:00

notfallplan_routes.py

refactor(backend/api): extract Notfallplan schemas + services (Step 4)

2026-04-09 20:10:43 +02:00

obligation_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

org_role_routes.py

feat: Rollenkonzept backend + SOP template (Phase 1-3)

2026-05-03 13:03:38 +02:00

process_task_routes.py

feat: add compliance modules 2-5 (dashboard, security templates, process manager, evidence collector)

2026-03-14 21:03:04 +01:00

project_routes.py

feat: Projekt-Verwaltung verbessern — Archivieren, Loeschen, Wiederherstellen

2026-03-09 17:48:02 +01:00

quality_routes.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

risk_routes.py

feat: Analyse-Module auf 100% — Backend-Wiring, Proxy-Route, DELETE-Endpoints

2026-03-02 12:46:11 +01:00

routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

schemas.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

scraper_routes.py

Initial commit: breakpilot-compliance - Compliance SDK Platform

2026-02-11 23:47:28 +01:00

screening_routes.py

merge: sync with origin/main, take upstream on conflicts

2026-04-16 16:26:48 +02:00

security_backlog_routes.py

refactor: phase 0 guardrails + phase 1 step 2 (models.py split)

2026-04-07 13:18:29 +02:00

source_policy_router.py

refactor(backend/api): extract SourcePolicyService (Step 4 — file 7 of 18)

2026-04-07 19:58:02 +02:00

tcf_routes.py

feat: IAB TCF 2.2 — TC String encoder + purpose mapping + UI

2026-05-04 07:01:37 +02:00

tenant_utils.py

feat(sdk): Multi-Tenancy, Versionierung, Change-Requests, Dokumentengenerierung (Phase 1-6)

2026-03-07 14:12:34 +01:00

tom_mapping_routes.py

feat(tom): audit document, compliance checks, 25 controls, canonical control mapping

2026-03-19 11:56:53 +01:00

tom_routes.py

refactor(backend/api): extract TOMService (Step 4 — file 3 of 18)

2026-04-07 19:42:17 +02:00

vendor_assessment_routes.py

feat(vendor-assessment): Pruefprotokoll + Frontend + Sidebar

2026-05-12 23:24:12 +02:00

vendor_compliance_routes.py

refactor(backend/api): extract vendor compliance services (Step 4)

2026-04-09 20:11:24 +02:00

versioning_utils.py

fix(quality): Ruff/CVE/TS-Fixes, 104 neue Tests, Complexity-Refactoring

2026-03-07 19:00:33 +01:00

vvt_library_routes.py

feat(sdk): VVT master libraries, process templates, Loeschfristen profiling + document

2026-03-19 11:56:25 +01:00

vvt_routes.py

fix: 3 weitere Router-Import-Fehler aus Refactoring

2026-04-25 22:48:04 +02:00

whistleblower_routes.py

feat: Whistleblower backend + Scanner banner-check (last 2 gaps)

2026-05-04 00:22:18 +02:00

wiki_routes.py

feat: Add Compliance Wiki as internal admin knowledge base

2026-03-09 20:01:27 +01:00