Benjamin Admin 1784b43d72 feat(audit): Screenshot+Tesseract-OCR Cookie-Extract als Vendor-Quelle C ...

Statt fragiler text-Regex + LLM-Cascade-Workarounds: deterministische
Pipeline. consent-tester macht Full-Page-Screenshot der Cookie-Richtlinie
(akzeptiert Banner, klappt Accordions, brennt Timestamp ein). Backend
laesst Tesseract OCR (deu, PSM 4) drueber + anchor-basierter Parser
extrahiert {name, category, purpose, duration, type} pro Cookie.

VW-Smoke-Test:
- Vorher (parse_flat): 60 cookies / 16 vendors
- Jetzt (Tesseract): 79 cookies / 14 vendor-records (~79% GT-coverage)

Architektur:
- consent-tester: page_screenshot.py + /capture-evidence Endpoint
- backend: cookie_screenshot_ocr.py mit Tesseract-pipeline
- pipeline: nach parse_flat als komplementaere Stufe C
- Dockerfile: tesseract-ocr + deutsches Sprachpaket
- requirements: pytesseract

KEINE Textkorrektur auf Cookie-Namen (awsalb bleibt awsalb).

Timestamp im Screenshot = juristischer Beweis was wir zum Scan-Zeitpunkt
wirklich auf der Site gesehen haben.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-22 23:22:35 +02:00

..

doc_checks

fix(audit): P93+P95 — Reject-Wording erweitert + Vendor-zentrisches Cookie-Format akzeptiert

2026-05-21 12:21:29 +02:00

founding_wizard

feat(founding-wizard): Per-Person IP-Assignment + Prefill + E2E-Tests

2026-05-21 18:49:10 +02:00

__init__.py

…

_banner_serializers.py

feat(cmp): Phase 2 — script blocking + cookie tracking

2026-05-11 22:52:26 +02:00

_company_profile_sql.py

…

agent_pdf_export.py

feat: Phase 6-8 — PDF export, recurring scans, multi-website compare

2026-04-29 15:27:51 +02:00

agent_tools.py

feat: LLM-agnostic Compliance Agent with tool calling

2026-05-10 22:56:09 +02:00

ai_compliance_assistant.py

…

anchor_finder.py

…

assertion_engine.py

…

audit_pdf_generator.py

…

audit_quality_checks.py

feat(audit): Cookie-Compliance-Audit (3-Quellen-Vergleich) + Vendor-Dedup + Block-Parser

2026-05-21 23:36:45 +02:00

audit_session_service.py

…

audit_signoff_service.py

…

auto_risk_updater.py

…

banner_ab_service.py

feat: A/B Testing + Compliance Report PDF (F5 + F8)

2026-05-03 21:42:50 +02:00

banner_admin_service.py

…

banner_analytics_service.py

feat: Vendor-level consent + Consent analytics (F4 + F6)

2026-05-03 20:58:06 +02:00

banner_consent_service.py

feat(cmp): timezone→geo_country mapping + timezone parameter

2026-05-12 14:43:13 +02:00

banner_consistency_checks.py

fix(audit): VW-404-Recovery + P52 LLM-Merge + P51 Banner-UX-Checks

2026-05-21 17:27:55 +02:00

banner_cookie_cross_check.py

feat(tcf-vendors): GVL cache + vendor extraction + VVT mapping

2026-05-12 18:18:50 +02:00

banner_dsr_service.py

feat: Cookie-Banner ↔ Backend Integration (DSR, Retention, Consent Proof)

2026-05-02 19:52:04 +02:00

banner_screenshot_block.py

feat(audit): Phase 1 Quick-Wins (P81 + P85 + P70 + P83) + TCF DELETE/INSERT-Fix

2026-05-22 08:24:46 +02:00

batch_dedup_runner.py

…

benchmark_extractor.py

feat(audit): P107 Branchen-Benchmark-Cockpit fuer Big-4-Demos

2026-05-22 09:23:37 +02:00

benchmark_k_anonymity.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

business_profiler.py

feat(profile+report): P17 — 4 Polish-Items

2026-05-19 12:22:05 +02:00

canonical_control_service.py

fix: ensure JSONB array fields are always arrays in control API

2026-05-02 21:18:10 +02:00

check_replay.py

feat(audit): P106 MC-Audit-Type + P83 BUILD_SHA in Dockerfiles + P80 v2 full

2026-05-22 08:57:02 +02:00

check_snapshot.py

feat(audit-pipeline): P72 MC-Scope-Classifier + P80 Snapshot/Replay-Foundation [migration-approved]

2026-05-21 08:53:31 +02:00

citation_backfill.py

…

company_profile_service.py

…

compliance_agent.py

feat: LLM-agnostic Compliance Agent with tool calling

2026-05-10 22:56:09 +02:00

compliance_audit_log.py

feat(banner): P19 + P20 — Per-Category-Click-Test + Frontend-Drilldown

2026-05-19 14:31:13 +02:00

compliance_pdf_generator.py

feat(licenses): Stufe 2 — auto-attribution footer in compliance PDF

2026-05-21 21:30:02 +02:00

compliance_user_agent.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

consent_diff_for_user.py

feat(audit): Phase 2+3 — P54 + P68 + P69 + P6/P53/P55 + P31 + P80v2

2026-05-22 08:38:08 +02:00

control_composer.py

…

control_dedup.py

…

control_export_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

control_generator.py

…

control_status_machine.py

…

cookie_behavior_validator.py

feat(consent+report): P56-P67 Mercedes-Audit-Cycle (Anti-Audit, Phase G Vendors, Cookie-Behavior-Validator + 5 Mail-Polish-Items) [migration-approved]

2026-05-21 06:28:25 +02:00

cookie_compliance_audit.py

feat(audit): Cookie-Compliance-Audit (3-Quellen-Vergleich) + Vendor-Dedup + Block-Parser

2026-05-21 23:36:45 +02:00

cookie_function_classifier.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

cookie_knowledge_db.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

cookie_knowledge_extended.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

cookie_knowledge.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

cookie_library_mismatch.py

feat(audit): VW-Cookie-Bug-Fix + P101/P102 Cookie-Library-Mismatch-Findings

2026-05-21 15:47:11 +02:00

cookie_link_validator.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

cookie_network_tracer.py

feat(audit): P103+P104+P105 Defeat-Device-Heuristik fuer Cookies

2026-05-22 00:24:07 +02:00

cookie_policy_architecture.py

feat(compliance-check): P10 — Cookie-Policy-Architecture-Detection

2026-05-19 01:01:48 +02:00

cookie_screenshot_ocr.py

feat(audit): Screenshot+Tesseract-OCR Cookie-Extract als Vendor-Quelle C

2026-05-22 23:22:35 +02:00

cookie_table_generator.py

feat: Cookie banner vendors per category + {{COOKIE_TABLE}} generator

2026-05-02 20:06:57 +02:00

cookie_to_vendor_fallback.py

fix(audit): VW-Cookie-Tabelle — Library-Fallback + Pattern-Extract verstaerkt

2026-05-21 18:32:07 +02:00

cookie_value_entropy.py

feat(audit): P103+P104+P105 Defeat-Device-Heuristik fuer Cookies

2026-05-22 00:24:07 +02:00

cookies_table_parser.py

fix(cookies): parse_flat_cookie_text whitespace-tolerant fuer HTTP-fetch

2026-05-22 19:17:21 +02:00

decomposition_pass.py

…

doc_anchor_locator.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

doc_input_warnings.py

feat(audit): Text-Paste-Mode pro Row — Crawler optional umgehen

2026-05-21 18:58:32 +02:00

doc_text_signals.py

feat(audit): P36 Social-Media-Einbindungs-Check

2026-05-21 16:45:12 +02:00

doc_type_classifier.py

feat(audit): Text-Paste-Mode pro Row — Crawler optional umgehen

2026-05-21 18:58:32 +02:00

dse_matcher.py

fix: Add missing service modules required by agent_scan_routes

2026-05-04 23:22:30 +02:00

dse_parser.py

fix: Add missing service modules required by agent_scan_routes

2026-05-04 23:22:30 +02:00

dse_service_extractor.py

fix: Playwright user permission + etracker DSE matching + CMP skip

2026-04-29 19:36:46 +02:00

dsfa_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

dsfa_workflow_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

dsi_document_checker.py

feat: Add 76 Level-2 regex checks for document correctness verification

2026-05-07 12:37:03 +02:00

dsms_client.py

feat(dsms): Stufe 1 — Gap-Analyse Report wird in DSMS archiviert

2026-05-11 23:39:26 +02:00

dsr_art11_service.py

feat: EmailDeliveryService + professional DSR email templates

2026-05-03 23:38:32 +02:00

dsr_export_service.py

fix: DSR export type-cast bug + session rollback on partial failures

2026-05-03 23:15:25 +02:00

dsr_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

dsr_workflow_service.py

feat: Cookie-Banner ↔ Backend Integration (DSR, Retention, Consent Proof)

2026-05-02 19:52:04 +02:00

email_delivery_service.py

feat: EmailDeliveryService + professional DSR email templates

2026-05-03 23:38:32 +02:00

email_template_service.py

…

email_template_version_service.py

…

evidence_service.py

…

export_generator.py

…

finding_action_recipes.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

finding_confidence.py

feat(audit): P82 GF-1-Pager + P87 Konfidenz-Score pro Finding

2026-05-21 16:20:19 +02:00

framework_decomposition.py

…

gf_one_pager.py

feat(audit): A Audit-Transparenz + B Tabellen-Parse + D HTML-Tables aus DOM

2026-05-21 20:21:28 +02:00

incident_service.py

…

incident_workflow_service.py

…

industry_benchmark.py

feat(audit): P86 Branchen-Benchmark + P35/P77/P78 Textsignale

2026-05-21 16:43:15 +02:00

industry_library.py

feat(audit): Phase 2+3 — P54 + P68 + P69 + P6/P53/P55 + P31 + P80v2

2026-05-22 08:38:08 +02:00

intake_extractor.py

fix: derive intake flags from DETECTED SERVICES, not from text content

2026-05-02 08:37:51 +02:00

isms_assessment_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

isms_findings_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

isms_governance_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

isms_readiness_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

jc_avv_decision.py

feat(audit): P71 JC-vs-AVV Entscheidungsbaum

2026-05-21 17:31:37 +02:00

legal_basis_validator.py

fix: Add missing service modules required by agent_scan_routes

2026-05-04 23:22:30 +02:00

legal_document_consent_service.py

…

legal_document_service.py

chore: mypy fixes for routes.py + legal_document_service + control_export_service

2026-04-09 20:04:16 +02:00

license_gate.py

…

llm_cascade.py

fix(scan): TCF SQL column + cascade diagnose-logs

2026-05-22 19:00:27 +02:00

llm_provider.py

…

mail_pdf_export.py

feat(audit): P88 PDF-Export via WeasyPrint

2026-05-21 17:06:48 +02:00

mandatory_content_checker.py

fix: Add missing service modules required by agent_scan_routes

2026-05-04 23:22:30 +02:00

mc_audit_type.py

fix(mc-audit): TOM/AVV case-mismatch + Ausnahmen-Pattern Wortabstand

2026-05-22 11:51:03 +02:00

mc_embedding_matcher.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

mc_scorecard.py

feat(audit): P106 MC-Audit-Type + P83 BUILD_SHA in Dockerfiles + P80 v2 full

2026-05-22 08:57:02 +02:00

mc_solution_generator.py

perf(audit): vendor_llm_extractor + mc_solution_generator nutzen P31 LLM-Cascade

2026-05-22 09:40:11 +02:00

migration_to_banner.py

feat(agent): migrate compliance-check results to banner + documents (M1-M5)

2026-05-17 14:06:28 +02:00

migration_to_document.py

feat(agent): migrate compliance-check results to banner + documents (M1-M5)

2026-05-17 14:06:28 +02:00

normative_patterns.py

…

notfallplan_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

notfallplan_workflow_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

obligation_extractor.py

…

pattern_matcher.py

…

pdf_extractor.py

…

pipeline_adapter.py

…

profile_extractor.py

feat(service-detector): detect 118 services in legal texts (was 20)

2026-05-13 16:00:15 +02:00

rag_client.py

…

rag_document_checker.py

feat(audit): P72 MC-Scope-Filter + P73 MC-Solution-Generator

2026-05-21 17:21:19 +02:00

rag_provenance.py

feat(audit): Phase 1 Quick-Wins (P81 + P85 + P70 + P83) + TCF DELETE/INSERT-Fix

2026-05-22 08:24:46 +02:00

regulation_requirement_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

regulation_scraper.py

…

relevance_filter.py

feat: Phase 0+1 — LLM intake extraction + control relevance filter

2026-04-29 11:36:24 +02:00

report_generator.py

…

reranker.py

…

reverse_audit.py

feat(audit): Phase 2+3 — P54 + P68 + P69 + P6/P53/P55 + P31 + P80v2

2026-05-22 08:38:08 +02:00

run_diff.py

feat(audit): P75 Banner-vs-CMP + P84 Diff-Mode + P74/P96/P97 Doc-Types

2026-05-21 16:38:25 +02:00

screening_service.py

…

section_splitter.py

fix(compliance-check): respect auto-discovery 'not found' verdict; DSB not canonical

2026-05-17 01:53:09 +02:00

seeder.py

…

service_detector.py

feat(service-detector): detect 118 services in legal texts (was 20)

2026-05-13 16:00:15 +02:00

service_registry.py

fix: Add missing service_registry.py to main

2026-05-04 23:34:00 +02:00

similarity_detector.py

…

smtp_sender.py

feat: ZeroClaw compliance agent — document analysis + role assignment + email

2026-04-27 23:28:21 +02:00

source_policy_service.py

…

tcf_encoder_service.py

feat: IAB TCF 2.2 — TC String encoder + purpose mapping + UI

2026-05-04 07:01:37 +02:00

tcf_vendor_authority.py

fix(scan): TCF SQL column + cascade diagnose-logs

2026-05-22 19:00:27 +02:00

tdm_reservation_check.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

tom_service.py

…

training_link_service.py

feat: Academy integration — training gap detection after document approval (F7)

2026-05-03 22:03:25 +02:00

unified_findings_collector.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

unified_findings_store.py

feat(compliance-check): exec-summary + voll-audit + TDM-respect + cookie-KB-extended + saving-scan-funnel

2026-05-18 23:48:34 +02:00

v1_enrichment.py

…

vendor_assessment_cross_check.py

feat(vendor-assessment): AVV/SCC/TOM/Sub-Processor checklists + assessment service

2026-05-12 23:14:54 +02:00

vendor_assessment_report.py

feat(vendor-assessment): Pruefprotokoll + Frontend + Sidebar

2026-05-12 23:24:12 +02:00

vendor_banner_sync.py

feat: Cookie-Banner ↔ Backend Integration (DSR, Retention, Consent Proof)

2026-05-02 19:52:04 +02:00

vendor_classifier.py

fix(vvt): score INTERNAL/GROUP without opt-out/privacy penalty

2026-05-17 13:15:40 +02:00

vendor_compliance_extra_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

vendor_compliance_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

vendor_compliance_sub_service.py

chore: mypy cleanup — comprehensive disable headers for agent-created services

2026-04-10 11:23:43 +02:00

vendor_cost_estimator.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

vendor_extractor.py

feat(consent+report): P56-P67 Mercedes-Audit-Cycle (Anti-Audit, Phase G Vendors, Cookie-Behavior-Validator + 5 Mail-Polish-Items) [migration-approved]

2026-05-21 06:28:25 +02:00

vendor_llm_extractor.py

perf(llm): reduce vendor-extract excerpt 50k → 20k chars

2026-05-22 21:55:23 +02:00

vendor_normalizer.py

feat(audit): Cookie-Compliance-Audit (3-Quellen-Vergleich) + Vendor-Dedup + Block-Parser

2026-05-21 23:36:45 +02:00

vendor_package_cookies.py

feat(audit-mail): P58/P59c/P60b/P61/P62 — Mercedes-Cycle Phase 1 abgeschlossen

2026-05-21 08:01:27 +02:00

vendor_redundancy.py

feat(compliance-check): MC-Classification + Embedding + Vendor-Redundanz + Action-Recipes + Borlabs-Features

2026-05-18 18:30:08 +02:00

vendor_vvt_mapper.py

feat(tcf-vendors): GVL cache + vendor extraction + VVT mapping

2026-05-12 18:18:50 +02:00

vvt_service.py

…

website_compliance_checks.py

fix: false positive findings + restore docs-src + §312k ecommerce filter

2026-05-02 08:26:59 +02:00

website_scanner.py

Merge feat/zeroclaw-compliance-agent into main

2026-05-11 11:44:20 +02:00