825e070ed9
Some checks failed
CI/CD / go-lint (push) Has been skipped
CI/CD / python-lint (push) Has been skipped
CI/CD / nodejs-lint (push) Has been skipped
CI/CD / test-go-ai-compliance (push) Failing after 47s
CI/CD / test-python-backend-compliance (push) Successful in 33s
CI/CD / test-python-document-crawler (push) Successful in 24s
CI/CD / test-python-dsms-gateway (push) Successful in 18s
CI/CD / validate-canonical-controls (push) Successful in 11s
CI/CD / Deploy (push) Has been skipped
Implements the full Multi-Layer Control Architecture for migrating ~25,000 Rich Controls into atomic, deduplicated Master Controls with full traceability. Architecture: Legal Source → Obligation → Control Pattern → Master Control → Customer Instance New services: - ObligationExtractor: 3-tier extraction (exact → embedding → LLM) - PatternMatcher: 2-tier matching (keyword + embedding + domain-bonus) - ControlComposer: Pattern + Obligation → Master Control - PipelineAdapter: Pipeline integration + Migration Passes 1-5 - DecompositionPass: Pass 0a/0b — Rich Control → atomic Controls - CrosswalkRoutes: 15 API endpoints under /v1/canonical/ New DB schema: - Migration 060: obligation_extractions, control_patterns, crosswalk_matrix - Migration 061: obligation_candidates, parent_control_uuid tracking Pattern Library: 50 YAML patterns (30 core + 20 IT-security) Go SDK: Pattern loader with YAML validation and indexing Documentation: MkDocs updated with full architecture overview 500 Python tests passing across all components. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
50 lines
2.2 KiB
SQL
50 lines
2.2 KiB
SQL
-- Migration 061: Obligation Candidates + Decomposition Tracking
|
|
-- Supports Pass 0a (Obligation Extraction from Rich Controls) and
|
|
-- Pass 0b (Atomic Control Composition).
|
|
--
|
|
-- Part of the Multi-Layer Control Architecture — Decomposition Pass.
|
|
|
|
-- =============================================================================
|
|
-- 1. Obligation Candidates
|
|
-- Individual normative obligations extracted from Rich Controls (Pass 0a).
|
|
-- =============================================================================
|
|
|
|
CREATE TABLE IF NOT EXISTS obligation_candidates (
|
|
id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
|
|
parent_control_uuid UUID NOT NULL REFERENCES canonical_controls(id),
|
|
candidate_id VARCHAR(30) NOT NULL,
|
|
obligation_text TEXT NOT NULL,
|
|
action VARCHAR(500),
|
|
object TEXT,
|
|
condition TEXT,
|
|
normative_strength VARCHAR(20) DEFAULT 'must'
|
|
CHECK (normative_strength IN ('must', 'should', 'may')),
|
|
is_test_obligation BOOLEAN DEFAULT FALSE,
|
|
is_reporting_obligation BOOLEAN DEFAULT FALSE,
|
|
extraction_confidence NUMERIC(3,2) DEFAULT 0.0
|
|
CHECK (extraction_confidence >= 0 AND extraction_confidence <= 1),
|
|
quality_flags JSONB DEFAULT '{}',
|
|
release_state VARCHAR(30) DEFAULT 'extracted'
|
|
CHECK (release_state IN ('extracted', 'validated', 'rejected', 'composed')),
|
|
created_at TIMESTAMPTZ DEFAULT NOW()
|
|
);
|
|
|
|
CREATE INDEX IF NOT EXISTS idx_oc_parent ON obligation_candidates(parent_control_uuid);
|
|
CREATE INDEX IF NOT EXISTS idx_oc_state ON obligation_candidates(release_state);
|
|
CREATE INDEX IF NOT EXISTS idx_oc_candidate ON obligation_candidates(candidate_id);
|
|
|
|
COMMENT ON TABLE obligation_candidates IS
|
|
'Individual normative obligations extracted from Rich Controls via Pass 0a decomposition';
|
|
|
|
-- =============================================================================
|
|
-- 2. Extend canonical_controls for decomposition tracking
|
|
-- =============================================================================
|
|
|
|
ALTER TABLE canonical_controls
|
|
ADD COLUMN IF NOT EXISTS parent_control_uuid UUID REFERENCES canonical_controls(id);
|
|
|
|
ALTER TABLE canonical_controls
|
|
ADD COLUMN IF NOT EXISTS decomposition_method VARCHAR(30);
|
|
|
|
CREATE INDEX IF NOT EXISTS idx_cc_parent ON canonical_controls(parent_control_uuid);
|