 kjh2064
|
258bb17f3c
|
Fix: Unify Outbox Pattern with IOutboxWriter (Architecture Consolidation)
**Issue Found & Resolved:**
- Discovered parallel Outbox/Inbox systems: building_blocks (pre-existing, ModelOperations/SignalEngine using) vs outbox (newly added)
- VIOLATION: IOutboxWriter registered singleton; multiple modules injected and actively using building_blocks.outbox_message
- ShadowRunJob was writing to separate outbox.outbox schema, breaking existing Outbox/Inbox pattern
**Architecture Fix:**
- ShadowRunJob now uses IOutboxWriter (injected) → building_blocks.outbox_message
- Eliminated: custom outbox.outbox insert logic (InsertOutboxEventAsync)
- Eliminated: parallel schema (outbox.outbox DDL migration 0007)
- Result: Single unified Outbox pattern via IOutboxWriter/IInboxStore interfaces
**Implementation:**
- ShadowRunJob: Added IDbConnectionFactory + IOutboxWriter dependencies
- Persist + Event: Single transaction (shadow_run + outbox_message inserted atomically)
- OutboxMessage: EventType="ShadowRunCompleted", SchemaVersion=1
- PayloadHash: SHA256.HashData (per CA1850 rule)
- Fallback: If AddAsync fails, transaction rolls back (no partial success)
**Downstream Consumers:**
- Existing OutboxPollerJob (unchanged): reads building_blocks.outbox_message → inbox_message
- ApprovalQueueConsumer: retains DB insert implementation (ready for Hangfire wiring later)
- AuditLogConsumer: retains Serilog structured logging (compliance audit via logs)
**Cleaned Up:**
- Removed: 0007_CreateOutboxTable.sql (separate schema not needed)
- Removed: ShadowRunOutboxPollerJob (existing OutboxPollerJob handles all events)
- Removed: ShadowRunCompletedInboxConsumerJob, ApprovalQueueInboxConsumerJob, AuditLogInboxConsumerJob (will integrate via existing consumer interfaces)
- Program.cs: Removed all new RecurringJob registrations
**AGENTS.md v16.0 Compliance:**
✓ Architecture: Unified via verified interface pattern (IOutboxWriter)
✓ Necessity: Grounded in existing code (ModelOperations, SignalEngine already using)
✓ Normalization: 3NF writes (atomic transaction)
✓ Idempotent: OutboxMessage deduplication via existing patterns
✓ Traceability: CorrelationId preserved end-to-end
✓ Safety: No partial success (transaction-wrapped)
✓ Debt: Consolidation (zero new parallel systems)
**Tests:** 84/84 passing (0 regressions)
**Next:** Integrate Consumers with Hangfire using unified Outbox pattern.
Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
|
2026-08-02 12:48:04 +09:00 |
|
|
kjh2064
|
fc1abd3ad9
|
Downstream Event Consumers: Shadow Run Completion Notifications
Implements event-driven async notification pattern per AGENTS.md v16.0:
1. Domain Events:
- ShadowRunCompletedEvent: Immutable contract with idempotency key
- Payload: RunId, ModelId, gates (PBO, DSR), metrics, correlation for tracing
2. Consumer Interface:
- IInboxConsumer<TEvent>: Generic, stateless, idempotent handlers
- Safe to retry: same event → same result (deduplication by UNIQUE constraint)
3. Three Consumer Implementations:
- ShadowRunCompletedConsumer: SignalR push (group: model-{modelId})
- ApprovalQueueConsumer: Create approval queue on gate passage
- AuditLogConsumer: Compliance logging (PASS/FAIL with details)
4. Architecture:
- ShadowRunJob (Phase 5) → Outbox event insert (transactional)
- Hangfire OutboxPoller (30s) → Inbox fanout (UNIQUE constraint)
- Hangfire InboxConsumers → Parallel handler execution
- CorrelationId tracking for distributed tracing
5. Idempotency & Safety:
- Outbox: Append-only, immutable events
- Inbox: UNIQUE (outbox_id, consumer_id) prevents duplicates
- Consumer: Stateless, re-playable without side effects
- Retry classification: transient/permanent per Hangfire
Files:
- src/KArtSell.Modules.ModelOperations/ShadowRun/Events/ShadowRunCompletedEvent.cs
- src/KArtSell.Host/Consumers/IInboxConsumer.cs (interface)
- src/KArtSell.Host/Consumers/ShadowRunCompletedConsumer.cs (SignalR)
- src/KArtSell.Host/Consumers/ApprovalQueueConsumer.cs (approval workflow)
- src/KArtSell.Host/Consumers/AuditLogConsumer.cs (compliance logging)
- src/KArtSell.Host/Features/ShadowRun/DOWNSTREAM_CONSUMERS_CONTRACT.md
- tests/KArtSell.Integration.Tests/DownstreamConsumersTests.cs (8 tests)
Test Status: 84/84 PASSING (Integration: 44/44 including 8 new)
AGENTS.md v16.0:
✅ Contract First: Full event schema + consumer patterns defined
✅ Test First: 8 tests for idempotency, deduplication, fanout
✅ Safety: Transactional outbox, idempotent consumers
✅ Traceability: CorrelationId in event, audit logging
✅ Pattern: Event-driven async (Outbox/Inbox)
✅ Maturity: Ready for ShadowRunJob integration
Next: Wire consumer registrations in Program.cs, Hangfire job integration.
Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
|
2026-08-02 12:20:43 +09:00 |
|