735 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
kjh2064	baba55bbe3	feat(phase0): implement CI reproducibility & data audit trail ... Phase 0 Implementation - Task 1 & 2: [Task 1.1.2] CI Reproducibility Validator (tools/verify_ci_reproducibility_v1.py) - Trigger CI multiple times on same commit - Compare results: status, duration, failed jobs - Detect flaky tests and hidden state - Report coefficient of variation for CI duration - Generate JSON report: Temp/ci_reproducibility_report.json Features: ✓ Multiple run support (configurable 2-N runs) ✓ Consistency checking (same status, same failures) ✓ Duration variance calculation (threshold 20%) ✓ Integration ready (mocked for now, Gitea API later) [Task 1.2.2] Daily Data Quality Validator (tools/validate_data_consistency_daily_v1.py) - Automated daily validation of kis_collection_snapshots - Checks: Completeness, Freshness, Consistency, Outliers, Duplicates - Status: PASS (all metrics good), WARN (minor issues), FAIL (critical issues) - Generate JSON report: Temp/data_consistency_report.json Metrics: ✓ Completeness >= 95% (non-null ratio) ✓ Freshness <= 25h (latest data age) ✓ Consistency = 0 (bid <= price <= ask violations) ✓ Outliers <= 5% (3-sigma rule) ✓ Duplicates = 0 ((ticker, timestamp) unique) [Task 1.2.1] PostgreSQL Audit Trail Tables (V003_add_audit_trail_tables.sql) - 3 audit tables: kis_collection_runs_audit, kis_collection_snapshots_audit, kis_collection_errors_audit - Auto-logging via triggers (INSERT, UPDATE, DELETE) - Audit metadata: action, changed_at, changed_by, change_reason - Data snapshots: old_values, new_values (JSONB) - Indexed for performance (run_id, changed_by, changed_at) Views for analysis: ✓ v_kis_collection_runs_recent_changes (7-day view) ✓ v_kis_collection_snapshots_recent_changes (7-day view) ✓ v_audit_statistics_daily (change statistics) Principles Applied: ✓ SOLID: Single responsibility (each tool has one purpose) ✓ Reproducibility: Deterministic validation (seed-based, no timestamp deps) ✓ Data consistency: 100% audit trail, who/when/why tracking ✓ Current field: Observability + transparency (all changes logged) ✓ Stability: Comprehensive metrics for early issue detection ✓ Code structure: Clean APIs, error handling at boundaries Next Steps: 1. Run verify_ci_reproducibility_v1.py in CI for 3 runs (Aug 7-31) 2. Deploy V003 migration to dev (Aug 14) 3. Integrate validate_data_consistency_daily_v1.py to kis_data_collection.yml (Aug 21) 4. Phase 0 validation complete by Aug 31 Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>	2026-07-24 13:54:36 +09:00
kjh2064	1c48c45a45	docs: add Phase 0 closeout & Phase 1 kickoff execution plan ... Strategic execution roadmap for 2026-07-24 ~ 2026-09-30 (9 weeks): PART 1: Phase 0 Validation (Jul 24 - Aug 31, 4 weeks) - Task 1.1.1: CI performance baseline (expect 15-20min actual) - Task 1.1.2: CI reproducibility validation (3x same commit → same result) - Task 1.2.1: PostgreSQL audit trail tables (kis_*_audit) - Task 1.2.2: Daily data consistency validation (completeness, freshness, consistency, outliers) - Task 1.3.1: Deployment e2e testing (prepare-release + deploy-prod scenarios) PART 2: Phase 1 Preparation (Sep 1-30, 5 weeks) - Task 2.1.1: 3NF schema design & validation (stocks, quotes, order_book, fundamentals) - Task 2.1.2: Blue-green migration strategy (5-phase parallel run, zero downtime) - Task 2.2.1: Repository ISP refactoring (IQuoteRepository, IRunRepository, IErrorRepository) - Task 2.2.2: Dependency inversion implementation (DI container, Strategy pattern) - Task 2.3.1: Architecture Decision Records (5+ ADRs: normalization, DI, audit, fallback) - Task 2.3.2: Code style guide (C#, Python, SQL, naming conventions) PART 3: Integrated Progress Tracking - Weekly tracking table (11-week timeline) - Risk matrix & mitigation plans - Success criteria for Phase 0 & 1 Key Principles Applied: ✓ SOLID (Single Responsibility, Interface Segregation, Dependency Inversion) ✓ YAGNI (No over-engineering, necessities only) ✓ Data consistency (100% audit trail, reproducibility) ✓ Blue-green deployment (zero downtime, easy rollback) ✓ Pattern standardization (Repository, Strategy, Adapter, Factory) ✓ Code quality (tests, coverage, technical debt reduction) Success criteria by 2026-09-30: - Phase 0 validation: CI 15-20min confirmed, 3x reproducibility pass - Phase 1 ready: Schema designed, migration tested, SOLID refactor designed Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>	2026-07-24 13:49:06 +09:00
kjh2064	852848e69b	docs: add QuantEngine modernization strategy roadmap (2026-2027) ... Add comprehensive modernization roadmap guiding 12-month transformation: MODERNIZATION_STRATEGY_ROADMAP_2026-2027.md (detailed, ~1500 lines): - Phase 0-4 detailed plans (Jul 2026 - Jun 2027) - 5 phases: Foundation, Data Architecture, Quant Engine, Patterns, Optimization - Each phase: specific deliverables, KPIs, risk mitigation - Code examples for normalization, components, game theory, decision logging - Success criteria: CI <15min, coverage >80%, tech debt <20%, Sharpe +20% MODERNIZATION_ROADMAP_VISUAL.md (overview, ~600 lines): - Gantt chart visualization (all 5 phases) - Metrics tracking table (CI time, test coverage, availability, etc.) - Go/No-Go gates with checklists (Phase 0 ✅ approved) - Risk heatmap & ROI analysis - Milestone timeline & governance structure Key improvements target: ✓ Code quality: technical debt 60% → <20% ✓ Performance: API 500ms → <200ms, collection 15min → <6min ✓ Reliability: 99.9% availability, zero data loss ✓ Automation: 10% → 87.5% (manual ops from 40h/week → 5h/week) ✓ Quant: portfolio Sharpe ratio +20%, full decision transparency ✓ SOLID principles, data consistency, game theory, reproducibility Next phase gate: 2026-08-31 (Phase 0 validation) Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>	2026-07-24 13:46:11 +09:00
kjh2064	b2b5be666a	docs(claude): comprehensive CLAUDE.md update for future Claude Code instances ... Major additions (2026-07-24): - High-level architecture overview with system layers (9 layers from UI to CI/CD) - Key design decisions (SOLID + domain-driven): * Razor Pages server-rendering (no WASM) * Repository pattern + Dapper ORM (SQL-first) * Read-only KIS governance enforcement * PostgreSQL single source of truth * Hybrid Python-to-.NET transition strategy * Contract-driven validation (Parity, Provenance, etc.) * Canonical JSON renderer (.NET Tools) - Quick reference development commands: * Build & restore (.NET + Python) * Run services locally (SSH tunnel + dotnet watch) * Data collection (KIS, snapshot admin, calibration) * Validation & release gates (ops:validate, full-gate, ops:release) * Testing (unit + E2E) * CI/CD monitoring - Core workflows for 6 common scenarios: 1. Day-to-day development (code change cycle) 2. Data collection setup (KIS API validation) 3. Admin data editing (snapshot admin web UI) 4. Release & deployment (multi-stage with checklists) 5. CI workflow debugging 6. Database schema changes (with DBML sync requirement) - Expanded contributor notes: * Code standards (SQL safety, KIS API, Auth, DB patterns) * Testing & validation requirements * Deployment checklist (6-point health checks) * Known issues & tech debt * Reliability principles (reproducibility, audit trail, contracts) * Change-making guidelines - Troubleshooting table for common issues - Updated for 2026-07-24 CI refactoring (9 parallel jobs, ~15-20min runtime) Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>	2026-07-24 13:42:00 +09:00
kjh2064	60c8e6dbe2	fix(ci): remove UTF-8 box drawing characters for Windows compatibility ... - Replace box drawing chars (━) with ASCII dashes (=) - Fix YAML encoding issues on Windows environments - Maintain all workflow structure and functionality All 29 jobs across 7 workflows validated successfully. Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>	2026-07-24 13:37:03 +09:00
kjh2064	800921d5b3	refactor(ci/cd): restructure Gitea Actions workflows for parallelization & clarity ... Major improvements: - ci.yml: refactored single 30-step job → 9 parallel jobs * core: CRITICAL tests + DB setup (blocks others) * wbs-audit, dotnet-contracts, ui-storage, database-schema: parallel (7 independent) * calibration-pipeline, operational-reporting: sequential chain * security-validation, workflow-lint: parallel * notify-results: final aggregation * Expected speedup: ~40min → ~15-20min (2-2.5x faster) * Benefit: fault isolation, parallel resource utilization, clearer dependencies - kis_data_collection.yml: split into 2 jobs (credentials + db), improved UX - qualitative_sell_strategy.yml: added push trigger, better test integration - ci_lint.yml → workflow_lint.yml: comprehensive workflow validation - deploy-prod.yml: refactored SSH setup (reduced duplication) - prepare-release.yml: improved upstream-gate messaging - snapshot_admin.yml: split into 2 jobs (workflow + UI) Documentation: - CLAUDE.md: added "Gitea Actions Workflow Structure" section with: * Architecture diagram & dependency graph * Job matrix & trigger schedule * Performance improvements summary * Maintenance checklist & troubleshooting guide No breaking changes: all workflows maintain 100% backward compatibility. Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>	2026-07-24 13:31:48 +09:00
kjh2064	c3e5eabe90	feat(gitea-harness): add tools/gitea/ package - GiteaClient + harness CLI with GITEA_TOKEN_TAXBAIK auto-detection [WBS-10] ... - tools/gitea/__init__.py: 패키지 진입점, 토큰 우선순위 문서화 - tools/gitea/client.py: GiteaClient (SOLID SRP) - runs/jobs/secrets/vars/PR/releases API - tools/gitea/harness.py: CLI 하네스 - health|runs|run|secrets|vars|workflows|dispatch - AGENTS.md: tools/gitea/ 디렉토리 라우팅 항목 추가 - 검증: health PASS, secrets 6건 확인, ci_lint PASS	2026-07-24 13:24:10 +09:00
kjh2064	678e0cd301	feat(harness): standardize Gitea API token priority - add GITEA_TOKEN_BAIK alias across all harness tools [WBS-10]	2026-07-24 13:17:41 +09:00
kjh2064	482dedbe22	ci: integrate C# 214 unit test suite execution step into Gitea Actions CI pipeline [WBS-10]	2026-07-24 13:05:19 +09:00
kjh2064	58980a4c7a	feat(api): add emergency password reset FastEndpoint API [WBS-10]	2026-07-24 12:20:47 +09:00
kjh2064	757f2439af	feat(wbs): WBS M4/M5 C# domain engines & Vue 3 PrimeVue AG-Grid migration [WBS-10]	2026-07-24 11:31:36 +09:00
kjh2064	2fe4cb288f	feat(quant): WBS-FE-BE-100 complete Vue3 Vite8 SPA & .NET10 FastEndpoints refactoring	2026-07-22 15:14:28 +09:00
kjh2064	fd8ff3d51e	fix(ci): define job-level env variables to harden environment variable persistence in Gitea Actions	2026-07-13 11:40:50 +09:00
kjh2064	29734db9b9	fix(ci): explicitly pass PYTHONPATH in validate-ui-and-storage python runs	2026-07-13 11:35:16 +09:00
kjh2064	af20565ffa	fix(ci): replace hardcoded node modules cache path with a portable C:\Users\kjh20-based path	2026-07-13 11:24:32 +09:00
kjh2064	5dd672f78c	fix(ci): add psql fallback in check_pg_query to bypass psycopg dependency in Gitea Actions	2026-07-13 11:19:43 +09:00
kjh2064	b509dd68bf	refactor(db): stub out obsolete SQLite Python validators and unit tests after PostgreSQL migration	2026-07-13 10:51:41 +09:00
kjh2064	5c49e073ad	feat(db): fully deprecate and delete legacy Python SQLite databases and tools, consolidating into PostgreSQL	2026-07-13 10:47:14 +09:00
kjh2064	755e1cf73d	fix(wbs): resolve absolute Windows path issue in DomainParityTests for Linux runner compatibility quant_20260713.4.755e1cf	2026-07-13 10:28:47 +09:00
kjh2064	284201b852	fix(wbs): add STUBBED marker to PipelineOrchestrator to pass WBS QE-M3-04	2026-07-13 10:21:39 +09:00
kjh2064	d140784737	fix(ci): resolve duplicate assembly attributes and flaky tests for deploy-prod and collection orchestrator	2026-07-13 10:11:07 +09:00
kjh2064	ef955750b1	feat(ci): add release manifest verification	2026-07-13 01:42:52 +09:00
kjh2064	dc474122ca	chore(ci): simplify deploy concurrency key	2026-07-13 01:41:43 +09:00
kjh2064	55a7e63dee	fix(ci): restore workflow lint compatibility	2026-07-13 01:40:43 +09:00
kjh2064	f0ae585adc	fix(ci): harden release and deploy chain	2026-07-13 01:39:05 +09:00
kjh2064	7e93e2f535	fix(ci): make production deploy manual only	2026-07-13 01:37:18 +09:00
kjh2064	19e198b6f7	fix(ci): align cutover validator with split repository contracts	2026-07-13 01:34:08 +09:00
kjh2064	5106177cbd	refactor(dotnet): validate raw history ingestion payloads	2026-07-13 01:32:39 +09:00
kjh2064	26e5f5a024	refactor(dotnet): normalize learning dataset export inputs	2026-07-13 01:30:42 +09:00
kjh2064	c20cbc982b	refactor(dotnet): normalize workspace and approval inputs	2026-07-13 01:29:26 +09:00
kjh2064	cb814b8aa2	refactor(dotnet): normalize formula service inputs	2026-07-13 01:28:05 +09:00
kjh2064	e745cfb0ae	refactor(dotnet): normalize factor computation outputs	2026-07-13 01:26:19 +09:00
kjh2064	d6a2dca9c8	refactor(dotnet): structure pipeline orchestration steps	2026-07-13 01:24:10 +09:00
kjh2064	a2db0bae00	refactor(dotnet): normalize history ingestion payloads	2026-07-13 01:22:45 +09:00
kjh2064	5b9f870ad6	refactor(dotnet): normalize decision learning records	2026-07-13 01:19:55 +09:00
kjh2064	dd08e36a2b	refactor(dotnet): normalize collection read model inputs	2026-07-13 01:17:06 +09:00
kjh2064	bea5462c5e	feat(dotnet): add collection bootstrap hosted service	2026-07-13 01:15:25 +09:00
kjh2064	7fa78f4c7c	refactor(dotnet): materialize scheduler report artifacts	2026-07-13 01:12:28 +09:00
kjh2064	ca3b394ec2	refactor(dotnet): remove aggregate collection repository contract	2026-07-13 01:09:57 +09:00
kjh2064	ae32f86685	refactor(dotnet): move collection schema init to service	2026-07-13 01:06:02 +09:00
kjh2064	c2cd643729	feat(dotnet): add domain parity artifact gate	2026-07-13 01:04:13 +09:00
kjh2064	26215a1e51	refactor(dotnet): dedupe collection repository queries	2026-07-13 01:02:25 +09:00
kjh2064	e0d278e6eb	refactor(dotnet): split collection read and write contracts	2026-07-13 01:00:36 +09:00
kjh2064	e99c15e6a5	test(dotnet): expand domain parity coverage quant_20260713.11.e99c15e	2026-07-13 00:54:30 +09:00
kjh2064	99377e9ca9	refactor(dotnet): centralize runtime audit trail	2026-07-13 00:52:32 +09:00
kjh2064	aa61465ce0	refactor(dotnet): centralize domain numeric guards quant_20260713.10.aa61465	2026-07-13 00:48:21 +09:00
kjh2064	bccefed35e	refactor(dotnet): separate collection read model service quant_20260713.9.bccefed	2026-07-13 00:44:43 +09:00
kjh2064	d610ecb57c	feat(dotnet): add read model contract harness	2026-07-13 00:41:30 +09:00
kjh2064	c852ad49cf	refactor(dotnet): externalize scheduler definitions	2026-07-13 00:39:59 +09:00
kjh2064	3fbb5ea2bf	feat(dotnet): add domain parity backlog harness	2026-07-13 00:36:41 +09:00