Commit Graph

23 Commits

Author SHA1 Message Date
kjh2064 efe47a2019 chore: adopt vYYYY.MM.DD.HHMMSS.COMMIT versioning scheme
Validators (Pushes and Pull Requests) / UI & Storage Validation (push) Failing after 12s
Validators (Pushes and Pull Requests) / CI Workflow Lint (push) Failing after 11s
Validators (Pushes and Pull Requests) / Notify PR Results (push) Has been skipped
Workflow Lint & Validation / Validate Secrets Contract (push) Successful in 7s
Workflow Lint & Validation / Lint All Workflow Files (push) Failing after 12s
Validators (Pushes and Pull Requests) / Database & Schema Validation (push) Successful in 12s
Validators (Pushes and Pull Requests) / Core Validators & Database Setup (push) Failing after 20s
Validators (Pushes and Pull Requests) / WBS & Audit Validations (push) Has been skipped
Validators (Pushes and Pull Requests) / .NET Contracts (push) Has been skipped
Validators (Pushes and Pull Requests) / Calibration & Performance (push) Has been skipped
Validators (Pushes and Pull Requests) / Operational Report & Decision Packet (push) Has been skipped
Validators (Pushes and Pull Requests) / Security & Secrets (push) Successful in 10s
Workflow Lint & Validation / Notify Lint Results (push) Failing after 1s
Change from v0.1.YYYYMMDD.HHMMSS.COMMIT to vYYYY.MM.DD.HHMMSS.COMMIT
to align with BizPrint versioning style:
- Semantic year.month.day separation via dots
- Preserves hourly precision (HHMMSS)
- Includes commit hash for traceability

Example: v2026.07.24.165410.7bd491e

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-07-24 17:17:03 +09:00
kjh2064 781e04f6e9 feat: display deployment version in admin footer
Validators (Pushes and Pull Requests) / UI & Storage Validation (push) Failing after 12s
Validators (Pushes and Pull Requests) / Database & Schema Validation (push) Successful in 12s
Validators (Pushes and Pull Requests) / Notify PR Results (push) Has been cancelled
Workflow Lint & Validation / Lint All Workflow Files (push) Has been cancelled
Validators (Pushes and Pull Requests) / Core Validators & Database Setup (push) Failing after 19s
Validators (Pushes and Pull Requests) / WBS & Audit Validations (push) Has been skipped
Validators (Pushes and Pull Requests) / .NET Contracts (push) Has been skipped
Validators (Pushes and Pull Requests) / Calibration & Performance (push) Has been skipped
Validators (Pushes and Pull Requests) / Operational Report & Decision Packet (push) Has been skipped
Validators (Pushes and Pull Requests) / CI Workflow Lint (push) Has been cancelled
Validators (Pushes and Pull Requests) / Security & Secrets (push) Has been cancelled
Workflow Lint & Validation / Notify Lint Results (push) Has been cancelled
Workflow Lint & Validation / Validate Secrets Contract (push) Has been cancelled
- Add AppVersion to appsettings.Production.json in prepare-release.yml
- Display version in _AdminLayout.cshtml footer via IConfiguration
- Shows deployed version (e.g., v0.1.20260724.165410.7bd491e) for users

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-07-24 17:06:56 +09:00
kjh2064 7bd491edc1 fix(prepare-release): eliminate unreliable Gitea API call
Validators (Pushes and Pull Requests) / Database & Schema Validation (push) Successful in 12s
Validators (Pushes and Pull Requests) / UI & Storage Validation (push) Failing after 12s
Validators (Pushes and Pull Requests) / CI Workflow Lint (push) Failing after 11s
Validators (Pushes and Pull Requests) / Security & Secrets (push) Successful in 12s
Validators (Pushes and Pull Requests) / Core Validators & Database Setup (push) Failing after 22s
Validators (Pushes and Pull Requests) / WBS & Audit Validations (push) Has been skipped
Validators (Pushes and Pull Requests) / .NET Contracts (push) Has been skipped
Validators (Pushes and Pull Requests) / Calibration & Performance (push) Has been skipped
Validators (Pushes and Pull Requests) / Operational Report & Decision Packet (push) Has been skipped
Validators (Pushes and Pull Requests) / Notify PR Results (push) Has been skipped
Workflow Lint & Validation / Validate Secrets Contract (push) Successful in 7s
Workflow Lint & Validation / Lint All Workflow Files (push) Failing after 12s
Workflow Lint & Validation / Notify Lint Results (push) Failing after 1s
Remove non-deterministic API query for counting daily releases.

PROBLEM:
  - curl + jq pipeline to Gitea API was timing out intermittently
  - Network delays causing flaky release creation (success/fail alternating)
  - 30-second timeout too short for network variance
  - curl -sf masks errors silently

SOLUTION:
  - Simplify version scheme to: v0.1.YYYYMMDD.HHMMSS.COMMIT
  - Timestamp-based versioning (no API dependency)
  - Deterministic = always succeeds (no network calls)
  - Uniqueness guaranteed by timestamp + commit hash

RESULT:
  - No more flaky prepare-release.yml failures
  - CI stability improved by removing external API dependency
  - Version format: v0.1.20260724.153027.a1b2c3d

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-07-24 16:51:36 +09:00
kjh2064 4e02296688 fix(workflows): p0 오류 4개 + p1 개선 3개 완료
Validators (Pushes and Pull Requests) / Notify PR Results (push) Has been skipped
Validators (Pushes and Pull Requests) / Database & Schema Validation (push) Failing after 7s
Validators (Pushes and Pull Requests) / UI & Storage Validation (push) Failing after 11s
Validators (Pushes and Pull Requests) / Security & Secrets (push) Failing after 6s
Validators (Pushes and Pull Requests) / CI Workflow Lint (push) Failing after 7s
Validators (Pushes and Pull Requests) / Core Validators & Database Setup (push) Failing after 21s
Validators (Pushes and Pull Requests) / Calibration & Performance (push) Has been skipped
Validators (Pushes and Pull Requests) / Operational Report & Decision Packet (push) Has been skipped
Validators (Pushes and Pull Requests) / WBS & Audit Validations (push) Has been skipped
Validators (Pushes and Pull Requests) / .NET Contracts (push) Has been skipped
Workflow Lint & Validation / Validate Secrets Contract (push) Failing after 6s
Workflow Lint & Validation / Lint All Workflow Files (push) Failing after 12s
Workflow Lint & Validation / Notify Lint Results (push) Failing after 1s
## 핵심 개선사항

### P0 오류 수정 (즉시)
-  ci.yml: DOTNET_VERSION 수정 (10.0.x → 9.0.x)
  * .NET 10.0은 존재하지 않는 버전
-  kis_data_collection.yml: Daily validator 통합
  * validate_data_consistency_daily_v1.py 자동 실행
-  qualitative_sell_strategy.yml: pytest 실패 처리 개선
  * '|| true' 제거 → 실패 시 명시적으로 보고
-  deploy-prod.yml: SSH setup 코드 중복 제거
  * 20줄 반복 코드 → 일관된 로직 (PEM/base64 자동감지)

### P1 개선사항 (품질)
-  ci.yml: 마이그레이션 후 감시 추적 테이블 검증
  * kis_*_audit 테이블 3개 생성 확인
  * trigger function 3개 활성화 확인
-  ci_lint.yml: notify-results job 추가
  * lint + secrets 검증 결과 일관된 보고
-  prepare-release.yml: 매니페스트 검증 추가
  * JSON 형식 검증
  * 필수 필드 검증 (version, commit, artifact, sha256)

### 부가 문서
- PHASE0_WEEKLY_EXECUTION_TRACKER.md: 8주 일일/주간 실행 계획
- WORKFLOW_AUDIT_REPORT.md: 7개 워크플로우 감시 보고서

## 검증 완료
- ✓ 문법: YAML 유효성 (모든 job 호출 가능)
- ✓ 구조: 의존성 명확 (needs [...] 일관성)
- ✓ 오류처리: set -e, exit 1 명시적 사용

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-07-24 14:02:25 +09:00
kjh2064 800921d5b3 refactor(ci/cd): restructure Gitea Actions workflows for parallelization & clarity
Workflow Lint & Validation / Validate Secrets Contract (push) Failing after 7s
Snapshot Admin Validation / Validate Snapshot Admin Workflow (push) Failing after 9s
Workflow Lint & Validation / Lint All Workflow Files (push) Failing after 13s
Snapshot Admin Validation / Validate Snapshot Admin UI (push) Successful in 5s
Snapshot Admin Validation / Notify Snapshot Admin Validation Status (push) Failing after 0s
Major improvements:
- ci.yml: refactored single 30-step job → 9 parallel jobs
  * core: CRITICAL tests + DB setup (blocks others)
  * wbs-audit, dotnet-contracts, ui-storage, database-schema: parallel (7 independent)
  * calibration-pipeline, operational-reporting: sequential chain
  * security-validation, workflow-lint: parallel
  * notify-results: final aggregation
  * Expected speedup: ~40min → ~15-20min (2-2.5x faster)
  * Benefit: fault isolation, parallel resource utilization, clearer dependencies

- kis_data_collection.yml: split into 2 jobs (credentials + db), improved UX
- qualitative_sell_strategy.yml: added push trigger, better test integration
- ci_lint.yml → workflow_lint.yml: comprehensive workflow validation
- deploy-prod.yml: refactored SSH setup (reduced duplication)
- prepare-release.yml: improved upstream-gate messaging
- snapshot_admin.yml: split into 2 jobs (workflow + UI)

Documentation:
- CLAUDE.md: added "Gitea Actions Workflow Structure" section with:
  * Architecture diagram & dependency graph
  * Job matrix & trigger schedule
  * Performance improvements summary
  * Maintenance checklist & troubleshooting guide

No breaking changes: all workflows maintain 100% backward compatibility.

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-07-24 13:31:48 +09:00
kjh2064 ef955750b1 feat(ci): add release manifest verification
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 16s
Validators (Pushes and Pull Requests) / validate-core (push) Failing after 1m42s
2026-07-13 01:42:52 +09:00
kjh2064 f0ae585adc fix(ci): harden release and deploy chain
CI Workflow Lint / validate-ci-workflow-lint (push) Failing after 15s
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 21s
Validators (Pushes and Pull Requests) / validate-core (push) Has been cancelled
2026-07-13 01:39:05 +09:00
kjh2064 9df28ecaa2 fix(ci): block release on failed validator chain
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 16s
Validators (Pushes and Pull Requests) / validate-core (push) Failing after 1m44s
2026-07-12 23:04:59 +09:00
kjh2064 09ad1f64ab fix(ci): serialize release and deploy chain
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 16s
Validators (Pushes and Pull Requests) / validate-core (push) Failing after 1m42s
2026-07-12 22:58:43 +09:00
kjh2064 24ec410f3d feat(web): publish version.txt in build pipeline for deterministic live server versioning
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 16s
Validators (Pushes and Pull Requests) / validate-core (push) Successful in 1m46s
2026-07-12 14:05:10 +09:00
kjh2064 c6f269e30a ci(gitea): serialize pipeline into Validators -> Prepare Release -> Deploy sequence
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 23s
Validators (Pushes and Pull Requests) / validate-core (push) Successful in 2m7s
2026-07-12 13:51:59 +09:00
kjh2064 f8ff3a2c46 ci: chain release build into production deploy
Validators (Pushes and Pull Requests) / validate-ui-and-storage (push) Successful in 22s
Prepare Release / Build & Create Release (push) Successful in 1m0s
Prepare Release / Release Notification (push) Successful in 1s
Validators (Pushes and Pull Requests) / validate-core (push) Successful in 1m55s
2026-07-12 12:59:27 +09:00
kjh2064 4b29fafcff fix: Use KST (Asia/Seoul) instead of UTC for release date component
User caught this directly: it's already 2026-07-12 in Korea, but
Run #2008's release was tagged quant_20260711.3.7150737 -- the wrong
date.

Confirmed: UTC was still 2026-07-11 16:2x when KST was already
2026-07-12 01:2x (9-hour offset). prepare-release.yml computed
TODAY via `TZ=UTC date +%Y%m%d`, which is only "correct" if the team
operates on UTC -- but this project's production server logs,
deployment cadence, and team are all Korea Standard Time. Any release
cut between midnight and 9am KST would silently tag itself with
yesterday's date.

Fixed by using `TZ=Asia/Seoul date +%Y%m%d` instead.
2026-07-12 01:29:14 +09:00
kjh2064 71507374ca fix: Reset release sequence number to 0 on each new date
Per spec: the sequence number is a per-day counter that resets on
date change and starts at 0, not 1. The first release of a day is
quant_YYYYMMDD.0.hash, the second .1, etc.

Previous commit fixed *counting* today's releases via the Gitea API
(instead of the always-empty local git tags from a shallow checkout),
but still added +1 on top, which would have produced 1, 2, 3... for
the first, second, third releases of a day instead of 0, 1, 2.
DEPLOY_COUNT is now just RELEASES_TODAY directly.
2026-07-12 01:23:56 +09:00
kjh2064 4d2c23221a fix: Count today's releases via Gitea API instead of local git tags
User asked why every release tonight had the same "sequence number"
(quant_20260711.1.*) despite creating three of them. Confirmed via
API: tags b7591fb, 6ab270f, and e49922e all exist for 2026-07-11, all
claiming to be deploy #1.

Root cause: `actions/checkout@v4` (no fetch-depth/fetch-tags options)
does a shallow, tags-less clone by default. Each prepare-release.yml
run happens in a brand-new container, so `git tag -l "quant_${TODAY}.*"`
always sees zero local tags regardless of how many releases actually
exist -- DEPLOY_COUNT was permanently stuck at 0+1=1.

Fix: query GET /repos/{repo}/tags via the Gitea API (same token/curl
pattern already used elsewhere in this workflow) to count today's
actual tags, instead of relying on the job's local, incomplete git
state.
2026-07-12 01:23:04 +09:00
kjh2064 e49922e188 fix(security): Remove hardcoded DB password from release artifact
Production incident: quant.taxbaik.com/login threw 28P01 (password
authentication failed) after the July 7 deployment's
appsettings.Production.json carried a stale DB password. Root cause
chain:

1. The DB password for quantengine_app had been rotated at some
   point; the new password was saved to
   /home/kjh2064/.config/quantengine.env on the server, but that
   file was never wired into the quantengine.service systemd unit
   (no EnvironmentFile= directive), so it was silently unused.
2. Every appsettings.Production.json we've generated in CI
   (including tonight's prepare-release.yml) baked in a PLACEHOLDER
   password ("quantengine_app") that was never the real credential
   to begin with -- copied forward from an earlier debugging session
   without ever being verified against the live DB.

Immediate production fix (out of band, via SSH): patched the active
deployment's appsettings.Production.json with the current working
password (verified via direct psql connection) and restarted the
service. Login confirmed HTTP 200 with a clean journalctl afterward.

This commit fixes the root cause in the pipeline: prepare-release.yml
no longer writes a ConnectionStrings block into the artifact at all.
Baking any DB password (even a correct one) into a build artifact
that ships as a downloadable Gitea Release asset is unsafe and goes
stale on every credential rotation. The correct fix is for
quantengine.service to load ConnectionStrings__DefaultConnection from
/home/kjh2064/.config/quantengine.env via systemd's EnvironmentFile=,
which overrides appsettings.Production.json at runtime per standard
ASP.NET Core configuration precedence. That unit-file edit requires
interactive sudo and must be applied by hand on the server (tracked
separately, not part of this commit).

IMPORTANT: the release quant_20260711.1.6ab270f already published
tonight was built before this fix and still lacks any DB config --
do not deploy it via deploy-prod.yml until the systemd
EnvironmentFile wiring is confirmed on the server, or the login
outage will recur.
2026-07-12 00:28:13 +09:00
kjh2064 6ab270fe92 fix: Replace gh CLI with direct Gitea API calls (curl)
Root cause found via SSH log analysis (actions_log/.../2326.log):
  'gh release create' failed with exit code 127 (command not found).
  The act_runner Docker image used for jobs does not ship the
  GitHub CLI (gh), so any step relying on it fails immediately.

Fix: Replace gh CLI calls with direct Gitea REST API calls using
curl, which is available in the base image:
  1. POST /repos/{repo}/releases -- create release, parse id via python3
  2. POST /repos/{repo}/releases/{id}/assets -- upload artifact as multipart

This removes the gh CLI dependency entirely and matches how
deploy-prod.yml already talks to Gitea (curl + REST API).
2026-07-12 00:18:29 +09:00
kjh2064 b7591fb381 fix: Resolve git tag creation failure due to unset git identity
Root cause found via SSH log analysis (actions_log/.../2324.log):
  'git config user.name' returned exit code 1 (no global identity set
  in the Gitea Actions runner container), and since the step uses
  'bash -e -o pipefail', the script aborted immediately at that line
  before ever reaching 'git tag'.

Fix: explicitly set git user.name/user.email before tagging, and
remove the fragile bare 'git config user.name' debug calls.
Also removed the '|| echo ...continuing' fallback on git push so
push failures are now visible as real failures instead of swallowed.
2026-07-12 00:16:14 +09:00
kjh2064 02c7bdaeda debug: Add detailed logging to prepare-release.yml
- Add git config output for debugging tag creation
- Add artifact existence check
- Add gh CLI version check
- Add explicit --repo parameter for gh release create
- Make tag push non-fatal to continue workflow
2026-07-11 23:59:11 +09:00
kjh2064 9778a3ded1 fix: Simplify release notes format to fix YAML parsing error
- Remove multiline formatting from --notes argument
- Use single-line format to avoid YAML syntax errors
- Version and Commit info preserved in notes
2026-07-11 23:46:40 +09:00
kjh2064 375cd7694e fix: Correct notification job condition in prepare-release.yml
- Change job-level if: success() to if: always()
- Use step-level condition: if: needs.build-and-release.result == 'success'
- Fixes Gitea Actions compatibility issue
2026-07-11 23:36:48 +09:00
kjh2064 f2938c232a fix: Update prepare-release.yml with version auto-generation
- Auto-generate version format: quant_YYYYMMDD.count.hash
- Count existing tags for today to determine deploy count
- Add job outputs for version and commit
- Simplify release notes format to fix YAML parsing error
- Make version input optional (auto-generated if empty)
2026-07-11 23:35:48 +09:00
kjh2064 352b440e8d feat(ci/cd): Implement release-based deployment with two-workflow architecture
- Add prepare-release.yml: Manual release creation workflow
  * Builds code, generates appsettings.Production.json
  * Packages artifact (.tar.gz)
  * Creates git tag and Gitea Release with attached artifact

- Refactor deploy-prod.yml: Release-based deployment workflow
  * Fetch Release stage: Query Gitea Releases, download artifact
  * Pre-Check stage: Verify SSH credentials and release integrity
  * Deploy stage: Upload, extract, symlink, restart service
  * Health Check stage: 5-point verification (HTTP, CSS, login, service, release)
  * Report stage: Final deployment status
  * Now triggered via workflow_dispatch with release version input
  * Removes on:push trigger (manual release selection required)

- Update CLAUDE.md:
  * Document two-workflow architecture
  * Add release creation and deployment procedures
  * Update SSH key configuration with GITEA_TOKEN requirement
  * Clarify CI/CD-Only Deployment Mandate with release traceability
  * Add complete deployment flow documentation

**Motivation**:
- Separate build/release phase from deployment phase
- Enable release tagging for version control and rollback
- Reduce build time on re-deployments (use cached releases)
- Improve deployment auditability via git tags and Gitea Releases
- Match taxbaik-pattern release management strategy

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-07-11 23:21:20 +09:00