Status Report 2026 10 13 - MatthewFeroz/heval GitHub Wiki

End-of-Sprint-1 status report

Sprint 1: September 30 through October 13, 2026. Reporting period: October 6 through October 13. Author: Matthew Feroz. Prepared October 14 from the repository and validation records. This is a new snapshot; the October 6 report is unchanged.

Overall status: AMBER

The public release is integrated and CI passes, but Sprint 1 did not finish all acceptance and documentation work. Recovery/cancellation validation is complete. Fresh-account onboarding, the complete hosted report-sharing browser check, and the reproducibility example/release checklist carry into Sprint 2. There is no evidence of a blocking implementation failure; the risk is completing and recording acceptance across the hosted app and installed worker.

Since the last report, public release #14 merged on October 7 with Clerk sign-in, the no-model worker check, recovery fixes and report-access tests. Release #15 added proxy restrictions/accounting, turn/request reporting and Harbor 0.24. Public main is dd69e2b. Its CI passed. Source integration and CI do not establish live Clerk acceptance or an npm/worker upgrade.

Feature status

Major feature Started Design Development Testing Integrated
Worker setup, pairing and no-model check Yes Complete Complete Automated checks pass; fresh-account hosted acceptance pending Public source
Evaluation configuration and monitoring Yes Complete Complete UI/connected checks pass; hosted first-run acceptance pending Public source
Reconnect, cancellation and partial results Yes Complete Complete Real local worker recovery/cleanup tests and browser checks pass Public source; #10 complete
Private reports, Studio drafts and published revisions Yes Complete Complete Backend/export checks pass; complete real-role browser acceptance pending Public source
Hosted sign-in through Clerk Yes Complete Complete Contract checks pass; live account/session acceptance pending Public source; deployment acceptance unverified
Turn/request reporting and evaluation proxy Yes Complete Complete Local regressions and public CI pass Public source
Reproducibility example and release checklist Yes Partial Incomplete documentation Final example/checklist not validated Incomplete

At closeout, one of the four committed issues has complete evidence: #10. #9, #11 and #12 remain open. Recovery validation explains #10's checks and limits. Sprint 2 has explicit acceptance tasks for the remaining work; implementation is not counted as completed acceptance.

Resource utilization

Matthew Feroz is the sole project owner/developer. During the prior week, work integrated the reviewed public releases, hardened the evaluation proxy, added turn/request and comparison-statistics reporting, and updated Harbor/Bun pins. Development was assisted by coding agents; the public PRs record the model/harness disclosures. Repository history supports these deliverables, but no reliable actual-hours log is available.

For October 14 through October 20, the priority is fresh-account Oracle onboarding and owner/editor/viewer/anonymous report acceptance, followed by installed-worker compatibility checks. The following week consolidates the reproducibility example, release checklist and updated prototypes. Sprint 2 commits 28 estimated hours plus 4 contingency hours across two weeks. These are estimates, not claimed time spent.

Team activities

Date Purpose and participants Outcome and follow-up
Oct 6-7 Public release review/integration; Matthew Feroz with coding-agent assistance recorded in PR #14 First-run, recovery, report-access and Clerk changes merged; CI passed. Live account acceptance remains.
Oct 7-8 Evaluation tooling release; Matthew Feroz with coding-agent assistance recorded in PR #15 Proxy hardening, turn/request data and Harbor 0.24 merged; CI passed. Installed-package compatibility must be checked separately.
Oct 14 closeout Repository/evidence audit and next-sprint planning; Matthew Feroz with Codex assistance #10 qualifies for closure. Remaining acceptance is tracked in Sprint 2; no additional human team meeting is claimed.

Changes and major decisions

Change Reason Impact
Private fixes transferred into public source Reviewed functionality was ready for public integration Public history excludes private study evidence; production acceptance remains separate.
Harbor 0.24 and Bun 1.4.2 source pins Keep the evaluation runtime and CI consistent Source-built workers and the existing npm CLI may need different compatible Harbor versions; Sprint 2 verifies this boundary.
Restricted model/vendor routes and shared estimated-spend gate Evaluation agents must use the intended route and preserve usage through stream failures Better control and accounting. In-flight requests or missing usage can still exceed an estimated budget.
Three Sprint 1 acceptance/documentation items carry forward Required evidence was incomplete at the sprint deadline Overall status changes from GREEN to AMBER. Sprint 2 runs October 14-27; no scope expansion into paid studies, deployment or package publication.