Status Report 2026 10 13 - MatthewFeroz/heval GitHub Wiki
End-of-Sprint-1 status report
Sprint 1: September 30 through October 13, 2026. Reporting period: October 6 through October 13. Author: Matthew Feroz. Prepared October 14 from the repository and validation records. This is a new snapshot; the October 6 report is unchanged.
Overall status: AMBER
The public release is integrated and CI passes, but Sprint 1 did not finish all acceptance and documentation work. Recovery/cancellation validation is complete. Fresh-account onboarding, the complete hosted report-sharing browser check, and the reproducibility example/release checklist carry into Sprint 2. There is no evidence of a blocking implementation failure; the risk is completing and recording acceptance across the hosted app and installed worker.
Since the last report, public release #14 merged on October 7 with Clerk sign-in, the no-model worker check, recovery fixes and report-access tests. Release #15 added proxy restrictions/accounting, turn/request reporting and Harbor 0.24. Public main is dd69e2b. Its CI passed. Source integration and CI do not establish live Clerk acceptance or an npm/worker upgrade.
Feature status
| Major feature | Started | Design | Development | Testing | Integrated |
|---|---|---|---|---|---|
| Worker setup, pairing and no-model check | Yes | Complete | Complete | Automated checks pass; fresh-account hosted acceptance pending | Public source |
| Evaluation configuration and monitoring | Yes | Complete | Complete | UI/connected checks pass; hosted first-run acceptance pending | Public source |
| Reconnect, cancellation and partial results | Yes | Complete | Complete | Real local worker recovery/cleanup tests and browser checks pass | Public source; #10 complete |
| Private reports, Studio drafts and published revisions | Yes | Complete | Complete | Backend/export checks pass; complete real-role browser acceptance pending | Public source |
| Hosted sign-in through Clerk | Yes | Complete | Complete | Contract checks pass; live account/session acceptance pending | Public source; deployment acceptance unverified |
| Turn/request reporting and evaluation proxy | Yes | Complete | Complete | Local regressions and public CI pass | Public source |
| Reproducibility example and release checklist | Yes | Partial | Incomplete documentation | Final example/checklist not validated | Incomplete |
At closeout, one of the four committed issues has complete evidence: #10. #9, #11 and #12 remain open. Recovery validation explains #10's checks and limits. Sprint 2 has explicit acceptance tasks for the remaining work; implementation is not counted as completed acceptance.
Resource utilization
Matthew Feroz is the sole project owner/developer. During the prior week, work integrated the reviewed public releases, hardened the evaluation proxy, added turn/request and comparison-statistics reporting, and updated Harbor/Bun pins. Development was assisted by coding agents; the public PRs record the model/harness disclosures. Repository history supports these deliverables, but no reliable actual-hours log is available.
For October 14 through October 20, the priority is fresh-account Oracle onboarding and owner/editor/viewer/anonymous report acceptance, followed by installed-worker compatibility checks. The following week consolidates the reproducibility example, release checklist and updated prototypes. Sprint 2 commits 28 estimated hours plus 4 contingency hours across two weeks. These are estimates, not claimed time spent.
Team activities
| Date | Purpose and participants | Outcome and follow-up |
|---|---|---|
| Oct 6-7 | Public release review/integration; Matthew Feroz with coding-agent assistance recorded in PR #14 | First-run, recovery, report-access and Clerk changes merged; CI passed. Live account acceptance remains. |
| Oct 7-8 | Evaluation tooling release; Matthew Feroz with coding-agent assistance recorded in PR #15 | Proxy hardening, turn/request data and Harbor 0.24 merged; CI passed. Installed-package compatibility must be checked separately. |
| Oct 14 closeout | Repository/evidence audit and next-sprint planning; Matthew Feroz with Codex assistance | #10 qualifies for closure. Remaining acceptance is tracked in Sprint 2; no additional human team meeting is claimed. |
Changes and major decisions
| Change | Reason | Impact |
|---|---|---|
| Private fixes transferred into public source | Reviewed functionality was ready for public integration | Public history excludes private study evidence; production acceptance remains separate. |
| Harbor 0.24 and Bun 1.4.2 source pins | Keep the evaluation runtime and CI consistent | Source-built workers and the existing npm CLI may need different compatible Harbor versions; Sprint 2 verifies this boundary. |
| Restricted model/vendor routes and shared estimated-spend gate | Evaluation agents must use the intended route and preserve usage through stream failures | Better control and accounting. In-flight requests or missing usage can still exceed an estimated budget. |
| Three Sprint 1 acceptance/documentation items carry forward | Required evidence was incomplete at the sprint deadline | Overall status changes from GREEN to AMBER. Sprint 2 runs October 14-27; no scope expansion into paid studies, deployment or package publication. |