nSelf Eval Gate - nself-org/plugins GitHub Wiki
| Field | Value |
|---|---|
| Licence | Free (MIT) |
| Maturity | implemented (maturity levels) |
| Version | 1.2.6 |
| Install | nself plugin install nself-eval-gate |
| Commands |
nself eval: gate
|
| Requirements | nSelf >=1.1.1 |
Eval harness and autonomy-tier gate for nSelf.
nself plugin install nself-eval-gateNo license key required.
Eval harness and autonomy-tier gate for nSelf. Three-mode scoring (exact, semantic via BGE-M3, rubric via LLM-as-judge), recall-quality precision/recall/fact_f1 metrics, CI integration via nself ci eval, and autonomy-tier threshold enforcement.
Category: development. Current version: 1.0.0.
| Env Var | Default | Description |
|---|---|---|
NSELF_EVAL_GATE_DB_URL |
(required) |
- |
NSELF_EVAL_GATE_PORT |
3770 |
- |
NSELF_EVAL_GATE_REDIS_URL |
- |
- |
NSELF_EVAL_GATE_JUDGE_MODEL |
- |
- |
NSELF_EVAL_GATE_JUDGE_TIMEOUT_S |
- |
- |
NSELF_EVAL_GATE_EMBED_TIMEOUT_S |
- |
- |
NSELF_EVAL_GATE_MAX_CONCURRENCY |
- |
- |
NSELF_EVAL_GATE_CACHE_EMBED_TTL_H |
- |
- |
NSELF_EVAL_GATE_CACHE_JUDGE_TTL_H |
- |
- |
NSELF_EVAL_RECALL_K |
- |
- |
NSELF_EVAL_SCHEMA_VERSION |
- |
- |
| Port | Purpose |
|---|---|
| 3770 | nSelf Eval Gate service port |
4 table(s) added to your Postgres database:
np_eval_suitesnp_eval_tasksnp_eval_runsnp_eval_thresholds
POST /eval/run
GET /eval/runs/{id}
GET /eval/suites
POST /eval/validate
GET /eval/thresholds
GET /eval/gate/{tier}
curl http://localhost:3770/eval/runManifest: plugins/nself-eval-gate/plugin.json
- Plugin-Marketplace — full plugin index
- Plugin-Development — write your own plugin
← Home →