SEMANTIC DIRECTORY · plugin-directory-semantic-v3-19
Model & Agent Quality Evaluation
以受控实验和统计证据评估模型、提示词、RAG 或智能体配置，包括基准测试、A/B、回归、盲测、漂移检测、连通性诊断和发布治理；不承担日常运行遥测。
Leaf membership
25 plugins
@percepteye/agent-flywheel@percepteye/agent-flywheelCatalog AnalyzedClose the loop on your OpenClaw or DeepSeek Harness agent: record what your tools actually did — ok, failed or unknown — claim graded rollouts in training mode, and report them back. Never alters a tool result; set PERCEPTEYE_AGENT_MODE=production for a sCompatibilityDSH 0.1.6-alpha.2 · webDependency audit0 reported in bounded auditArtifact0.1.2Evidence updated2026-09-26Public signals0 downloadsbenchMauricioPerera/benchCatalog AnalyzedDSH plugin from MauricioPerera/benchCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals0 starsdeepseekharnessevalsuyoumo/deepseekharnessevalCatalog AnalyzedDSH plugin from suyoumo/deepseekharnessevalCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals5 starsdeepsiper-enthea8b-is/deepsiper-entheaCatalog AnalyzedSovereign, agent-driven LLM evaluation harness forked from deepseek-harness (dsh) — Cordis plugin architecture, EntheAI backends, and multi-model benchmarkingCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals1 starsdsh-agent-evolutionFriendsHL/dsh-agent-evolutionCatalog AnalyzedPreset-composed Agent experiments and evolution primitives for DeepSeek HarnessCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals0 starsdsh-agent-evolvejonah791/dsh-agent-evolveCatalog Analyzed跨代自评估进化Plugin：配置仓库（Version化资源+锚点链）、热重载（.agent-presets 运行时应用/回滚）、子智能体白纸继承配置跑 modeltest 评测、账本（分数/轨迹/失败模式）。受益主体为宿主 agent 本体。CompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals1 starsdsh-bench1105623876/dsh-benchCatalog Analyzed一个用于做模型对照实验的DeepSeek HarnessPluginCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals1 starsdsh-blind-arenachanger-changer/dsh-blind-arenaCatalog AnalyzedA blind, fair, local DSH Web arena: same task, isolated worktrees, shared verification, judge before reveal.CompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals2 starsdsh-design-qadsh-design-qaCatalog AnalyzedDesign-fidelity QA for text-only models: a `deepseek_vision` tool borrows an eye from any OpenAI-compatible vision route, so the model can judge whether an implementation matches its mock — shipped with the benchmark behind that judgement (four fixtures, 23 injected defects, raw transcripts) and the questioning discipline it depends on.CompatibilityDSH 0.1.6-alpha.2 · webDependency audit0 reported in bounded auditArtifact0.1.4Evidence updated2026-09-19Public signals44 stars · 607 downloadsdsh-gray-testLiLiLi-Zi/dsh-gray-testCatalog Analyzeddsh gray-model detection plugin — launch N concurrent sessions, stream reasoning chains, auto-classify gray models (I'm+ing > Let me×5), normal models (Let me≥3), and abnormal models (no features). Supports standard/PTC/minimal/cordis presets.CompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals1 starsdsh-harbor-evolutiondsh-harbor-evolutionCatalog AnalyzedDeepSeek Harness plugin and Skill for Harbor Candidate and Historical Session evaluation workflows.CompatibilityDSH 0.1.6-alpha.2 · webDependency audit0 reported in bounded auditArtifact0.9.8Evidence updated2026-09-25Public signals2972 downloadsdsh-livebench-paneldsh-livebench-panelCatalog AnalyzedDSH web plugin: a LiveBench tab in the Trajectory view (right of 对话/轨迹). Run LiveBench evaluations against every model configured in the DeepSeek Harness — pick provider/model, category, task, release and question range from dropdowns, watch progress, andCompatibilityDSH 0.1.6-alpha.2 · webDependency audit0 reported in bounded auditArtifact0.2.33Evidence updated2026-09-26Public signals4181 downloadsdsh-livebench-rankingsaddie-ace/dsh-livebench-rankingsCatalog AnalyzedLiveBench leaderboard for DSH — discovers the release the official site currently publishes, then reads its CSV and category JSON, and renders model rankings in an isolated same-origin iframe opened from a button beside the composer. Search, organization / open-weight / reasoning filters, per-category sorting, task-level detail, up to four models side by side, CSV export; refreshes every 60 s by default (configurable 30–3600) and caches only to the plugin's own .cache/rankings.json.CompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals0 starsdsh-model-deploylhwwxy/dsh-model-deployCatalog AnalyzedLLM model selection & deployment analysis tool for DeepSeek Harness: deployability, VRAM, TTFT, latency, throughput and power for 38 models × 20 GPUs/NPUsCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals0 starsdsh-models-radardsh-models-radarCatalog AnalyzedDisplays CodexRadar model capability benchmarks in a Settings page and shows the selected session model's DeepSWE score beside the composer.CompatibilityDSH 0.1.6-alpha.2 · webDependency audit0 reported in bounded auditArtifact0.1.23Evidence updated2026-09-21Public signals2 stars · 2411 downloadsdsh-provider-probeWanbinyu/dsh-provider-probeCatalog AnalyzedManual provider connectivity and latency checks for DeepSeek HarnessCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals1 starsdsh-purgeYuJunZhiXue/dsh-purgeCatalog AnalyzedAdds a Settings card to edit prompt-inject.md, manage AGENTS.md or CLAUDE.md rule sets, check for plugin updates, and apply or restore reversible local package updates.CompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals1380 starsdsh-research-labHarzva/dsh-research-labCatalog AnalyzedDSH-native multi-runtime baseline, ablation, and reproducible evaluation control planeCompatibilityDSH 0.1.6-alpha.2 · webDependency auditNot testedArtifactUnresolvedEvidence updated2026-09-27Public signals0 stars
Categories are public semantic index facts, not a final recommendation. Compatibility, permissions, and source evidence remain separate.