dsh-verifier-gate
DeepSeek Harness verifier plugin that adds end-of-turn quality gates, LLM assessment tools, best-of-N selection, and UI evidence capture.
Install
$ dsh plugin --profile web add /path/to/dsh-verifier-gatePlugin Overview & Capabilities
AI-assisted organization based on the public repository snapshot. The content must be grounded in source evidence and does not replace compatibility or security verification.
Key Capabilities
- Adds an automatic end-of-turn gate that scores an agent trajectory and can request one repair round when the score is below a configurable threshold.
- Provides verifier_assess, verifier_compare, and verifier_select tools for assessment, pairwise comparison, and best-of-N candidate selection.
- Uses logprob-based expected scores with OpenAI-compatible chat-completions backends that provide logprobs and top_logprobs.
- Supports a Harness backend fallback, which uses literal score letters when logprobs are unavailable.
- Runs configurable mid-turn progress checkpoints and edit-debt reminders.
- Provides ui_snapshot for headless screenshots across configured viewports and color modes, plus browser load-error evidence.
- Includes the graph-verified-coding skill for evidence-oriented coding, gating, comparison, and reporting workflows.
Useful For
- Require evidence-based quality checks before an agent turn closes.
- Ask an agent to assess implementation results against coding, terminal, or general criteria.
- Choose among competing agent-generated solutions using pairwise verifier comparisons.
- Steer long-running coding tasks when progress stalls or declines.
- Capture screenshots and browser errors as evidence for visual or web UI work.
Who It Fits
- DeepSeek Harness users running coding or tool-using agents.
- Teams experimenting with LLM-as-a-verifier evaluation workflows.
- Agent developers who need configurable turn-level quality gates and candidate selection.
Documented Limitations
- The default openai-compatible backend URL is a placeholder; a real backend base URL and model must be configured for verifier calls to succeed.
- Fine-grained logprob scoring requires a direct endpoint with logprobs and top_logprobs; the Harness backend falls back to literal-letter scoring.
- A gate with zero scored criteria closes the turn unverified rather than producing a verified pass.
- Score caching is limited to a single verifier_select call and is not persisted across calls.
- Criteria sets are built in; custom criteria files are not currently loaded.
- Development typechecking requires a DeepSeek Harness checkout adjacent to the repository because dev dependencies use local link paths.
DSH Compatibility
Version-specific runtime evidence collected by DSH Plugin. A missing result means we have not tested that combination yet.
Security Signals
Objective signals discovered from package metadata and source inspection. These are not a guarantee that a plugin is safe.
package.json declares 2 runtime, 9 development, 7 peer, and 0 optional dependencies.
package.json declares DSH bundle metadata.
GitHub reports the repository license as NOASSERTION.
A root package.json was captured and can be inspected by the registry.
Public GitHub source metadata is available for this registry snapshot.
Source & Registry Notes
Public provenance, Registry classification, and the latest source check for this entry, kept separate from runtime verification.
- Source repository
- DevRico003/dsh-verifier-gate
- Registry source
- GitHub · dsh-plugin topic
- Registry classification
- Plugin
- Source checked
- c99acf5 · 2026-09-15
This project is independently indexed from public source information. DSH Plugin is not affiliated with DeepSeek or the plugin author. Always check the author repository before installation.
Repository Activity
- GitHub stars
- 2GitHub stars
- Forks
- 0
- Open issues
- 0
- Last commit
- 2026-08-22
- Last release
- No release detected
Related DSH Plugins
Ranked by overlapping capabilities, use cases, plugin type, categories, and DSH profile.
Persistent multi-model Agent teams and bounded DAG workflows with GUI controls for DeepSeek Harness.
View plugin →Compatibility bridge and host ABI enabling unmodified Pi plugins to run natively on DeepSeek Harness.
View plugin →Generative UI plugin for DeepSeek Harness that renders interactive components and charts inline from assistant responses.
View plugin →The most comprehensive DeepSeek Harness plugin market — refreshed daily, sourced across the Internet, reviewed before publishing.
View plugin →