← DeepSeek Harness Plugins
DeepSeek Harness PluginManifest Valid

oh-my-knowledge

Evidence-backed evaluation, observability, and knowledge benchmarking toolkit with native DeepSeek Harness support.

VisionUI & ProductivityTerminal & TUIDeveloper ToolsSecurity & PolicySkills & WorkflowsRemote Execution
23GitHub Stars4ForksUpdated2026-09-29

Install

$ dsh plugin --profile web add oh-my-knowledge

Plugin Overview & Capabilities

AI-assisted organization based on the public repository snapshot. The content must be grounded in source evidence and does not replace compatibility or security verification.

source-grounded
OMK (Oh My Knowledge) provides evaluation and observability workflows for prompts, RAG pipelines, skills, agents, and workflows. It integrates with DeepSeek Harness via Cordis configuration patches, enabling commands such as /omk eval and /omk observe to assess and compare knowledge artifacts directly within harness sessions.

Key Capabilities

  • Run controlled evaluations and benchmark knowledge artifacts directly within DeepSeek Harness
  • Inspect task trajectories, execution logs, and source evidence via Studio and observe commands
  • Extract and retain reviewable knowledge items from execution traces and work logs
  • Verify task acceptance and file modifications with independent verifiers
  • Compare skill versions (control vs. treatment) with automated statistical scoring and decision metrics

Useful For

  • Evaluating prompts, RAG, and agent skills before adopting or updating changes in production
  • Observing task executions and generating evidence-backed reports from model interactions
  • Running local task acceptance testing to verify AI-generated code and configuration changes
  • Reviewing candidate knowledge from agent logs and creating evaluation benchmarks

Who It Fits

  • AI engineers and prompt engineers
  • Developers building and testing agent workflows on DeepSeek Harness
  • Teams requiring controlled evaluations and regression tests for LLM skills

Documented Limitations

  • Designed primarily for local trusted environments; custom assertions and local tasks execute local code without strict sandbox isolation
  • Observation in DSH currently reads snapshots of completed sessions rather than live-following running sessions
  • Requires Node.js 22 or higher and configured executor authentication

DSH Compatibility

Version-specific runtime evidence collected by DSH Plugin. A missing result means we have not tested that combination yet.

Not tested yetNo runtime compatibility tests have been published yet.

Security Signals

Objective signals discovered from package metadata and source inspection. These are not a guarantee that a plugin is safe.

Dependency Counts

package.json declares 15 runtime, 15 development, 2 peer, and 0 optional dependencies.

info
Dsh Bundle Declared

package.json declares DSH bundle metadata.

info
License Declared

GitHub reports the repository license as MIT.

info
Package Manifest Available

A root package.json was captured and can be inspected by the registry.

info
Prepare Script Detected

package.json declares a prepare lifecycle script that may run during relevant package installation workflows.

info
Source Available

Public GitHub source metadata is available for this registry snapshot.

info

Source & Registry Notes

Public provenance, Registry classification, and the latest source check for this entry, kept separate from runtime verification.

Source repository
lizhiyao/oh-my-knowledge
Registry source
GitHub · dsh-plugin topic
Registry classification
Plugin Bundle
Source checked
cf350f5 · 2026-10-07

This project is independently indexed from public source information. DSH Plugin is not affiliated with DeepSeek or the plugin author. Always check the author repository before installation.

Repository Activity

GitHub stars
23GitHub stars
Forks
4
Open issues
4
Last commit
2026-09-29
Last release
2026-08-24
For maintainers

Maintaining this plugin?

This listing is generated from public repository data. If you maintain this project, you can review the information and share this listing with your users if you find it useful.

Add to README
Listed on DSHPlugin.app