oh-my-knowledge
Evidence-backed evaluation and observability bundle for prompts, RAG, skills, agents, and workflows in DeepSeek Harness.
Install
$ dsh plugin --profile web add oh-my-knowledgePlugin Overview & Capabilities
AI-assisted organization based on the public repository snapshot. The content must be grounded in source evidence and does not replace compatibility or security verification.
Key Capabilities
- Controlled A/B evaluation of prompts, skills, and knowledge artifacts with fixed model baselines
- DeepSeek Harness bundle integration providing in-harness `/omk eval` and `/omk observe` commands
- Task trajectory visualization and log reconstruction via local Studio UI
- Statistical evaluation rigor including Bootstrap CI, Krippendorff alpha, and length-debiasing
- Production knowledge gap signal detection and draft regression sample generation
Useful For
- Evaluating whether an updated prompt, skill, or RAG recipe outperforms the previous version before deployment
- Running controlled knowledge regression tests inside DeepSeek Harness profiles and CI/CD workflows
- Observing task trajectories and tool executions from DeepSeek Harness session persistence
Who It Fits
- Prompt engineers and LLM application developers
- DeepSeek Harness power users maintaining custom skills and agent configurations
- AI evaluation and quality assurance teams
Documented Limitations
- Requires Node.js >= 22 and at least one configured/authenticated runtime or host
- Studio report server is unauthenticated and intended for local or trusted development environments
- Live task following in DSH is offline snapshot-based rather than real-time continuous streaming
DSH Compatibility
Version-specific runtime evidence collected by DSH Plugin. A missing result means we have not tested that combination yet.
Security Signals
Objective signals discovered from package metadata and source inspection. These are not a guarantee that a plugin is safe.
package.json declares 10 runtime, 10 development, 2 peer, and 0 optional dependencies.
package.json declares DSH bundle metadata.
GitHub reports the repository license as MIT.
A root package.json was captured and can be inspected by the registry.
package.json declares a prepare lifecycle script that may run during relevant package installation workflows.
Public GitHub source metadata is available for this registry snapshot.
Source & Registry Notes
Public provenance, Registry classification, and the latest source check for this entry, kept separate from runtime verification.
- Source repository
- lizhiyao/oh-my-knowledge
- Registry source
- GitHub · dsh-plugin topic
- Registry classification
- Plugin Bundle
- Source checked
- 678fc8a · 2026-08-30
This project is independently indexed from public source information. DSH Plugin is not affiliated with DeepSeek or the plugin author. Always check the author repository before installation.
Repository Activity
- GitHub stars
- 18GitHub stars
- Forks
- 2
- Open issues
- 8
- Last commit
- 2026-08-30
- Last release
- 2026-08-24
Related DSH Plugins
Ranked by overlapping capabilities, use cases, plugin type, categories, and DSH profile.
Persistent multi-model Agent teams and bounded DAG workflows with GUI controls for DeepSeek Harness.
View plugin →Connect ChatGPT subscriptions to DeepSeek Harness via OAuth with Codex model access and GPT Image generation.
View plugin →Compatibility bridge and host ABI enabling unmodified Pi plugins to run natively on DeepSeek Harness.
View plugin →Governance-powered AI-agent task execution framework with a DeepSeek Harness plugin integration.
View plugin →