Problem
dotPilot needs tracked work for local model runtimes so sessions can run without external provider CLIs when appropriate.
Scope
- Track a shared local runtime abstraction plus LLamaSharp, ONNX Runtime, and model-vault capabilities
- Keep local runtimes compatible with the same session and event model used by external providers
Out of scope
- Adding MLXSharp in the first wave
- Designing a separate local-only session model
Planned child issues
- Define the local model runtime abstraction
- Integrate LLamaSharp
- Integrate ONNX Runtime
- Build the model vault, runtime selection, fallback, and compatibility diagnostics
Definition of Done
- The local-runtime issues exist and reference this epic
- The epic explicitly excludes MLXSharp from the first roadmap wave
Verification
- Child issues reference this epic
- The epic keeps local runtimes aligned with the broader session model
Problem
dotPilot needs tracked work for local model runtimes so sessions can run without external provider CLIs when appropriate.
Scope
Out of scope
Planned child issues
Definition of Done
Verification