feat(openwhispr): wire real CUDA support for local transcription
The onnxruntime CUDA execution provider it bundles was hard-failing back to CPU: konishi has the driver but no CUDA toolkit runtime libs. Adds an opt-in cudaSupport toggle (cudaPackages_13, pinned to match the provider's build) and enables it on konishi, the only host with an NVIDIA GPU.
This commit is contained in:
@@ -15,6 +15,7 @@ let
|
||||
};
|
||||
openwhispr = pkgs.callPackage ../../../pkgs/openwhispr/package.nix {
|
||||
inherit (config.custom.aiApps) deviceScaleFactor;
|
||||
cudaSupport = config.custom.aiApps.cudaAcceleration;
|
||||
};
|
||||
in
|
||||
{
|
||||
|
||||
@@ -19,6 +19,14 @@
|
||||
description = "--force-device-scale-factor value for Claude Desktop and T3 Code.";
|
||||
};
|
||||
|
||||
# OpenWhispr's GPU-accelerated local Whisper transcription (NVIDIA hosts
|
||||
# only). Pulls in cudaPackages_13 (multi-GB) when enabled, so opt-in per host.
|
||||
options.custom.aiApps.cudaAcceleration = lib.mkOption {
|
||||
type = lib.types.bool;
|
||||
default = false;
|
||||
description = "Wire OpenWhispr's onnxruntime CUDA execution provider against cudaPackages_13.";
|
||||
};
|
||||
|
||||
# ~/.claude/settings.json stays unmanaged: Claude Code rewrites it itself
|
||||
# (model pins, permission grants, plugin state), so any nix copy drifts within
|
||||
# a session and every `nh home switch` then aborts on the diff.
|
||||
|
||||
Reference in New Issue
Block a user