failed to transcribe cuBLAS failed with status CUBLAS_STATUS_NOT_SUPPORTED

[piperino11]

I tried on this system:
Ubuntu 20

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

Nvida H100

but I get this error:

skynet.modules.stt.streaming_whisper.state ERROR: Participant 9c428b99: failed to transcribe cuBLAS failed with status CUBLAS_STATUS_NOT_SUPPORTED.

[rpurdel]

Hi @piperino11,

It would look like you are using a VM. Try building a Docker image following the instructions here and run it as a container.

I think it's also worth mentioning that we did not test it on H100s. Can you send one over for testing :) ?

Facci sapere com'è andata.