I’ve been noodling around with transcription software, and encountered whisper, which does a great job of transcribing. It’s the usual python-based solution, which is pretty good at knocking out a transcription, but it’s a tad on the slow side.
Then, when listening to the Changelog podcast, they were talking to Georgi Gerganov, who’s created whisper.cpp, which is an implementation in C++. I am completely bowled over with not surprise that it’s faster than the original python implementation.
… but… it’s faster by an order of magnitude. While the original python implementation can be done in hours, this can be done in minutes.
I think I’m going to stick to C++ and rust when I need the performance, thanks!