coral-pi-rest-server VS ButtFish

That said, you can always look at something like https://coral.ai/products/accelerator/ to help with the performance you need.

Should only be ~$60 https://coral.ai/products/accelerator/

The Coral USB accelerator might be of interest if you want to do some light ML with a low power budget.

However, a pi doesn't have the strength to run something like Llama.cpp, of course, so I've been considering using something like the Coral USB Accelerator (https://coral.ai/products/accelerator). As I've been learning more about it, it seems to be very geared towards TensorFlow Lite models. But whisper.cpp and Llama.cpp use ggml models.

Recently found this thing, though I haven't found a use case for me.

for the curious

If you aren't aware someone else created a project on github called "ButtFish" as well. While the whole page is great his Venn Diagram is the best part.

-Worlds best chess player lost to a weaker opponent, suspected cheating -People speculate how he could have cheated, buttplug vibrations synced to a chess AI was thrown out there -Some madlad decided that this needed to exist and made it https://github.com/RonSijm/ButtFish -Now getting coverage and reactions from world class chess players (Hikaru)

This will get you part of the way there. https://github.com/RonSijm/ButtFish