It took me a bit research and some attempts but I got a fully self hosted voice assistant running with Home Assistant and Home Assistant Voice (Nabu) and it’s actually working well.
Short write up how to get this running if you want to go down that route :)
https://www.screamingatmyscreen.com/notes/home-assistant-voice-and-local-llms/
@mr_rbn I’m testing CPU only and it’s performing decently (AMD Ryzen 5700g). I’ll test a 3060 12GB next week to see what the performance impact is, but I don’t think it’ll be worth allocating resources to it to me.
@fallenhitokiri Thx. Did you try the services from nabu case and if so, can you compare it performance wise?
@mr_rbn I did not, I only ordered the Voice preview edition when I learned that I can fully self host the whole stack. (I’m not using any of the HA cloud offerings)
