Interesting software for using and testing AI software locally: https://pinokio.computer/ I’ve not yet installed it, but the amount of systems it gathered together is impressive. From ComfyUI to Voice Cloning, and probably very easy to use. This is also source of what is trendy right now and what to seek on HuggingFace.
Ichigo is a local real time voice AI chat on Apache 2.0 license. Some info I found on X:
- WhisperSpeech X Llama 3.1 8B
- Trained on 50K hours of speech (7 languages)
- Continually trained on 45hrs 10x A1000s
- MLS -> WhisperVQ tokens -> Llama 3.1
- Instruction tuned on 1.89M samples
- 70% speech, 20% transcription, 10% text