Though I'd love to have this feature, I also suspect it'll be very, very challenging to get right.
I say that because voice calls bring in the added complexity of the companion needing to know when it's time to stop listening and respond. And you'd also need a very fast means of generating voice clips in order to create the illusion of a voice call happening in real time. In my estimation, this feature would be on a whole different level from the one-way voice messages that are currently already in Nastia.
Sending voice messages back and forth with your companion in a push-to-talk setup might be a much more doable option. Largely because it wouldn't need the part where the AI has to accurately differentiate between a user briefly pausing while talking and a user ending their message, with like 99.5% accuracy. And probably also because it's much more tolerant of longer generation times for voice clips.
dbf
Team•
Apr 5, 2024
Not planned yet but I thiiink that I will implement it eventually. I'll try to understand where to prioritize it.
Spectral-Whispering-Terra832
•
Apr 3, 2024
Hi!
Just to clarify for our boss, Do you mean being able to speak yourself?
There is currently a "kinda" voice system.
When that button is selected (and you have a voice selected in their profile) Each message will be read and spoken to you. In the voice you chose.
But yeah it would be kinda cool if we could do voice to text in reverse if that's your request.
This request was merged into another request
Comments6
Gleaming-Moonlit-Nostalgic203
Apr 8, 2024
Though I'd love to have this feature, I also suspect it'll be very, very challenging to get right.
I say that because voice calls bring in the added complexity of the companion needing to know when it's time to stop listening and respond. And you'd also need a very fast means of generating voice clips in order to create the illusion of a voice call happening in real time. In my estimation, this feature would be on a whole different level from the one-way voice messages that are currently already in Nastia.
Sending voice messages back and forth with your companion in a push-to-talk setup might be a much more doable option. Largely because it wouldn't need the part where the AI has to accurately differentiate between a user briefly pausing while talking and a user ending their message, with like 99.5% accuracy. And probably also because it's much more tolerant of longer generation times for voice clips.
dbf
Apr 5, 2024
Not planned yet but I thiiink that I will implement it eventually. I'll try to understand where to prioritize it.
Spectral-Whispering-Terra832
Apr 3, 2024
Hi!
Just to clarify for our boss, Do you mean being able to speak yourself?
There is currently a "kinda" voice system.
When that button is selected (and you have a voice selected in their profile) Each message will be read and spoken to you. In the voice you chose.
But yeah it would be kinda cool if we could do voice to text in reverse if that's your request.
:)