In this study, we used a very simple method from the speech synthesis community to reconstruct natural, intelligible speech from intra-op ECoG in IFG, pre-motor and motor cortex.pic.twitter.com/ZTeseh4Y51
U tweetove putem weba ili aplikacija drugih proizvođača možete dodati podatke o lokaciji, kao što su grad ili točna lokacija. Povijest lokacija tweetova uvijek možete izbrisati. Saznajte više
In this study, we used a very simple method from the speech synthesis community to reconstruct natural, intelligible speech from intra-op ECoG in IFG, pre-motor and motor cortex.pic.twitter.com/ZTeseh4Y51
Our approach is based on Unit Selection, where the best fitting unit of speech is just concatenated to the output. We determine the best fitting unit of speech by comparing the cosine similarity of high-gamma activity. This video illustrates the approach: https://www.youtube.com/watch?v=GDsb99rDDgo …pic.twitter.com/7D1eSoTec6
This simple and fast approach reconstructs very high quality audio using the patient's own voice. You can listen to a few examples in the supplementary material.pic.twitter.com/HorVv3RtI4
The approach used also allows us to run the analysis with the three regions individually. Each of them performed above chance level, but M1 clearly provided most information for the decoding processes.pic.twitter.com/CJTgvf8QpE
We also asked volunteers to perform a listening test and 66.7% of the reconstructed words could be identified correctly in a forced-choice test with 4 options.pic.twitter.com/SQm18pDVni
What I like best about this paper is that this super simple pattern matching approach is able to produce high-quality audio, while being fast enough for real-time processing at the same time. It was great fun working with everyone involved in this project. Thanks!
Congrats you all! I'm looking forward to reading it.
What would this look like for non- verbal kids.... Is their brain activity similar to neurotypical? Just curious
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.