Subject: Re: [AUDITORY] How is the signal of a cochlear implant? [Sound art Project in honor to my deaf sister] From: Nawal El Boghdady <000000eb20164629-dmarc-request@xxxxxxxx> Date: Mon, 8 Mar 2021 07:20:56 +0000--_000_DM6PR08MB58841DF3C2E11793A5A3A76CF3939DM6PR08MB5884namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hi Hugo, People usually use vocoders when trying to emulate the processing of a coch= lear implant, although you can never really capture what an implant user he= ars through their own device. Vocoders only allow us to process the sounds = using similar signal processing techniques as those used in the CI and give= just a rough feeling as to what important aspects of the sound are lost in= the implant processing. So this is something you have to always keep in mi= nd. Now there are many many implementations of vocoders out there in different = programming languages, so if you google =91vocoder cochlear implant=92, you= will find plenty of examples and sample code to get you started. Let me know if you need anything else! Cheers, Nawal Outlook voor iOS<https://aka.ms/o0ukef> downloaden ________________________________ Van: AUDITORY - Research in Auditory Perception <AUDITORY@xxxxxxxx> = namens Hugo Sol=EDs <hugosoli@xxxxxxxx> Verzonden: Sunday, March 7, 2021 2:55:01 PM Aan: AUDITORY@xxxxxxxx <AUDITORY@xxxxxxxx> Onderwerp: How is the signal of a cochlear implant? [Sound art Project in h= onor to my deaf sister] Hi everybody, My names is Hugo and I am a sound artist with some background in computer science. I have a sister that was born fully deaf and she got a cochlear implant when she was 40 years old. She is now 48. The cochlear changed too little in my sister's live and she doesn't describe music as a pleasant experience. I want to create a piece of art where hearing people could hear the real signal that the cochlear implant sends to the brain. I know that the signal is processed and that pulses are generated on each one of the electrodes. However I do not nothing about the details of the transformation. I am capable of write code in Python (ussing the Essentia Library (https://essentia.upf.edu/) in order the emulate the transformation to a signal but I don=B4t know what is the typical process. I could also write the code in SuperCollider (https://supercollider.github.io/) but although it has tons of unit generators it does not have as many extractors of audio descriptors and common phsyacoustic process as Python. I am not an audiologist and I have a lack of the signal processing transformation that happens in a cochlear implant. I do know a lot about digital signal processing though. So I need some basics: 1. Code or libraries in any programming code but ideally in Python that does the emulation. I could write the process but I imagine that many people has already done this and that there is opensource code already written. 2. Basic reference about the process that happens in the cochlear device that could help me to either write the code or tuning the opensource code in order to make my piece. The work will be shown in a exhibition and I am running out of time. So any help would be more than appreciate it. I will be forever thankfull with your support. Warm regards Hugo Sol=EDs --_000_DM6PR08MB58841DF3C2E11793A5A3A76CF3939DM6PR08MB5884namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1= 252"> </head> <body> <div> <div> <div style=3D"direction: ltr;">Hi Hugo,</div> <div style=3D"direction: ltr;">People usually use vocoders when trying to e= mulate the processing of a cochlear implant, although you can never really = capture what an implant user hears through their own device. Vocoders only = allow us to process the sounds using similar signal processing techniques as those used in the CI and give just= a rough feeling as to what important aspects of the sound are lost in the = implant processing. So this is something you have to always keep in mind.</= div> <div style=3D"direction: ltr;">Now there are many many implementations of v= ocoders out there in different programming languages, so if you google =91v= ocoder cochlear implant=92, you will find plenty of examples and sample cod= e to get you started.</div> <div style=3D"direction: ltr;">Let me know if you need anything else!</div> <div><br> </div> <div style=3D"direction: ltr;">Cheers,</div> <div style=3D"direction: ltr;">Nawal<span id=3D"ms-outlook-ios-cursor"></sp= an></div> </div> <div><br> </div> <div class=3D"ms-outlook-ios-signature"><a href=3D"https://aka.ms/o0ukef">O= utlook voor iOS</a> downloaden</div> </div> <hr style=3D"display:inline-block;width:98%" tabindex=3D"-1"> <div id=3D"divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" st= yle=3D"font-size:11pt" color=3D"#000000"><b>Van:</b> AUDITORY - Research in= Auditory Perception <AUDITORY@xxxxxxxx> namens Hugo Sol=EDs &= lt;hugosoli@xxxxxxxx><br> <b>Verzonden:</b> Sunday, March 7, 2021 2:55:01 PM<br> <b>Aan:</b> AUDITORY@xxxxxxxx <AUDITORY@xxxxxxxx><br> <b>Onderwerp:</b> How is the signal of a cochlear implant? [Sound art Proje= ct in honor to my deaf sister]</font> <div> </div> </div> <div class=3D"BodyFragment"><font size=3D"2"><span style=3D"font-size:11pt;= "> <div class=3D"PlainText">Hi everybody,<br> <br> My names is Hugo and I am a sound artist with some background in <br> computer science. I have a sister that was born fully deaf and she got a <b= r> cochlear implant when she was 40 years old. She is now 48. The cochlear <br= > changed too little in my sister's live and she doesn't describe music as <b= r> a pleasant experience.<br> <br> I want to create a piece of art where hearing people could hear the real <b= r> signal that the cochlear implant sends to the brain. I know that the <br> signal is processed and that pulses are generated on each one of the <br> electrodes. However I do not nothing about the details of the <br> transformation.<br> <br> I am capable of write code in Python (ussing the Essentia Library <br> (<a href=3D"https://essentia.upf.edu/">https://essentia.upf.edu/</a>) in or= der the emulate the transformation to a <br> signal but I don=B4t know what is the typical process. I could also write <= br> the code in SuperCollider (<a href=3D"https://supercollider.github.io/">htt= ps://supercollider.github.io/</a>) but <br> although it has tons of unit generators it does not have as many <br> extractors of audio descriptors and common phsyacoustic process as Python.<= br> <br> I am not an audiologist and I have a lack of the signal processing <br> transformation that happens in a cochlear implant. I do know a lot about <b= r> digital signal processing though.<br> <br> So I need some basics:<br> <br> 1. Code or libraries in any programming code but ideally in Python that <br= > does the emulation. I could write the process but I imagine that many <br> people has already done this and that there is opensource code already <br> written.<br> <br> 2. Basic reference about the process that happens in the cochlear device <b= r> that could help me to either write the code or tuning the opensource <br> code in order to make my piece. The work will be shown in a exhibition <br> and I am running out of time. So any help would be more than appreciate it.= <br> <br> I will be forever thankfull with your support.<br> <br> Warm regards<br> <br> Hugo Sol=EDs<br> </div> </span></font></div> </body> </html> --_000_DM6PR08MB58841DF3C2E11793A5A3A76CF3939DM6PR08MB5884namp_--