Subject: Re: [AUDITORY] Virtual reality equipment From: "Picinali, Lorenzo" <l.picinali@xxxxxxxx> Date: Wed, 27 Jan 2021 10:47:46 +0000--_000_VI1PR06MB56771B5751403DEE5F58C55EBABB0VI1PR06MB5677eurp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Dear Mila, to echo what Stefania wrote, we also use the HTC Vive pro eye, which allows= us also to measure pupil dilation (this can be interesting for certain typ= es of tests). We use Oculus Rifts, and will start using the Oculus Quest so= on. We do not use the headphones that come with the head-mounted displays, = but we remove them and use the Sennheiser HD600/650 (with a decent amplifie= r, such as RME, MOTU or Focusrite, not the standard computer audio out). We= also have a project which uses iPhones with the head-mounted cases - they = actually work rather well, and you can "pair" them with Bluetooth controlle= rs in order to allow the user to easily interact with the tasks. In terms of software, we do most of the graphics in Unity, using Blender if= needed for the 3D models. For the iPhone option we use Unity as well, or C= #/Swift when possible/suitable. Please forgive me if now I make a bit of adversiting nos: for the audio spa= tialisation we use our own 3D Tune-In Toolkit, which is available here - ht= tps://github.com/3DTune-In/3dti_AudioToolkit/. We normally use it in its "T= est Application" version (standalone), connected with Unity through Open So= und Control (OSC). An example of the functionalities of the Test Application can be found in t= his video (use headphones when listening): https://www.youtube.com/watch?v=3DosJQ0Kxv1P0 and here is a video demonstrating the hearing loss/hearing aid functions https://www.youtube.com/watch?v=3DjtEL__hwmq0 But you could also use it in its VST plugin form, and run it on MaxMSP or o= ther VST hosts. Here you can download all the 3DTI Toolkit releases (Test A= pp, VST, Javascript, etc.) https://github.com/3DTune-In/3dti_AudioToolkit/releases We also have a Unity wrapper for the Toolkit, which allows to use it straig= ht within the Unity environment as an asset. We'll launch v2.0 of the wrapp= er in the next two-three weeks, but if you need anything earlier I'll be ha= ppy to share the older version. I hope this helps Lorenzo -- Dr Lorenzo Picinali Reader in Audio Experience Design Director of Undergraduate Studies Dyson School of Design Engineering Imperial College London Dyson Building Imperial College Road South Kensington, SW7 2DB, London T: 0044 (0)20 7594 8158 E: l.picinali@xxxxxxxx http://www.imperial.ac.uk/people/l.picinali www.imperial.ac.uk/design-engineering-school<http://www.imperial.ac.uk/desi= gn-engineering-school> ________________________________ From: AUDITORY - Research in Auditory Perception <AUDITORY@xxxxxxxx>= on behalf of Stefania Serafin <sts@xxxxxxxx> Sent: 27 January 2021 09:23 To: AUDITORY@xxxxxxxx <AUDITORY@xxxxxxxx> Subject: Re: [AUDITORY] Virtual reality equipment ******************* This email originates from outside Imperial. Do not click on links and atta= chments unless you recognise the sender. If you trust the sender, add them to your safe senders list https://spam.ic= .ac.uk/SpamConsole/Senders.aspx to disable email stamping for this address. ******************* Hi Maria It depends on which kind of experiments you want to conduct. For hardware we use the VIVE pro if eye tracking is also involved, or Oculu= s Quest for more portable and not too computationally expensive solutions. For software we use Unity for the visual side and different audio engines (= STEAM audio, Max=85.). Best Stefania > On 26 Jan 2021, at 19.04, MAR=CDA MILAGROS JER=D3NIMO FUMERO <mjeronimof@xxxxxxxx= USAL.ES> wrote: > > Dear list, > > I am writing to you because I would be interested in conducting auditory = perception tests in virtual reality environments. What type of equipment (h= ardware and software) do you recommend? > > Kind regards, > > Mila > --_000_VI1PR06MB56771B5751403DEE5F58C55EBABB0VI1PR06MB5677eurp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1= 252"> <style type=3D"text/css" style=3D"display:none;"> P {margin-top:0;margin-bo= ttom:0;} </style> </head> <body dir=3D"ltr"> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> Dear Mila,</div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> to echo what Stefania wrote, we also use the HTC Vive pro eye, which allows= us also to measure pupil dilation (this can be interesting for certain typ= es of tests). We use Oculus Rifts, and will start using the Oculus Quest so= on. We do not use the headphones that come with the head-mounted displays, but we remove them and use the S= ennheiser HD600/650 (with a decent amplifier, such as RME, MOTU or Focusrit= e, not the standard computer audio out). We also have a project which uses = iPhones with the head-mounted cases - they actually work rather well, and you can "pair" them with B= luetooth controllers in order to allow the user to easily interact with the= tasks.<br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> In terms of software, we do most of the graphics in Unity, using Blender if= needed for the 3D models. For the iPhone option we use Unity as well, or C= #/Swift when possible/suitable.</div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> Please forgive me if now I make a bit of adversiting nos: for the audio spa= tialisation we use our own 3D Tune-In Toolkit, which is available here - <a href=3D"https://github.com/3DTune-In/3dti_AudioToolkit/" id=3D"LPlnk1453= 99">https://github.com/3DTune-In/3dti_AudioToolkit/</a>. We normally use it= in its "Test Application" version (standalone), connected with U= nity through Open Sound Control (OSC).</div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> An example of the functionalities of the Test Application can be found in t= his video (use headphones when listening): <div><br> </div> <div><a href=3D"https://www.youtube.com/watch?v=3DosJQ0Kxv1P0" id=3D"LPlnk"= >https://www.youtube.com/watch?v=3DosJQ0Kxv1P0</a> <br> </div> <div class=3D"_Entity _EType_OWALinkPreview _EId_OWALinkPreview_1 _EReadonl= y_1"></div> <br> <div>and here is a video demonstrating the hearing loss/hearing aid functio= ns</div> <div><br> </div> <a href=3D"https://www.youtube.com/watch?v=3DjtEL__hwmq0" id=3D"LPlnk">http= s://www.youtube.com/watch?v=3DjtEL__hwmq0</a><br> <div class=3D"_Entity _EType_OWALinkPreview _EId_OWALinkPreview _EReadonly_= 1"></div> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> But you could also use it in its VST plugin form, and run it on MaxMSP or o= ther VST hosts. Here you can download all the 3DTI Toolkit releases (Test A= pp, VST, Javascript, etc.)<br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <a href=3D"https://github.com/3DTune-In/3dti_AudioToolkit/releases" id=3D"L= Plnk">https://github.com/3DTune-In/3dti_AudioToolkit/releases</a><br> </div> <div class=3D"_Entity _EType_OWALinkPreview _EId_OWALinkPreview_2 _EReadonl= y_1"></div> <br> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> We also have a Unity wrapper for the Toolkit, which allows to use it straig= ht within the Unity environment as an asset. We'll launch v2.0 of the wrapp= er in the next two-three weeks, but if you need anything earlier I'll be ha= ppy to share the older version.</div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> I hope this helps</div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> Lorenzo<br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div> <div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size= : 12pt; color: rgb(0, 0, 0);"> <br> </div> <div id=3D"Signature"> <div> <div id=3D"divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; color= :#000000; background-color:#FFFFFF; font-family:Calibri,Arial,Helvetica,san= s-serif"> <div id=3D"divtagdefaultwrapper" style=3D"color:rgb(0,0,0); background-colo= r:rgb(255,255,255); font-family:Calibri,Arial,Helvetica,sans-serif"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"><font style=3D"font-size:10pt"></font><sp= an style=3D"font-size:10pt"></span><span style=3D"font-size:10pt"></span> <div style=3D"font-family:Tahoma"> <div style=3D"font-family:Tahoma"><span style=3D"font-size:10pt"><br> -- <br> Dr Lorenzo Picinali<br> Reader in Audio Experience Design<br> Director of Undergraduate Studies<br> Dyson School of Design Engineering<br> Imperial College London<br> Dyson Building<br> Imperial College Road<br> South Kensington, <span id=3D"ms-rterangepaste-start"></span><span>SW7 2DB<= /span><span id=3D"ms-rterangepaste-end"></span>, London <br> T: 0044 (0)20 7594 8158<br> E: l.picinali@xxxxxxxx<br> <font style=3D"" color=3D"3366FF"><u style=3D""><br> <a href=3D"http://www.imperial.ac.uk/people/l.picinali" target=3D"_blank">h= ttp://www.imperial.ac.uk/people/l.picinali</a></u></font><br> <br> <a href=3D"http://www.imperial.ac.uk/design-engineering-school" target=3D"_= blank">www.imperial.ac.uk/design-engineering-school</a><br> </span></div> </div> <span style=3D"font-size:10pt"></span><span style=3D"font-size:10pt"></span= ><font style=3D"font-size:10pt"></font></div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <div id=3D"appendonsend"></div> <hr style=3D"display:inline-block;width:98%" tabindex=3D"-1"> <div id=3D"divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" st= yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b> AUDITORY - Research i= n Auditory Perception <AUDITORY@xxxxxxxx> on behalf of Stefani= a Serafin <sts@xxxxxxxx><br> <b>Sent:</b> 27 January 2021 09:23<br> <b>To:</b> AUDITORY@xxxxxxxx <AUDITORY@xxxxxxxx><br> <b>Subject:</b> Re: [AUDITORY] Virtual reality equipment</font> <div> </div> </div> <div class=3D"BodyFragment"><font size=3D"2"><span style=3D"font-size:11pt;= "> <div class=3D"PlainText"><br> *******************<br> This email originates from outside Imperial. Do not click on links and atta= chments unless you recognise the sender. <br> If you trust the sender, add them to your safe senders list <a href=3D"http= s://spam.ic.ac.uk/SpamConsole/Senders.aspx"> https://spam.ic.ac.uk/SpamConsole/Senders.aspx</a> to disable email stampin= g for this address.<br> *******************<br> Hi Maria<br> It depends on which kind of experiments you want to conduct.<br> For hardware we use the VIVE pro if eye tracking is also involved, or Oculu= s Quest for more portable and not too computationally expensive solutions.<= br> For software we use Unity for the visual side and different audio engines (= STEAM audio, Max=85.).<br> <br> Best<br> Stefania <br> <br> <br> > On 26 Jan 2021, at 19.04, MAR=CDA MILAGROS JER=D3NIMO FUMERO <mjero= nimof@xxxxxxxx> wrote:<br> > <br> > Dear list,<br> > <br> > I am writing to you because I would be interested in conducting audito= ry perception tests in virtual reality environments. What type of equipment= (hardware and software) do you recommend?<br> > <br> > Kind regards,<br> > <br> > Mila<br> > <br> <br> </div> </span></font></div> </body> </html> --_000_VI1PR06MB56771B5751403DEE5F58C55EBABB0VI1PR06MB5677eurp_--