Subject: Re: [AUDITORY] Visual references in sound localisation From: Les Bernstein <lbernstein@xxxxxxxx> Date: Sun, 25 Feb 2018 12:51:30 -0500 List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>--------------00636809BF4F2D39F5D729B8 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by edgeum2.it.mcgill.ca id w1PHpXnk004217 <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dutf= -8"> </head> <body text=3D"#000000" bgcolor=3D"#FFFFFF"> <font size=3D"-1"><font face=3D"Verdana">I believe the question was about what would occur under the circumstances described and the nature of visual influences.=C2=A0 It's also important to recogni= ze that the visual <i>modality </i>is not dominant, <i>per se</i>.=C2= =A0 Rather, it depends upon the reliability (indexed by variance) of the transduced information within each modality.=C2=A0 One can ma= nipulate those variances and humans will generally weight the information within each modality in a near-optimal fashion (inverse to the variance).=C2=A0 Think Alais and Burr.</font></font><br> <br> <div class=3D"moz-cite-prefix">On 2/25/2018 12:50 AM, Kent Walker wrote:<br> </div> <blockquote type=3D"cite" cite=3D"mid:1662_1519538765_5A92524D_1662_167_15_15ebd22d-5ccf-4cd1-8768-= 962ef9abb4b4@xxxxxxxx"> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Du= tf-8"> <div dir=3D"auto">When doing localization tests best practice is to use visually-opaque acoustically-transparent curtains. However, it's also best practice to provided respondents with visual references which they can use to respond.=C2=A0 <div dir=3D"auto"><br> </div> <div dir=3D"auto">Depending on the perceptual task, providing a reference stimulus with known location (visual & acoustic) can be extremely useful.=C2=A0</div> <div dir=3D"auto"><br> </div> <div dir=3D"auto">In audio engineering, things get more interesting when visual and auditory cues are in different spatial locations.=C2=A0</div> <div dir=3D"auto"><br> </div> <div dir=3D"auto">For example, in film sound mixing dialogue is pretty much always mixed to the centre channel only, even when actors are visible at the left and right of the projected image. There are technical limitations that prevent using phantom sources to match the sound to the=C2=A0 viewed location= of the actors. The visual-auditory mismatch is generally not annoying or troublesome and we perceive the dialogue as eminating from the visual location on the screen - not the physical location of the loudspeaker. In large theatres the physical mismatch between the stimuli can be quite large, routinely 30 feet.</div> <div dir=3D"auto"><br> </div> <div dir=3D"auto">This is because in multimodal perception vision generally dominates (think McGurk effect).</div> </div> <div class=3D"gmail_extra"><br> <div class=3D"gmail_quote">On Feb 24, 2018 22:11, "Engel Alonso-Martinez, Isaac" <a class=3D"moz-txt-link-rfc2396E" href= =3D"mailto:isaac.engel@xxxxxxxx"><isaac.engel@xxxxxxxx>= </a> wrote:<br type=3D"attribution"> <blockquote class=3D"quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div dir=3D"ltr"> <div dir=3D"ltr" style=3D"font-size:12pt;color:rgb( 0 , 0 ,= 0 );font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols'"> <div style=3D"font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols';font-size:16px"> <font size=3D"3" face=3D"Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols" color=3D"black"><s= pan style=3D"font-size:12pt"> <div>Dear all,</div> <div><br> </div> </span></font></div> <div style=3D"font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols';font-size:16px"> <font size=3D"3" face=3D"Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols" color=3D"black"><s= pan style=3D"font-size:12pt"> <div>I am interested in the impact of audible visual references in sound localisation tasks.</d= iv> <div><br> </div> </span></font></div> <div style=3D"font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols';font-size:16px"> <font size=3D"3" face=3D"Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols" color=3D"black"><s= pan style=3D"font-size:12pt"> <div>For instance, let's say that you are presented two different continuous sounds (e.g., speech) coming from sources A and B, which are in different locations. While source A is clearly visible to you, B is invisible and you are asked to estimate its location. Will source A act as a spatial reference, helping you in doing a more accurate estimation, or will it be distracting and make the task more difficult?</di= v> <div><br> </div> </span></font></div> <div style=3D"font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols';font-size:16px"> <font size=3D"3" face=3D"Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols" color=3D"black"><s= pan style=3D"font-size:12pt"> <div>If anyone can point to some literature on this, it would be greatly appreciated.</div> <div><br> </div> </span></font></div> <div style=3D"font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols';font-size:16px"> <font size=3D"3" face=3D"Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols" color=3D"black"><s= pan style=3D"font-size:12pt"> <div>Kind regards,</div> </span></font></div> <div style=3D"font-family:'calibri' , 'helvetica' , sans-serif , 'emojifont' , 'apple color emoji' , 'segoe ui emoji' , 'notocoloremoji' , 'segoe ui symbol' , 'android emoji' , 'emojisymbols';font-size:16px"> <font size=3D"3" face=3D"Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols" color=3D"black"><s= pan style=3D"font-size:12pt"> <div>Isaac Engel</div> </span></font></div> </div> </div> </blockquote> </div> <br> </div> </blockquote> <br> <br> <div class=3D"moz-signature">-- <br> <meta http-equiv=3D"content-type" content=3D"text/html; charset=3Du= tf-8"> <title></title> <b><span style=3D"font-size:10.0pt;font-family:"Arial",sans-se= rif; mso-fareast-font-family:"Times New Roman \;color\:\#002048"">Leslie R. Bernstein, Ph.D. </span></b>= <b><span style=3D"font-size:10.0pt;font-family:"Arial",sans-serif; mso-fareast-font-family:"Times New Roman \;color\:\#585858"">| </span></b><span style=3D"font-size:10.0pt;font-family:"Arial",sans-serif;mso-fa= reast-font-family:"Times New Roman \;color\:\#585858"">Professor</span><span style=3D"mso-fareast-font-family: "Times New Roman""><o= :p></o:p></span><span style=3D"font-size:10.0pt;font-family:"Arial",sans-serif; mso-fareast-font-family:"Times New Roman \;color\:\#585858""><br> Depts. of Neuroscience and Surgery (Otolaryngology)| UConn School of Medicine </span><br> <span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858""></span><span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858"">263 Farmington Avenue, Farmington, CT 06030-3401</span><br> <span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858""></span><span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858"">Office: 860.679.4622 | Fax: 860.679.2495<br> <br> <img alt=3D"" src=3D"cid:part1.5C99BC99.351CA442@xxxxxxxx" height=3D"48" width=3D"125"><br> </span> </div> </body> </html> --------------00636809BF4F2D39F5D729B8 Content-Type: image/png; name="uconnhealth_stacked_blue_email.png" Content-ID: <part1.5C99BC99.351CA442@xxxxxxxx> Content-Disposition: inline; filename="uconnhealth_stacked_blue_email.png" Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAAH0AAAAwCAMAAAALmIWlAAAAGXRFWHRTb2Z0d2FyZQBBZG9i ZSBJbWFnZVJlYWR5ccllPAAAADNQTFRFKzVYHCZM4eLn8PHzpKi30dTbaG+IlZqrs7fDWWB8 O0Nkd32UwsXPSlJwhoufDRhA////A68jmAAAABF0Uk5T/////////////////////wAlrZli AAACYklEQVR42uzY22KDIAwAUC7e6gjw/187gUC4OetaupflaTXKWSuBKNMuJptC+QMCP20a uPHBQCubBWU46K24uB7NfZ58ZqaMP8D8AEBHtT/goXnB8WPwBf8r1WYUXWxUOZobHcJXIMcf ONclmE4s0lrRzYBIOjvTjX5WV6YbP2ZQJ6TWjfiAbuYzHW7p+xpuolQrP83sjQ5nupnu6Lqa J92MbnSznulcfkBHpNXNY6y+c0JKnWX1eFeflQt5qcNESKnrQMrf6LSAXeiWkEoXdOU4nZBK xzPnoTohtW5ZZyK8W09Io6tYjyP1iDS6XbAeh815S0irS6zHUfXuB0Ok1S3W41AdEWh1/Nb7 UD1bWytd0LY4ThdnerYbBJ1taT5XBmy4J8mNnWagp5fbba6HeiTdneK6vNgoFj0EhyO4eSZT 6AlpdNXoNzqYi94GbIU0eqhHp3d5drRf4heZUo9Iq8vYptup6VB37H6m/W6m0hFpdaxH3/yK 9cHpVq5Zy59n2GMV/QxPGdV9NElPE9njyOozsfWWKq6j7bLuw97KPBnM/mX86//6n+tH/yLK P7AUXcyd80Lx53WnspB47ty5qKND1gLockfIFzHR7srpQ7X0+6GgHPNFXedPyaN1CPFli71z +ZBeTxbcI2RXxwOQj/lW/Ui610Z6gA4a32WRrssXYbO76V/Zy6FLnZVj/qCnqGcdZE1DeFKc ntWrMV/RZXCh7B/fpF/+8tQQx6J74y9/Oeuyrm75+Jyf8oKWH9CL1SYNJtJ91HTOAD2fdjPN 9UcsumwmDNYXqvPtOLa9pH8LMACnoV0siZAyOAAAAABJRU5ErkJggg== --------------00636809BF4F2D39F5D729B8--