Re: [AUDITORY] Measuring perceptual similarity (Pat Savage )


Subject: Re: [AUDITORY] Measuring perceptual similarity
From:    Pat Savage  <patsavagenz@xxxxxxxx>
Date:    Thu, 22 Mar 2018 16:19:25 +0900
List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>

--Apple-Mail=_2B97DDBB-BB9C-4A5C-BED4-96732F86D134 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi Bruno, Sabine, Daniel, and all, Thanks for the clarification. I was indeed wondering how the MUSHRA = approach would deal with multidimensionality, but since several people = had independently suggested it I figured I just needed to read more to = see how it was done=E2=80=A6=20 I think for now we will indeed probably stick with pairwise = dissimilarity ratings to start with with using a small sample of <=3D20 = stimuli, while also thinking about other possible options=E2=80=A6 Cheers, Pat --- Dr. Patrick Savage http://PatrickESavage.com=C2=A0 <http://patrickesavage.com/> > On Mar 21, 2018, at 19:29, Bruno L. Giordano <brungio@xxxxxxxx> = wrote: >=20 > Dear Pat, >=20 > in addition to what pointed out by Daniel, I personally favour = pairwise dissimilarity ratings over sorting unless the number of stimuli = is so large that it is not possible to acquire a full dissimilarity = matrix in one humane experimental session (<=3D ~40 stimuli). As you = might have read, dissimilarity ratings produces estimates of the = distances that are much more reliable (because of the larger number of = stimulus playback involved, I suppose), much less distorted (cf. = binarization of dissimilarities in free sorting and skewed distribution = of hierarchical sorting dissimilarities), and much more indicative of = stimulus features than the more efficient sorting methods. >=20 > Alternative methods come to mind that rely on the placement of stimuli = on a visual space and consider the inter-stimulus distances as estimates = of the perceptual dissimilarities (e.g., Harbke, 2003; Kriegeskorte and = Mur, 2012). Importantly and unsurprisingly, these "direct MDS" methods = bias the perceptual space towards a 2D representation (see Harbke, 2003) = and for this reason are a suboptimal choice for the discovery of = perceptually relevant stimulus features. >=20 > In short, there is no free meal in the behavioural estimation of = distances: if your goal is accuracy, methods that are less efficient = from the time allocation point of view are, in my opinion, still the = best option. >=20 > Best, >=20 > Bruno >=20 > @xxxxxxxx{harbke2003evaluation, > author =3D {C. R. Harbke}, > title =3D {Evaluation of data collection techniques for = multidimensional scaling with large stimulus sets}, > school =3D {Washington State University, Department of Psychology}, > year =3D {2003}, > } >=20 >=20 > @xxxxxxxx{kriegeskorte2012inverse, > title=3D{Inverse MDS: Inferring dissimilarity structure from = multiple item arrangements}, > author=3D{Kriegeskorte, Nikolaus and Mur, Marieke}, > journal=3D{Frontiers in psychology}, > volume=3D{3}, > pages=3D{245}, > year=3D{2012}, > publisher=3D{Frontiers} > } >=20 >=20 > On 20 March 2018 at 12:29, Oberfeld-Twistel, Daniel = <oberfeld@xxxxxxxx <mailto:oberfeld@xxxxxxxx>> wrote: > Thanks for sharing the references! >=20 > =20 >=20 > In my view, MUSHRA cannot be recommended for studying musical = similarity. >=20 > =20 >=20 > The method is designed to identify differences between stimuli on a = defined dimension (which is audio quality in the MUSHRA recommendation, = although this rating method could also be used for evaluating other = perceptual dimensions). >=20 > =20 >=20 > In the MUSHRA method, listeners are NOT asked to rate the similarity = of the stimuli, however. While in principle information about similarity = could be deduced in an indirect manner from the ratings obtained with = MUSHRA (similar mean ratings =3D high similarity), this would require = that you can specify the perceptual dimension on which your stimuli = differ or are similar (say, rhythm, tempo, consonance/dissonance, mood = etc.). >=20 > =20 >=20 > If that is not possible, the other approaches that were suggested like = triadic tests or MDS can be used *without* having to specify which exact = dimension the similarity judgments should refer to, and to identify = structures in the (dis-) similarity ratings. >=20 > =20 >=20 > In addition, I could imagine that the MUSHRA concepts of a = high-quality =E2=80=9Creference=E2=80=9D and a low-quality =E2=80=9Canchor= =E2=80=9D do not easily apply to the experiments you have in mind. >=20 > =20 >=20 > Best >=20 > =20 >=20 > Daniel >=20 > =20 >=20 > --------------------------------- >=20 > Dr. Daniel Oberfeld-Twistel >=20 > Associate Professor >=20 > Johannes Gutenberg - Universitaet Mainz >=20 > Institute of Psychology >=20 > Experimental Psychology >=20 > Wallstrasse 3 = <https://maps.google.com/?q=3DWallstrasse+3+%0D%0A+55122+Mainz+%0D%0A+Germ= any&entry=3Dgmail&source=3Dg> > 55122 Mainz = <https://maps.google.com/?q=3DWallstrasse+3+%0D%0A+55122+Mainz+%0D%0A+Germ= any&entry=3Dgmail&source=3Dg> > Germany = <https://maps.google.com/?q=3DWallstrasse+3+%0D%0A+55122+Mainz+%0D%0A+Germ= any&entry=3Dgmail&source=3Dg> > =20 >=20 > Phone ++49 (0) 6131 39 39274 <tel:+49%206131%203939274> > Fax ++49 (0) 6131 39 39268 <tel:+49%206131%203939268> > http://www.staff.uni-mainz.de/oberfeld/ = <http://www.staff.uni-mainz.de/oberfeld/> > https://www.facebook.com/WahrnehmungUndPsychophysikUniMainz = <https://www.facebook.com/WahrnehmungUndPsychophysikUniMainz> > =20 >=20 > From: AUDITORY - Research in Auditory Perception = <AUDITORY@xxxxxxxx <mailto:AUDITORY@xxxxxxxx>> On Behalf = Of Pat Savage > Sent: Tuesday, March 20, 2018 6:19 AM > To: AUDITORY@xxxxxxxx <mailto:AUDITORY@xxxxxxxx> > Subject: Re: Measuring perceptual similarity >=20 > =20 >=20 > Dear list, >=20 > =20 >=20 > Thanks very much for all of your responses. I=E2=80=99m summarizing = below all the reference recommendations I received.=20 >=20 > =20 >=20 > I still want to more fully read some of these, but so far my = impression is that the Giordano et al. (2011) paper gives a good review = of the benefits and drawbacks of previous methods, but since that was = published MUSHRA seems to have become the standard method for these = types of subjective perceptual similarity ratings. >=20 > =20 >=20 > Please let me know if I seem to be misunderstanding anything here. >=20 > =20 >=20 > Cheers, >=20 > Pat=20 >=20 > -- >=20 > Flexer, A., & Grill, T. (2016). The Problem of Limited Inter-rater = Agreement in Modelling Music Similarity. Journal of New Music Research, = 45(3), 1=E2=80=9313. >=20 > =20 >=20 > P. Susini, S. McAdams, S. Winsberg: A multidimensional technique for = sound quality assessment. Acta Acustica united with Acustica 85 (1999), = 650=E2=80=93656. >=20 > =20 >=20 > Novello, A., McKinney, M. F., & Kohlrausch, A. (2006). Perceptual = evaluation of music similarity. In Proceedings of the 7th International = Conference on Music Information Retrieval. Retrieved from = http://ismir2006.ismir.net/PAPERS/ISMIR06148_Paper.pdf = <http://ismir2006.ismir.net/PAPERS/ISMIR06148_Paper.pdf> > Michaud, P. Y., Meunier, S., Herzog, P., Lavandier, M., & D=E2=80=99Aubi= gny, G. D. (2013). Perceptual evaluation of dissimilarity between = auditory stimuli: An alternative to the paired comparison. Acta Acustica = United with Acustica, 99(5), 806=E2=80=93815. >=20 > =20 >=20 > Wolff, D., & Weyde, T. (2011). Adapting Metrics for Music Similarity = Using Comparative Ratings. 12th International Society for Music = Information Retrieval Conference (ISMIR=E2=80=9911), Proc., (Ismir), = 73=E2=80=9378.=20 >=20 > =20 >=20 > B. L. Giordano, C. Guastavino, E. Murphy, M. Ogg, B. K. Smith, S. = McAdams: Comparison of methods for collecting and modeling dissimilarity = data: Applications to complex sound stimuli. Multivariate Behavioral = Research 46 (2011), 779=E2=80=93811. >=20 > =20 >=20 > P. Y. Michaud, S. Meunier, P. Herzog, M. Lavandier, G. d=E2=80=99Aubigny= : Perceptual evaluation of dissimilarity between auditory stimuli: an = alternative to the paired comparison. Acta Acustica united with = Acustica 99 (2013), 806=E2=80=93815. >=20 > =20 >=20 > Collett, E., Marx, M., Gaillard, P., Roby, B., Fraysse, B., & Deguine, = O. (2016). Categorization of common sounds by cochlear implanted and = normal hearing adults. Hearing Research, 335, 207=E2=80=93219. >=20 > =20 >=20 > International Telecommunication Union. (2015). ITU-R BS.1534-3, Method = for the subjective assessment of intermediate quality level of audio = systems. ITU-R Recommendation, 1534=E2=80=933, 1534=E2=80=933. Retrieved = from = https://www.itu.int/dms_pubrec/itu-r/rec/bs/R-REC-BS.1534-3-201510-I!!PDF-= E.pdf = <https://www.itu.int/dms_pubrec/itu-r/rec/bs/R-REC-BS.1534-3-201510-I!!PDF= -E.pdf> > =20 >=20 > Lavandier, M., Meunier, S., & Herzog, P. (2008). Identification of = some perceptual dimensions underlying loudspeaker dissimilarities. = Journal of the Acoustical Society of America, 123(6), 4186=E2=80=934198.=20= >=20 > =20 >=20 > DZHAFAROV, E. N., & OLDENBURG, H. C. (2006). RECONSTRUCTING DISTANCES = AMONG OBJECTS FROM THEIR DISCRIMINABILITY. Psychometrika, 71(2), = 365=E2=80=93386. >=20 > =20 >=20 > Software:=20 >=20 > =20 >=20 > Various: >=20 > = http://www.ak.tu-berlin.de/menue/digitale_ressourcen/research_tools/whispe= r_listening_test_toolbox_for_matlab/ = <http://www.ak.tu-berlin.de/menue/digitale_ressourcen/research_tools/whisp= er_listening_test_toolbox_for_matlab/> > =20 >=20 > MUSHRA: >=20 > https://github.com/audiolabs/webMUSHRA = <https://github.com/audiolabs/webMUSHRA> > =20 >=20 > Free-sorting: >=20 > http://petra.univ-tlse2.fr/spip.php?rubrique49&lang=3Den = <http://petra.univ-tlse2.fr/spip.php?rubrique49&lang=3Den> > --- > Dr. Patrick Savage > Project Associate Professor >=20 > Faculty of Environment and Information Studies >=20 > Keio University SFC (Shonan Fujisawa Campus) > http://PatrickESavage.com <http://patrickesavage.com/> >=20 >=20 > --=20 > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > Bruno L. Giordano, PhD =E2=80=93 CR1 > Institut de Neurosciences de la Timone (INT) > UMR 7289, CNRS and Aix Marseille Universit=C3=A9 > http://www.int.univ-amu.fr/ <http://www.int.univ-amu.fr/> > Campus sant=C3=A9 Timone > 27, boulevard Jean Moulin > 13385 Marseille cedex 5 > Www: http://www.brunolgiordano.net <http://www.brunolgiordano.net/> --Apple-Mail=_2B97DDBB-BB9C-4A5C-BED4-96732F86D134 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">Hi = Bruno, Sabine, Daniel, and all,<div class=3D""><br class=3D""></div><div = class=3D"">Thanks for the clarification. I was indeed wondering how the = MUSHRA approach would deal with multidimensionality, but since several = people had independently suggested it I figured I just needed to read = more to see how it was done=E2=80=A6&nbsp;</div><div class=3D""><br = class=3D""></div><div class=3D"">I think for now we will indeed probably = stick with pairwise dissimilarity ratings to start with with using a = small sample of &lt;=3D20 stimuli, while also thinking about other = possible options=E2=80=A6</div><div class=3D""><br class=3D""></div><div = class=3D"">Cheers,</div><div class=3D"">Pat</div><div class=3D""><div = class=3D""> <div style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space;" class=3D""><span style=3D"color: = rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: = normal; font-variant-caps: normal; font-weight: normal; letter-spacing: = normal; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = float: none; display: inline !important;" class=3D"">---</span><br = style=3D"color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; = font-style: normal; font-variant-caps: normal; font-weight: normal; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><span style=3D"color: rgb(0, = 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; = display: inline !important;" class=3D"">Dr. Patrick Savage</span><br = style=3D"color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; = font-style: normal; font-variant-caps: normal; font-weight: normal; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px;" class=3D""><div style=3D"color: rgb(0, = 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: normal; letter-spacing: normal; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><a = href=3D"http://PatrickESavage.com" = class=3D"">http://PatrickESavage.com&nbsp;</a></div><div style=3D"color: = rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: = normal; font-variant-caps: normal; font-weight: normal; letter-spacing: = normal; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" = class=3D""><br class=3D""></div><br = class=3D"Apple-interchange-newline"></div><br = class=3D"Apple-interchange-newline"> </div> <div><br class=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">On Mar 21, 2018, at 19:29, Bruno L. Giordano &lt;<a = href=3D"mailto:brungio@xxxxxxxx" class=3D"">brungio@xxxxxxxx</a>&gt; = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""><div = dir=3D"ltr" class=3D"">Dear Pat,<div class=3D""><br class=3D""></div><div = class=3D"">in addition to what pointed out by Daniel, I personally = favour pairwise dissimilarity ratings over sorting unless the number of = stimuli is so large that it is not possible to acquire a full = dissimilarity matrix in one humane experimental session (&lt;=3D ~40 = stimuli). As you might have read, dissimilarity ratings produces = estimates of the distances that are much more reliable (because of the = larger number of stimulus playback involved, I suppose), much less = distorted (cf. binarization of dissimilarities in free sorting and = skewed distribution of hierarchical sorting dissimilarities), and much = more indicative of stimulus features than the more efficient sorting = methods.</div><div class=3D""><br class=3D""></div><div = class=3D"">Alternative methods come to mind that rely on the placement = of stimuli on a visual space and consider the inter-stimulus distances = as estimates of the perceptual dissimilarities (e.g., Harbke, 2003; = Kriegeskorte and Mur, 2012). Importantly and unsurprisingly, these = "direct MDS" methods bias the perceptual space towards a 2D = representation (see Harbke, 2003) and for this reason are a suboptimal = choice for the discovery of perceptually relevant stimulus = features.</div><div class=3D""><br class=3D""></div><div class=3D"">In = short, there is no free meal in the behavioural estimation of distances: = if your goal is accuracy, methods that are less efficient from the time = allocation point of view are, in my opinion, still the best = option.</div><div class=3D""><br class=3D""></div><div = class=3D"">Best,</div><div class=3D""><br class=3D""></div><div = class=3D"">&nbsp; &nbsp; &nbsp;Bruno</div><div class=3D""><br = class=3D""></div><div class=3D""><div = class=3D"">@xxxxxxxx{harbke2003evaluation,</div><div = class=3D"">&nbsp; author =3D {C. R. Harbke},</div><div class=3D"">&nbsp; = title&nbsp; =3D {Evaluation of data collection techniques for = multidimensional scaling with large stimulus sets},</div><div = class=3D"">&nbsp; school =3D {Washington State University, Department of = Psychology},</div><div class=3D"">&nbsp; year&nbsp; &nbsp;=3D = {2003},</div><div class=3D"">}</div></div><div class=3D""><br = class=3D""></div><div class=3D""><br class=3D""></div><div class=3D""><div= class=3D"">@xxxxxxxx{kriegeskorte2012inverse,</div><div class=3D"">&nbsp; = title=3D{Inverse MDS: Inferring dissimilarity structure from multiple = item arrangements},</div><div class=3D"">&nbsp; author=3D{Kriegeskorte, = Nikolaus and Mur, Marieke},</div><div class=3D"">&nbsp; = journal=3D{Frontiers in psychology},</div><div class=3D"">&nbsp; = volume=3D{3},</div><div class=3D"">&nbsp; pages=3D{245},</div><div = class=3D"">&nbsp; year=3D{2012},</div><div class=3D"">&nbsp; = publisher=3D{Frontiers}</div><div class=3D"">}</div></div><div = class=3D""><br class=3D""></div></div><div class=3D"gmail_extra"><br = class=3D""><div class=3D"gmail_quote">On 20 March 2018 at 12:29, = Oberfeld-Twistel, Daniel <span dir=3D"ltr" class=3D"">&lt;<a = href=3D"mailto:oberfeld@xxxxxxxx" target=3D"_blank" = class=3D"">oberfeld@xxxxxxxx</a>&gt;</span> wrote:<br = class=3D""><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 = .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div lang=3D"DE" link=3D"blue" vlink=3D"purple" class=3D""> <div class=3D"m_1196544489159743617WordSection1"><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Thanks for sharing the references!<u = class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">In my view, MUSHRA cannot be recommended for = studying musical similarity.<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">The method is designed to identify differences = between stimuli on a defined dimension (which is audio quality in the MUSHRA recommendation, = although this rating method could also be used for evaluating other = perceptual dimensions).<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">In the MUSHRA method, listeners are NOT asked to = rate the similarity of the stimuli, however. While in principle information about similarity = could be deduced in an indirect manner from the ratings obtained with = MUSHRA (similar mean ratings =3D high similarity), this would require = that you can specify&nbsp; the perceptual dimension on which your stimuli differ or are similar (say, rhythm, tempo, = consonance/dissonance, mood etc.). <u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">If that is not possible, the other approaches that = were suggested like triadic tests or MDS can be used *<b class=3D""><span style=3D"font-weight:bold" = class=3D"">without</span></b>* having to specify which exact dimension = &nbsp;the similarity judgments should refer to, and to identify = structures in the (dis-) similarity ratings. <u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">In addition, I could imagine that the MUSHRA = concepts of a high-quality =E2=80=9Creference=E2=80=9D and a low-quality =E2=80=9Canchor=E2=80=9D = do not easily apply to the experiments you have in mind.<u = class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p> <div class=3D""><p class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" = face=3D"Calibri" class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Best<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Daniel <u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">------------------------------<wbr class=3D"">---<u = class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Dr. Daniel Oberfeld-Twistel<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Associate Professor<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Johannes Gutenberg - Universitaet Mainz<u = class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Institute of Psychology<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Experimental Psychology<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><a = href=3D"https://maps.google.com/?q=3DWallstrasse+3+%0D%0A+55122+Mainz+%0D%= 0A+Germany&amp;entry=3Dgmail&amp;source=3Dg" class=3D"">Wallstrasse = 3</a><u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><a = href=3D"https://maps.google.com/?q=3DWallstrasse+3+%0D%0A+55122+Mainz+%0D%= 0A+Germany&amp;entry=3Dgmail&amp;source=3Dg" class=3D"">55122 = Mainz</a><u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><a = href=3D"https://maps.google.com/?q=3DWallstrasse+3+%0D%0A+55122+Mainz+%0D%= 0A+Germany&amp;entry=3Dgmail&amp;source=3Dg" class=3D"">Germany</a><u = class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Phone <a href=3D"tel:+49%206131%203939274" = value=3D"+4961313939274" target=3D"_blank" class=3D"">++49 (0) 6131 39 = 39274</a> <u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D"">Fax&nbsp;&nbsp; <a href=3D"tel:+49%206131%203939268" = value=3D"+4961313939268" target=3D"_blank" class=3D"">++49 (0) 6131 39 = 39268</a><u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" face=3D"Calibri" = class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><a href=3D"http://www.staff.uni-mainz.de/oberfeld/" = target=3D"_blank" class=3D"">http://www.staff.uni-mainz.de/<wbr = class=3D"">oberfeld/</a><u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"2" = color=3D"#1f497d" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><a = href=3D"https://www.facebook.com/WahrnehmungUndPsychophysikUniMainz" = target=3D"_blank" class=3D"">https://www.facebook.com/<wbr = class=3D"">WahrnehmungUndPsychophysikUniM<wbr class=3D"">ainz</a><u = class=3D""></u><u class=3D""></u></span></font></p> </div><p class=3D"MsoNormal"><font size=3D"2" color=3D"#1f497d" = face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :#1f497d" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p> <div style=3D"border:none;border-left:solid blue 1.5pt;padding:0cm 0cm = 0cm 4.0pt" class=3D""> <div class=3D""> <div style=3D"border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt = 0cm 0cm 0cm" class=3D""><p class=3D"MsoNormal"><b class=3D""><font = size=3D"2" face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;font-= weight:bold" class=3D"">From:</span></font></b><font size=3D"2" = face=3D"Calibri" class=3D""><span lang=3D"EN-US" = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif" = class=3D""> AUDITORY - Research in Auditory Perception &lt;<a = href=3D"mailto:AUDITORY@xxxxxxxx" target=3D"_blank" = class=3D"">AUDITORY@xxxxxxxx</a>&gt; <b class=3D""><span = style=3D"font-weight:bold" class=3D"">On Behalf Of </span></b>Pat Savage<br class=3D""> <b class=3D""><span style=3D"font-weight:bold" class=3D"">Sent:</span></b>= Tuesday, March 20, 2018 6:19 AM<br class=3D""> <b class=3D""><span style=3D"font-weight:bold" class=3D"">To:</span></b> = <a href=3D"mailto:AUDITORY@xxxxxxxx" target=3D"_blank" = class=3D"">AUDITORY@xxxxxxxx</a><br class=3D""> <b class=3D""><span style=3D"font-weight:bold" = class=3D"">Subject:</span></b> Re: Measuring perceptual similarity<u = class=3D""></u><u class=3D""></u></span></font></p> </div> </div><div class=3D""><div class=3D"h5"><p class=3D"MsoNormal"><font = size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal"><font size=3D"3" = face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">Dear list,<u class=3D""></u><u = class=3D""></u></span></font></p> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D""><u class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">Thanks very much for all of your responses. I=E2=80=99m = summarizing below all the reference recommendations I received.&nbsp;<u = class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D""><u class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">I still want to more fully read some of these, but so far my = impression is that the Giordano et al. (2011) paper gives a good review = of the benefits and drawbacks of previous methods, but since that was published MUSHRA seems to have = become the standard method for these types of subjective perceptual = similarity ratings.<u class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D""><u class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">Please let me know if I seem to be misunderstanding anything = here.<u class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D""><u class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">Cheers,<u class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">Pat&nbsp;<u class=3D""></u><u class=3D""></u></span></font></p>= </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">--<u class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal" style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">Flexer, A., &amp; Grill, T. = (2016). The Problem of Limited Inter-rater Agreement in Modelling Music = Similarity.&nbsp;<i class=3D""><span style=3D"font-style:italic" = class=3D"">Journal of New Music Research</span></i>,&nbsp;<i = class=3D""><span style=3D"font-style:italic" class=3D"">45</span></i>(3), 1=E2=80=9313.<u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal" style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt;background:white" class=3D"">P. Susini, S. = McAdams, S. Winsberg: A multidimensional technique for sound quality = assessment. Acta Acustica united with Acustica 85 (1999), = 650=E2=80=93656.</span></font><span lang=3D"EN-US" class=3D""><u = class=3D""></u><u class=3D""></u></span></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">Novello, A., McKinney, M. F., = &amp; Kohlrausch, A. (2006). Perceptual evaluation of music similarity. = In&nbsp;<i class=3D""><span style=3D"font-style:italic" = class=3D"">Proceedings of the 7th International Conference on Music Information Retrieval</span></i>. Retrieved = from&nbsp;</span><a = href=3D"http://ismir2006.ismir.net/PAPERS/ISMIR06148_Paper.pdf" = target=3D"_blank" class=3D""><span lang=3D"EN-US" = class=3D"">http://ismir2006.ismir.<wbr = class=3D"">net/PAPERS/ISMIR06148_Paper.<wbr = class=3D"">pdf</span></a></font><span lang=3D"EN-US" class=3D""><u = class=3D""></u><u class=3D""></u></span></p> </div> <div class=3D""><p class=3D"MsoNormal" style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">Michaud, P. Y., Meunier, S., = Herzog, P., Lavandier, M., &amp; D=E2=80=99Aubigny, G. D. (2013). = Perceptual evaluation of dissimilarity between auditory stimuli: An = alternative to the paired comparison.&nbsp;<i class=3D""><span style=3D"font-style:italic" = class=3D"">Acta Acustica United with Acustica</span></i>,&nbsp;<i = class=3D""><span style=3D"font-style:italic" class=3D"">99</span></i>(5), = 806=E2=80=93815.<u class=3D""></u><u class=3D""></u></span></font></p><p = class=3D"MsoNormal" style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">Wolff, D., &amp; Weyde, T. (2011). = Adapting Metrics for Music Similarity Using Comparative Ratings.&nbsp;<i = class=3D""><span style=3D"font-style:italic" class=3D"">12th = International Society for Music Information Retrieval Conference (ISMIR=E2=80=9911), Proc.</span></i>, (Ismir), = 73=E2=80=9378.&nbsp;<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt;background:white" class=3D"">B. L. Giordano, = C. Guastavino, E. Murphy, M. Ogg, B. K. Smith, S. McAdams: Comparison of = methods for collecting and modeling dissimilarity data: Applications to complex sound stimuli. Multivariate Behavioral Research 46 (2011), = 779=E2=80=93811.</span></font><span lang=3D"EN-US" class=3D""><u = class=3D""></u><u class=3D""></u></span></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt;background:white" class=3D"">P. Y. Michaud, S. = Meunier, P. Herzog, M. Lavandier, G. d=E2=80=99Aubigny: Perceptual = evaluation of dissimilarity between auditory stimuli: an alternative to = the paired&nbsp; comparison. Acta Acustica united with Acustica 99 (2013), = 806=E2=80=93815.</span></font><span lang=3D"EN-US" class=3D""><u = class=3D""></u><u class=3D""></u></span></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">Collett, E., Marx, M., Gaillard, = P., Roby, B., Fraysse, B., &amp; Deguine, O. (2016). Categorization of = common sounds by cochlear implanted and normal hearing adults.&nbsp;<i = class=3D""><span style=3D"font-style:italic" class=3D"">Hearing Research</span></i>,&nbsp;<i class=3D""><span style=3D"font-style:italic"= class=3D"">335</span></i>, 207=E2=80=93219.<u class=3D""></u><u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">International Telecommunication = Union. (2015). ITU-R BS.1534-3, Method for the subjective assessment of = intermediate quality level of audio systems.&nbsp;<i class=3D""><span = style=3D"font-style:italic" class=3D"">ITU-R Recommendation</span></i>,&nbsp;<i class=3D""><span = style=3D"font-style:italic" class=3D"">1534</span></i>=E2=80=93<i = class=3D""><span style=3D"font-style:italic" class=3D"">3</span></i>, = 1534=E2=80=933. Retrieved from&nbsp;</span><a = href=3D"https://www.itu.int/dms_pubrec/itu-r/rec/bs/R-REC-BS.1534-3-201510= -I!!PDF-E.pdf" target=3D"_blank" class=3D""><span lang=3D"EN-US" = class=3D"">https://www.itu.int/dms_<wbr = class=3D"">pubrec/itu-r/rec/bs/R-REC-BS.<wbr = class=3D"">1534-3-201510-I!!PDF-E.pdf</span></a></font><span = lang=3D"EN-US" class=3D""><u class=3D""></u><u = class=3D""></u></span></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span = style=3D"font-size:12.0pt" class=3D"">Lavandier, M., Meunier, S., &amp; = Herzog, P. (2008). </span></font><span lang=3D"EN-US" class=3D"">Identification of some = perceptual dimensions underlying loudspeaker dissimilarities.&nbsp;<i = class=3D""><span style=3D"font-style:italic" class=3D"">Journal of the = Acoustical Society of America</span></i>,&nbsp;<i class=3D""><span = style=3D"font-style:italic" class=3D"">123</span></i>(6), 4186=E2=80=934198.&nbsp;<u class=3D""></u><u class=3D""></u></span></p><p= class=3D"MsoNormal" style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D""><u class=3D""></u>&nbsp;<u = class=3D""></u></span></font></p><p class=3D"MsoNormal" = style=3D"margin-left:24.0pt"> <font size=3D"3" face=3D"Times New Roman" class=3D""><span lang=3D"EN-US" = style=3D"font-size:12.0pt" class=3D"">DZHAFAROV, E. N., &amp; OLDENBURG, = H. C. (2006). RECONSTRUCTING DISTANCES AMONG OBJECTS FROM THEIR = DISCRIMINABILITY.&nbsp;</span><i class=3D""><span = style=3D"font-style:italic" class=3D"">Psychometrik<wbr = class=3D"">a</span></i>,&nbsp;<i class=3D""><span = style=3D"font-style:italic" class=3D"">71</span></i>(2), 365=E2=80=93386.<u class=3D""></u><u class=3D""></u></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><u = class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" = class=3D"">Software:&nbsp;<u class=3D""></u><u = class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><u = class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" = class=3D"">Various:<u class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><a = href=3D"http://www.ak.tu-berlin.de/menue/digitale_ressourcen/research_tool= s/whisper_listening_test_toolbox_for_matlab/" target=3D"_blank" = class=3D""><font size=3D"2" color=3D"purple" face=3D"Calibri" = class=3D""><span = style=3D"font-size:11.0pt;font-family:&quot;Calibri&quot;,sans-serif;color= :purple" class=3D"">http://www.ak.tu-berlin.de/<wbr = class=3D"">menue/digitale_ressourcen/<wbr = class=3D"">research_tools/whisper_<wbr = class=3D"">listening_test_toolbox_for_<wbr = class=3D"">matlab/</span></font></a></span></font><u class=3D""></u><u = class=3D""></u></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><u = class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" = class=3D"">MUSHRA:<u class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><a = href=3D"https://github.com/audiolabs/webMUSHRA" target=3D"_blank" = class=3D"">https://github.com/audiolabs/<wbr = class=3D"">webMUSHRA</a></span></font><u class=3D""></u><u = class=3D""></u></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><u = class=3D""></u>&nbsp;<u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" = class=3D"">Free-sorting:<u class=3D""></u><u = class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span style=3D"font-size:12.0pt" class=3D""><a = href=3D"http://petra.univ-tlse2.fr/spip.php?rubrique49&amp;lang=3Den" = target=3D"_blank" class=3D"">http://petra.univ-tlse2.fr/<wbr = class=3D"">spip.php?rubrique49&amp;lang=3Den</a></span></font><u = class=3D""></u><u class=3D""></u></p> </div> <div class=3D""> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">---<br class=3D""> Dr. Patrick Savage<br class=3D""> Project Associate Professor<u class=3D""></u><u = class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">Faculty of Environment and Information Studies<u = class=3D""></u><u class=3D""></u></span></font></p> </div> <div class=3D""><p class=3D"MsoNormal"><font size=3D"3" face=3D"Times = New Roman" class=3D""><span lang=3D"EN-US" style=3D"font-size:12.0pt" = class=3D"">Keio University SFC (Shonan Fujisawa Campus)<br class=3D""> </span><a href=3D"http://patrickesavage.com/" target=3D"_blank" = class=3D""><span lang=3D"EN-US" = class=3D"">http://PatrickESavage.com</span></a></font><span lang=3D"EN-US"= class=3D""><u class=3D""></u><u class=3D""></u></span></p> </div> </div> </div></div></div> </div> </div> </blockquote></div><br class=3D""><br clear=3D"all" class=3D""><div = class=3D""><br class=3D""></div>-- <br class=3D""><div = class=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div = dir=3D"ltr" class=3D""><div = style=3D"color:rgb(136,136,136);font-size:12.8px" = class=3D"">~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">Bruno L. = Giordano, PhD =E2=80=93 CR1</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">Institut de = Neurosciences de la Timone (INT)</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">UMR 7289, = CNRS and Aix Marseille Universit=C3=A9</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D""><a = href=3D"http://www.int.univ-amu.fr/" style=3D"color:rgb(17,85,204)" = target=3D"_blank" class=3D"">http://www.int.univ-amu.fr/</a></div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">Campus = sant=C3=A9 Timone</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">27, = boulevard Jean Moulin</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">13385 = Marseille cedex 5</div><div = style=3D"color:rgb(136,136,136);font-size:12.8px" class=3D"">Www:&nbsp;<a = href=3D"http://www.brunolgiordano.net/" style=3D"color:rgb(17,85,204)" = target=3D"_blank" = class=3D"">http://www.brunolgiordano.net</a></div></div></div> </div> </div></blockquote></div><br class=3D""></div></body></html>= --Apple-Mail=_2B97DDBB-BB9C-4A5C-BED4-96732F86D134--


This message came from the mail archive
../postings/2018/
maintained by:
DAn Ellis <dpwe@ee.columbia.edu>
Electrical Engineering Dept., Columbia University