Subject: Re: Experiments with large N From: Malcolm Slaney <malcolm@xxxxxxxx> Date: Sun, 2 Dec 2007 11:18:35 -0800 List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>--Apple-Mail-30--727416789 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed This music paper has 380k subjects :-) http://cobweb.ecn.purdue.edu/~malcolm/yahoo/Slaney2007 (SimilarityByUserRatingISMIR).pdf While Ben Marlin collected another 30k subjects for this music- recommendation study. http://cobweb.ecn.purdue.edu/~malcolm/yahoo/Marlin2007 (UserBiasUncertainty).pdf The underlying data for both papers is available for academic researchers (fully anonymized, both by song and by user). Send me email if you want more information. - Malcolm On Dec 1, 2007, at 5:43 PM, Matt Wright wrote: > Trevor Cox recently published the results of an online experiment > about listeners' ratings of sound files on a six-point scale ("not > horrible", "bad", "really bad", "awful", "really awful", and > "horrible"). To date he has 130,000 subjects (!) and about 1.5 > million data points: > > http://www.sea-acustica.es/WEB_ICA_07/fchrs/papers/ppa-09-003.pdf > > Here's the website for his experiment: http://www.sound101.org > > Clearly this is related to the "effect of visual stimuli on the > horribleness of awful sounds" that Kelly Fitz pointed out. > > -Matt > > > On Jun 29, 2007, at 12:32 AM, Massimo Grassi wrote: >> So far it looks that the experiment with the largest N (513!) is >> "The role of contrasting temporal amplitude patterns in the >> perception of speech" Healy and Warren JASA but I didn't check yet >> the methodology to see whether is a between or a within subject >> design. --Apple-Mail-30--727416789 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=ISO-8859-1 <html><body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = -webkit-line-break: after-white-space; ">This music paper has 380k = subjects :-)<div><div><span class=3D"Apple-tab-span" = style=3D"white-space:pre"> </span><a = href=3D"http://cobweb.ecn.purdue.edu/~malcolm/yahoo/Slaney2007(SimilarityB= yUserRatingISMIR).pdf">http://cobweb.ecn.purdue.edu/~malcolm/yahoo/Slaney2= 007(SimilarityByUserRatingISMIR).pdf</a><div><div><br></div><div>While = Ben Marlin collected another 30k subjects for this music-recommendation = study.</div><div><div style=3D"margin-top: 0px; margin-right: 0px; = margin-bottom: 0px; margin-left: 0px; "><font face=3D"Helvetica" = size=3D"3" style=3D"font: 12.0px Helvetica"><span class=3D"Apple-tab-span"= style=3D"white-space:pre"> = </span>http://cobweb.ecn.purdue.edu/~malcolm/yahoo/Marlin2007(UserBiasUnce= rtainty).pdf</font></div></div><div><br = class=3D"webkit-block-placeholder"></div><div>The underlying data for = both papers is available for academic researchers (fully anonymized, = both by song and by user). =A0Send me email if you want more = information.</div><div><br class=3D"webkit-block-placeholder"></div><div>-= Malcolm</div><div><br class=3D"webkit-block-placeholder"></div><div>On = Dec 1, 2007, at 5:43 PM, Matt Wright wrote:</div><br = class=3D"Apple-interchange-newline"><blockquote type=3D"cite"><div = style=3D"margin-top: 0px; margin-right: 0px; margin-bottom: 0px; = margin-left: 0px; ">Trevor Cox recently published the results of an = online experiment about listeners' ratings of sound files on a six-point = scale ("not horrible", "bad", "really bad", "awful", "really awful", and = "horrible").<span class=3D"Apple-converted-space">=A0 </span>To date he = has 130,000 subjects (!) and about 1.5 million data points:</div><div = style=3D"margin-top: 0px; margin-right: 0px; margin-bottom: 0px; = margin-left: 0px; min-height: 14px; "><br></div><div style=3D"margin-top: = 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; = ">http://www.sea-acustica.es/WEB_ICA_07/fchrs/papers/ppa-09-003.pdf</div><= div style=3D"margin-top: 0px; margin-right: 0px; margin-bottom: 0px; = margin-left: 0px; min-height: 14px; "><br></div><div style=3D"margin-top: = 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Here's = the website for his experiment: http://www.sound101.org</div><div = style=3D"margin-top: 0px; margin-right: 0px; margin-bottom: 0px; = margin-left: 0px; min-height: 14px; "><br></div><div style=3D"margin-top: = 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Clearly = this is related to the "effect of visual stimuli on the horribleness of = awful sounds" that Kelly Fitz pointed out.</div><div style=3D"margin-top: = 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; = min-height: 14px; "><br></div><div style=3D"margin-top: 0px; = margin-right: 0px; margin-bottom: 0px; margin-left: 0px; = ">-Matt</div><div style=3D"margin-top: 0px; margin-right: 0px; = margin-bottom: 0px; margin-left: 0px; min-height: 14px; "><br></div><div = style=3D"margin-top: 0px; margin-right: 0px; margin-bottom: 0px; = margin-left: 0px; min-height: 14px; "><br></div><div style=3D"margin-top: = 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">On Jun = 29, 2007, at 12:32 AM, Massimo Grassi wrote:</div> <blockquote = type=3D"cite"><div style=3D"margin-top: 0px; margin-right: 0px; = margin-bottom: 0px; margin-left: 0px; ">So far it looks that the = experiment with the largest N (513!) is "The role of contrasting = temporal amplitude patterns in the perception of speech" Healy and = Warren JASA but I didn't check yet the methodology to see whether is a = between or a within subject design.</div> = </blockquote></blockquote></div><br></div></div></body></html>= --Apple-Mail-30--727416789--