Re: [AUDITORY] Online rhythm production experiments ("Jacoby, Nori" )


Subject: Re: [AUDITORY] Online rhythm production experiments
From:    "Jacoby, Nori"  <nori.jacoby@xxxxxxxx>
Date:    Tue, 20 Oct 2020 16:00:03 +0000

--_000_cf87324db7404beb9f8c8e43823b7534aempgde_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hi Henkjan and everybody, My research group has developed a technology that has solved this problem a= nd allowed us to collect reliable tapping data in an online setup. We=92ve = successfully collected large tapping datasets this way, and we believe that= our method fully addresses the issues mentioned in this thread (low latenc= y and jitter) while also being practical in terms of realistic online data = collection. We plan to publish a preprint by the end of the year and theref= ore make the details of the technology accessible to everyone soon. If you = are interested in using the technology earlier, please contact me. Very best, Nori Jacoby Nori Jacoby Max Planck Group Leader, =93Computational Auditory Perception=94 Max Planck Institute for Empirical Aesthetics Gr=FCneburgweg 14, 60322 Frankfurt am Main, Germany nori.jacoby@xxxxxxxx<mailto:nori.jacoby@xxxxxxxx> +49 69 8300479-820 ________________________________ From: AUDITORY - Research in Auditory Perception <AUDITORY@xxxxxxxx>= on behalf of Prof. dr Henkjan Honing <honing@xxxxxxxx> Sent: Monday, October 19, 2020 10:11:37 AM To: AUDITORY@xxxxxxxx Subject: [AUDITORY] Online rhythm production experiments We are looking for some advice from those that have been doing online rhyth= m production experiments in the last few years. Rhythm production experiments that are performed online =96 like typing on = the spacebar 'in sync=92 to a fragment of streamed music =96 is notoriously= tricky due to all kinds of delays mostly due to the effects of scan rate, = device drivers and OS scheduling at the client-side [1,2]; Delays / jitter = in the order of 50-100 ms are not uncommon. There are all kinds of workarounds available, like offline analysis of audi= o files or using estimation algorithms [3], but it might well be that some = of you have solved some of these issues in a more direct way. For instance,= a piece of software at the client-side that handles the timing of both the= streaming and recording the taps. If you have experience on these issues, we would appreciate if you would em= ail us your tips, solutions, etc. Henkjan Honing Fleur Bouwer [1] https://psyarxiv.com/d6nu5/ [2] https://psyarxiv.com/jfeca/ [3] https://www.cs.cmu.edu/~rbd/papers/Tap-ISMIR-2009.pdf . University of Amsterdam Faculty of Humanities Faculty of Science . --_000_cf87324db7404beb9f8c8e43823b7534aempgde_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1= 252"> </head> <body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; line-break:= after-white-space;" class=3D""> <style type=3D"text/css" style=3D"display:none;"><!-- P {margin-top:0;margi= n-bottom:0;} --></style> <div id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font= -family:Calibri,Helvetica,sans-serif;" dir=3D"ltr"> <p></p> <div style=3D"margin-top: 0px; margin-bottom: 0px;">Hi&nbsp;Henkjan and eve= rybody,<br> <br> My research group has developed a technology that has solved this problem a= nd allowed us to collect reliable tapping data in an online setup. We=92ve = successfully&nbsp;collected large tapping datasets this way, and we believe= that our method fully addresses the issues mentioned in this thread (low latency and jitter) while also being practic= al in terms of realistic online data collection. We plan to publish a prepr= int by the end of the year and therefore make the details of the technology= accessible to everyone soon. If you are interested in using the technology earlier, please contact me.<br> <br> Very best,<br> Nori Jacoby<br> </div> <div style=3D"color: rgb(33, 33, 33); font-family: wf_segoe-ui_normal, &quo= t;Segoe UI&quot;, &quot;Segoe WP&quot;, Tahoma, Arial, sans-serif, serif, E= mojiFont; font-size: 15px; margin-top: 0px; margin-bottom: 0px;"> <br> </div> <p></p> <div id=3D"Signature"> <div id=3D"divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size: 12pt; colo= r: rgb(0, 0, 0); font-family: Calibri, Helvetica, sans-serif, Helvetica, Em= ojiFont, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, NotoCol= orEmoji, &quot;Segoe UI Symbol&quot;, &quot;Android Emoji&quot;, EmojiSymbo= ls;"> <p></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Nori Jacoby</span>= </p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Max Planck Group L= eader, =93Computational Auditory Perception=94</span></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Max Planck Institu= te for Empirical Aesthetics</span></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Gr=FCneburgweg 14,= 60322 Frankfurt am Main, Germany</span></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline"><a href=3D"mailto:nori.jacoby@xxxxxxxx= mpg.de" title=3D"mailto:nori.jacoby@xxxxxxxx Cmd&#43;Click or tap to follo= w the link" style=3D"" id=3D"LPNoLP"><span style=3D"font-size:9pt">nori.jac= oby@xxxxxxxx</span></a><span style=3D"font-size:9pt"> </span><span style=3D"font-size:9pt">&#43;49 69 8300479-820</span><font col= or=3D"#1155cc" face=3D"Arial"></font> </span></p> <p></p> </div> </div> </div> <hr style=3D"display:inline-block;width:98%" tabindex=3D"-1"> <div id=3D"divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" st= yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b> AUDITORY - Research i= n Auditory Perception &lt;AUDITORY@xxxxxxxx&gt; on behalf of Prof. d= r Henkjan Honing &lt;honing@xxxxxxxx&gt;<br> <b>Sent:</b> Monday, October 19, 2020 10:11:37 AM<br> <b>To:</b> AUDITORY@xxxxxxxx<br> <b>Subject:</b> [AUDITORY] Online rhythm production experiments</font> <div>&nbsp;</div> </div> <div> <div class=3D""><br class=3D""> </div> <div class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; l= ine-break: after-white-space;"> We are looking for some advice from those that have been doing online&nbsp;= <b class=3D"">rhythm production</b>&nbsp;experiments in the last few years.= &nbsp;</div> <div class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; l= ine-break: after-white-space;"> <br class=3D""> </div> <div class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; l= ine-break: after-white-space;"> Rhythm production experiments that are performed online =96 like typing on = the spacebar 'in sync=92 to a fragment of streamed music =96 is notoriously= tricky due to all kinds of delays mostly due to the effects of scan rate, = device drivers and OS scheduling&nbsp;at the client-side [1,2]; Delays / jitter in the order of 50-100 ms are not uncom= mon.</div> <div class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; l= ine-break: after-white-space;"> <br class=3D""> </div> <div class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; l= ine-break: after-white-space;"> There are all kinds of workarounds available, like offline analysis of audi= o files or using estimation algorithms [3], but it might well be that some = of you have solved some of these issues in a more direct way. For instance,= a piece of software at the client-side that handles the timing of both the streaming and recording the taps.&nbsp= ;</div> <div class=3D"" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; l= ine-break: after-white-space;"> <br class=3D""> </div> <div class=3D"">If you have experience on these issues, we would appreciate= if you would email us your tips, solutions, etc.</div> <div class=3D""><br class=3D""> </div> <div class=3D""><i class=3D"">Henkjan Honing</i></div> <div class=3D""><i class=3D"">Fleur Bouwer</i></div> <div class=3D""><span class=3D""><br class=3D""> </span></div> <div class=3D""><span class=3D"">[1]&nbsp;<a href=3D"https://psyarxiv.com/d= 6nu5/" class=3D"">https://psyarxiv.com/d6nu5/</a></span></div> <div class=3D"">[2]&nbsp;<a href=3D"https://psyarxiv.com/jfeca/" class=3D""= >https://psyarxiv.com/jfeca/</a></div> <div class=3D"">[3]&nbsp;<a href=3D"https://www.cs.cmu.edu/~rbd/papers/Tap-= ISMIR-2009.pdf" class=3D"">https://www.cs.cmu.edu/~rbd/papers/Tap-ISMIR-200= 9.pdf</a></div> <div class=3D""><br class=3D""> </div> <div class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); = letter-spacing: normal; text-align: start; text-indent: 0px; text-transform= : none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: = 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space= ; line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class= =3D""> <div dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class= =3D""> <div dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class= =3D""> <div dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class= =3D""> <div dir=3D"auto" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space;= line-break: after-white-space;" class=3D""> <div dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class= =3D""> <div dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class= =3D""> <div dir=3D"auto" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space;= line-break: after-white-space;" class=3D""> <div style=3D"text-align: start; text-indent: 0px;"> <div style=3D"orphans: 2; widows: 2; margin-bottom: 0px; margin-top: 0px;" = class=3D""> <div dir=3D"auto" style=3D"orphans: 2; text-align: start; text-indent: 0px;= widows: 2; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: af= ter-white-space;" class=3D""> <div dir=3D"auto" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space;= line-break: after-white-space;" class=3D""> <div style=3D"margin-bottom: 0px; margin-top: 0px;" class=3D""> <div style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: n= ormal; font-variant-caps: normal; letter-spacing: normal; text-transform: n= one; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit= -text-stroke-width: 0px; font-family: Courier; font-size: 14px;" class=3D""= > <div class=3D""><span style=3D"font-size: 10px; color: rgb(102, 102, 102); = font-family: Calibri;" class=3D"">.</span></div> </div> <div style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: n= ormal; font-variant-caps: normal; letter-spacing: normal; text-transform: n= one; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit= -text-stroke-width: 0px; font-family: Courier; font-weight: normal;" class= =3D""> <span style=3D"font-weight: bold; color: rgb(102, 102, 102); font-family: C= alibri; font-size: 12px;" class=3D"">University of Amsterdam</span></div> <div style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: n= ormal; font-variant-caps: normal; letter-spacing: normal; text-transform: n= one; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit= -text-stroke-width: 0px; font-family: Courier; font-weight: normal;" class= =3D""> <span style=3D"color: rgb(102, 102, 102); font-family: Calibri; font-size: = 12px;" class=3D"">Faculty of Humanities&nbsp;</span></div> <div style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: n= ormal; font-variant-caps: normal; letter-spacing: normal; text-transform: n= one; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit= -text-stroke-width: 0px; font-family: Courier; font-weight: normal;" class= =3D""> <span style=3D"color: rgb(102, 102, 102); font-family: Calibri; font-size: = 12px;" class=3D"">Faculty of Science</span></div> <div style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: n= ormal; font-variant-caps: normal; letter-spacing: normal; text-transform: n= one; white-space: normal; word-spacing: 0px; text-decoration: none; -webkit= -text-stroke-width: 0px; font-family: Courier; font-weight: normal;" class= =3D""> <span style=3D"font-size: 10px; color: rgb(102, 102, 102); font-family: Cal= ibri;" class=3D"">.</span></div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <br class=3D""> </div> </body> </html> --_000_cf87324db7404beb9f8c8e43823b7534aempgde_--


This message came from the mail archive
src/postings/2020/
maintained by:
DAn Ellis <dpwe@ee.columbia.edu>
Electrical Engineering Dept., Columbia University