Subject: [AUDITORY] Online rhythm production experiments : follow-up From: "Prof. dr Henkjan Honing" <honing@xxxxxxxx> Date: Mon, 19 Oct 2020 14:36:59 +0200--Apple-Mail=_EF17DBA7-6A36-4E3D-8C31-44F1ED512ACA Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 P.S. I will share a summary of the responses in a few weeks. N.B. I expect some innovations in (commercial) technologies that support = online music making via Zoom-like media. These suffer from similar = timing / synchronisation problems. I am currently approaching some of = these parties. But here as well: advise is welcome. Best, Henkjan =E2=80=94=E2=80=94 We are looking for some advice from those that have been doing online = rhythm production experiments in the last few years.=20 Rhythm production experiments that are performed online =E2=80=93 like = typing on the spacebar 'in sync=E2=80=99 to a fragment of streamed music = =E2=80=93 is notoriously tricky due to all kinds of delays mostly due to = the effects of scan rate, device drivers and OS scheduling at the = client-side [1,2]; Delays / jitter in the order of 50-100 ms are not = uncommon. There are all kinds of workarounds available, like offline analysis of = audio files or using estimation algorithms [3], but it might well be = that some of you have solved some of these issues in a more direct way. = For instance, a piece of software at the client-side that handles the = timing of both the streaming and recording the taps.=20 If you have experience on these issues, we would appreciate if you would = email us your tips, solutions, etc. Henkjan Honing Fleur Bouwer [1] https://psyarxiv.com/d6nu5/ <https://psyarxiv.com/d6nu5/> [2] https://psyarxiv.com/jfeca/ <https://psyarxiv.com/jfeca/> [3] https://www.cs.cmu.edu/~rbd/papers/Tap-ISMIR-2009.pdf = <https://www.cs.cmu.edu/~rbd/papers/Tap-ISMIR-2009.pdf> . University of Amsterdam Faculty of Humanities=20 Faculty of Science . --Apple-Mail=_EF17DBA7-6A36-4E3D-8C31-44F1ED512ACA Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D""><meta= http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dutf-8" = class=3D""><div style=3D"word-wrap: break-word; -webkit-nbsp-mode: = space; line-break: after-white-space;" class=3D""><div class=3D""><div = class=3D"">P.S. I will share a summary of the responses in a few = weeks.</div><div class=3D""><br class=3D""></div><div class=3D"">N.B. I = expect some innovations in (commercial) technologies that support online = music making via Zoom-like media. These suffer from similar timing / = synchronisation problems. I am currently approaching some of these = parties. But here as well: advise is welcome.</div><div class=3D""><br = class=3D""></div><div class=3D"">Best,</div><div class=3D""><br = class=3D""></div><div class=3D""><i class=3D"">Henkjan</i></div></div><div= class=3D""><br class=3D""></div><div class=3D"">=E2=80=94=E2=80=94</div><= div class=3D""><br class=3D""></div><div class=3D""><br = class=3D""></div><div class=3D"" style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;">We are looking = for some advice from those that have been doing online <b = class=3D"">rhythm production</b> experiments in the last few = years. </div><div class=3D"" style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;"><br = class=3D""></div><div class=3D"" style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;">Rhythm = production experiments that are performed online =E2=80=93 like typing = on the spacebar 'in sync=E2=80=99 to a fragment of streamed music =E2=80=93= is notoriously tricky due to all kinds of delays mostly due to the = effects of scan rate, device drivers and OS scheduling at the = client-side [1,2]; Delays / jitter in the order of 50-100 ms are not = uncommon.</div><div class=3D"" style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;"><br = class=3D""></div><div class=3D"" style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;">There are all = kinds of workarounds available, like offline analysis of audio files or = using estimation algorithms [3], but it might well be that some of you = have solved some of these issues in a more direct way. For instance, a = piece of software at the client-side that handles the timing of both the = streaming and recording the taps. </div><div class=3D"" = style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; line-break: = after-white-space;"><br class=3D""></div><div class=3D"">If you have = experience on these issues, we would appreciate if you would email us = your tips, solutions, etc.</div><div class=3D""><br class=3D""></div><div = class=3D""><i class=3D"">Henkjan Honing</i></div><div class=3D""><i = class=3D"">Fleur Bouwer</i></div><div class=3D""><span class=3D""><br = class=3D""></span></div><div class=3D""><span class=3D"">[1] <a = href=3D"https://psyarxiv.com/d6nu5/" = class=3D"">https://psyarxiv.com/d6nu5/</a></span></div><div = class=3D"">[2] <a href=3D"https://psyarxiv.com/jfeca/" = class=3D"">https://psyarxiv.com/jfeca/</a></div><div = class=3D"">[3] <a = href=3D"https://www.cs.cmu.edu/~rbd/papers/Tap-ISMIR-2009.pdf" = class=3D"">https://www.cs.cmu.edu/~rbd/papers/Tap-ISMIR-2009.pdf</a></div>= <div class=3D""><br class=3D""></div><div class=3D""> <div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, = 0); letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"caret-color: rgb(0, 0, 0); color: = rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: = 0px; text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"text-align: start; text-indent: = 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: = after-white-space;" class=3D""><div dir=3D"auto" style=3D"text-align: = start; text-indent: 0px; word-wrap: break-word; -webkit-nbsp-mode: = space; line-break: after-white-space;" class=3D""><div dir=3D"auto" = style=3D"text-align: start; text-indent: 0px; word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D""><div = dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D""><div = dir=3D"auto" style=3D"text-align: start; text-indent: 0px; word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div dir=3D"auto" style=3D"text-align: start; text-indent: = 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: = after-white-space;" class=3D""><div dir=3D"auto" style=3D"word-wrap: = break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" = class=3D""><div style=3D"text-align: start; text-indent: 0px;" = class=3D""><div style=3D"orphans: 2; widows: 2; margin-bottom: 0px; = margin-top: 0px;" class=3D""><div dir=3D"auto" style=3D"orphans: 2; = text-align: start; text-indent: 0px; widows: 2; word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D""><div = dir=3D"auto" style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; = line-break: after-white-space;" class=3D""><div style=3D"margin-bottom: = 0px; margin-top: 0px;" class=3D""><div style=3D"caret-color: rgb(0, 0, = 0); color: rgb(0, 0, 0); font-style: normal; font-variant-caps: normal; = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; text-decoration: none; -webkit-text-stroke-width: = 0px; font-family: Courier; font-size: 14px;" class=3D""><div = class=3D""><span style=3D"font-size: 10px; color: rgb(102, 102, 102); = font-family: Calibri;" class=3D"">.</span></div></div><div = style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: = normal; font-variant-caps: normal; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = text-decoration: none; -webkit-text-stroke-width: 0px; font-family: = Courier; font-weight: normal;" class=3D""><span style=3D"font-weight: = bold; color: rgb(102, 102, 102); font-family: Calibri; font-size: 12px;" = class=3D"">University of Amsterdam</span></div><div style=3D"caret-color: = rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: normal; = font-variant-caps: normal; letter-spacing: normal; text-transform: none; = white-space: normal; word-spacing: 0px; text-decoration: none; = -webkit-text-stroke-width: 0px; font-family: Courier; font-weight: = normal;" class=3D""><span style=3D"color: rgb(102, 102, 102); = font-family: Calibri; font-size: 12px;" class=3D"">Faculty of = Humanities </span></div><div style=3D"caret-color: rgb(0, 0, 0); = color: rgb(0, 0, 0); font-style: normal; font-variant-caps: normal; = letter-spacing: normal; text-transform: none; white-space: normal; = word-spacing: 0px; text-decoration: none; -webkit-text-stroke-width: = 0px; font-family: Courier; font-weight: normal;" class=3D""><span = style=3D"color: rgb(102, 102, 102); font-family: Calibri; font-size: = 12px;" class=3D"">Faculty of Science</span></div><div = style=3D"caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); font-style: = normal; font-variant-caps: normal; letter-spacing: normal; = text-transform: none; white-space: normal; word-spacing: 0px; = text-decoration: none; -webkit-text-stroke-width: 0px; font-family: = Courier; font-weight: normal;" class=3D""><span style=3D"font-size: = 10px; color: rgb(102, 102, 102); font-family: Calibri;" = class=3D"">.</span></div></div></div></div></div></div></div></div></div><= /div></div></div></div></div></div></div></div></div></div></div></div></d= iv></div></div></div></div></div></div> </div> <br class=3D""></div></body></html>= --Apple-Mail=_EF17DBA7-6A36-4E3D-8C31-44F1ED512ACA--