Re: Neural mechanisms of octave equivalence (Pierre Divenyi )


Subject: Re: Neural mechanisms of octave equivalence
From:    Pierre Divenyi  <pdivenyi@xxxxxxxx>
Date:    Sun, 25 Sep 2016 10:10:54 -0500
List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>

This is a multi-part message in MIME format. --------------45B4BA9FA07D68D579A52968 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by edgeum2.it.mcgill.ca id u8PFB3xu018584 Hi Alain, hi Dick, Another thought: would Terhardt's pitch salience measure also show this=20 octave phenomenon? I will take a look at it next week (I am traveling),=20 but what is your first reaction? -Pierre On 9/24/16 12:29 PM, Richard F. Lyon wrote: > Alain, right, I didn't mention harmonic templates; yes, that mechanism=20 > can work, but if birds mostly use narrowband harmonic-poor songs, and=20 > don't develop such templates, but do match on individual peaks, then=20 > no octave equivalence would be expected. > > Personally, I don't think the harmonic template approach is plausible.=20 > It's too hard to see how to make it work with plausible mechanisms=20 > that follow what the cochlea does, in either birds or mammals. > > Dick > > > On Sat, Sep 24, 2016 at 10:17 AM, Alain de Cheveigne=20 > <alain.de.cheveigne@xxxxxxxx <mailto:alain.de.cheveigne@xxxxxxxx>> wrote: > > Hi Dick, > > The mechnanisms I mentioned don=E2=80=99t depend on the tones havin= g > harmonics. This is easy to see for autocorrelation: the property > we invoke is that peaks for the lower tone coincide with peaks of > the octave tone, which is true whether or not the tones have > harmonics. The same holds for pattern matching: the fundamental > and and harmonics of the octave tone match the harmonic template > defined by the lower tone (whether that tone contains harmonics or > not). The harmonic template is an abstract pattern that can be > matched by a harmonic spectrum but also by a single component. > > Of course it could be that we (or birds) do perceive octave > similarity by matching patterns formed by the harmonics of the > tones. That would be yet another model. > > Alain > > > > > On 24 Sep 2016, at 18:39, Richard F. Lyon <dicklyon@xxxxxxxx > <mailto:dicklyon@xxxxxxxx>> wrote: > > > > I agree with Alain, but looked at the paper and have a few more > comments: > > > https://www.researchgate.net/profile/Lauren_Guillette/publication/2= 35376278_Chickadees_fail_standardized_operant_tests_for_octave_equivalenc= e/links/09e4151228c5ace7d7000000.pdf > <https://www.researchgate.net/profile/Lauren_Guillette/publication/= 235376278_Chickadees_fail_standardized_operant_tests_for_octave_equivalen= ce/links/09e4151228c5ace7d7000000.pdf> > > > > Octave equivalence is pretty strong for tones with enough > harmonics, for reasons that Alain describes. This paper shows that > humans have some octave generalization even with pure sine waves, > and that the birds do not. This likely points to different > mechanisms. > > > > For matching based on common frequencies of partials, you need > some partials in common, which is not the case here, due to the > signals being sine waves (no upper partials). For matching based > on common periods, or common peaks in autocorrelation functions, > sine waves an octave apart are close, because the higher one is > also periodic at the period of the lower one. > > > > So maybe this argues that humans use more period-based matching > and birds use only frequency (cochlear place) matching? Maybe the > experiment should be repeated with tones that have at least a > second harmonic, and see if that leads to birds doing octave > generalization by matching one tone's fundamental to another's > second harmonic? This would be a better way to get at pitch > height versus chroma, perhaps. > > > > Dick > > > > > > On Sat, Sep 24, 2016 at 12:59 AM, Alain de Cheveigne > <alain.de.cheveigne@xxxxxxxx <mailto:alain.de.cheveigne@xxxxxxxx>> wrot= e: > > Hi Ani, > > > > Octave =E2=80=9Cequivalence=E2=80=9D is an emergent property of b= oth > pattern-matching and autocorrelation models of pitch. All > harmonics of the tone at the octave belong to the harmonic series > of the lower tone. Likewise autocorrelation peaks of the lower > tone coincide with peaks of the tone at the octave. Some neural > instantiations of these models are Shihab Shamma=E2=80=99s harmonic > template model, or Cariani=E2=80=99s work on autocorrelation (based= on > Licklider=E2=80=99s ideas), and there are many others. Whether or = not any > specific model is supported by anatomical or electrophysiological > data is less clear. > > > > Actually =E2=80=9Cequivalence=E2=80=9D is a misnomer. The relatio= n is not > commutative: the harmonics of the lower tone do not all belong to > the harmonic series of the octave. Likewise peaks of the > autocorrelation of the octave tone are not all peaks of the lower > tone. Thus these models would predict an asymmetry in the > perceptual similarity between octaves (i.e. an octave tone > =E2=80=9Cresembles=E2=80=9D the lower tone but not vice-versa). I = don=E2=80=99t know of > any relevant behavioral data or music-theoretical results on this. > > > > Alain > > > > =E2=80=94 > > de Cheveign=C3=A9, A. (2005) Pitch perception models. In: Pitch - > Neural coding and perception (Plack C, Oxenham A, eds). New York: > Springer, 169-233. > (http://audition.ens.fr/adc/pdf/2005_pitch_SHAR.pdf > <http://audition.ens.fr/adc/pdf/2005_pitch_SHAR.pdf>) > > Shamma S, and Klein D (2000) The case of the missing pitch > templates: how harmonic templates emerge in the early auditory > system. J Acoust Soc Am 107:2631-2644. > > Cariani PA, and Delgutte B (1996b) Neural correlates of the > pitch of complex tones. II. Pitch shift, pitch ambiguity, > phase-invariance, pitch circularity, rate-pitch and the dominance > region for pitch. J Neurophysiol 76:1717-1734. > > Licklider JCR (1951) A duplex theory of pitch perception > (reproduced in Schubert 1979, 155-160). Experientia 7:128-134. > > > > > > > On 23 Sep 2016, at 13:06, Patel, Aniruddh D. > <a.patel@xxxxxxxx <mailto:a.patel@xxxxxxxx>> wrote: > > > > > > Dear List, > > > > > > Is anyone aware on theoretical or empirical papers on the > neural mechanisms of octave equivalence in auditory perception? > > > > > > Interestingly, recent works suggests that songbirds may not > perceive octave equivalence: > > > > > > Hoeschele, M., Weisman, R. G., Guillette, L. M., Hahn, A. H., > & Sturdy, C. B. (2013). Chickadees fail standardized operant tests > for octave equivalence. Animal cognition, 16(4), 599-609. > > > > > > Thanks, > > > > > > Ani Patel > > > > > > Aniruddh D. Patel > > > Professor > > > Dept. of Psychology > > > Tufts University > > > 490 Boston Ave. > > > Medford, MA 02155 > > > > > > Senior Fellow > > > Canadian Institute for Advanced Research (CIFAR) > > > Azrieli Program in Brain, Mind, & Consciousness > > > > > > a.patel@xxxxxxxx <mailto:a.patel@xxxxxxxx> > > > http://ase.tufts.edu/psychology/people/patel/ > <http://ase.tufts.edu/psychology/people/patel/> > > > > --------------45B4BA9FA07D68D579A52968 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by edgeum2.it.mcgill.ca id u8PFB3xu018584 <html> <head> <meta content=3D"text/html; charset=3Dutf-8" http-equiv=3D"Content-Ty= pe"> </head> <body bgcolor=3D"#FFFFFF" text=3D"#000000"> <p><font face=3D"Calibri">Hi Alain, hi Dick,</font></p> <font face=3D"Calibri">Another thought: would Terhardt's pitch salience measure also show this octave phenomenon? I will take a look at it next week (I am traveling), but what is your first reaction?<br> <br> -Pierre<br> </font><br> <div class=3D"moz-cite-prefix">On 9/24/16 12:29 PM, Richard F. Lyon wrote:<br> </div> <blockquote cite=3D"mid:22916_1474777877_57E75315_22916_57_61_CAA=3DYKqj-3rDZ6jdN4=3D= rBV+pMVBfeT=3DaO_4kj7VGRu5PQAv6uLg@xxxxxxxx" type=3D"cite"> <div dir=3D"ltr"> <div>Alain, right, I didn't mention harmonic templates; yes, that mechanism can work, but if birds mostly use narrowband harmonic-poor songs, and don't develop such templates, but do match on individual peaks, then no octave equivalence would be expected.<br> <br> </div> <div>Personally, I don't think the harmonic template approach is plausible. It's too hard to see how to make it work with plausible mechanisms that follow what the cochlea does, in either birds or mammals.<br> <br> </div> Dick<br> <br> </div> <div class=3D"gmail_extra"><br> <div class=3D"gmail_quote">On Sat, Sep 24, 2016 at 10:17 AM, Alai= n de Cheveigne <span dir=3D"ltr">&lt;<a moz-do-not-send=3D"true" href=3D"mailto:alain.de.cheveigne@xxxxxxxx" target=3D"_blank"= >alain.de.cheveigne@xxxxxxxx</a>&gt;</span> wrote:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Dick,<br= > <br> The mechnanisms I mentioned don=E2=80=99t depend on the tones= having harmonics.=C2=A0 This is easy to see for autocorrelation: the property we invoke is that peaks for the lower tone coincide with peaks of the octave tone, which is true whether or not the tones have harmonics.=C2=A0 The same holds for pattern matching: the fundamental and and harmonics of the octave tone match the harmonic template defined by the lower tone (whether that tone contains harmonics or not).=C2=A0 The harm= onic template is an abstract pattern that can be matched by a harmonic spectrum but also by a single component.<br> <br> Of course it could be that we (or birds) do perceive octave similarity by matching patterns formed by the harmonics of the tones.=C2=A0 That would be yet another model.<br> <span class=3D"HOEnZb"><font color=3D"#888888"><br> Alain<br> </font></span> <div class=3D"HOEnZb"> <div class=3D"h5"><br> <br> <br> &gt; On 24 Sep 2016, at 18:39, Richard F. Lyon &lt;<a moz-do-not-send=3D"true" href=3D"mailto:dicklyon@xxxxxxxx= g">dicklyon@xxxxxxxx</a>&gt; wrote:<br> &gt;<br> &gt; I agree with Alain, but looked at the paper and have a few more comments:<br> &gt; <a moz-do-not-send=3D"true" href=3D"https://www.researchgate.net/profile/Lauren_Guillette/publication= /235376278_Chickadees_fail_standardized_operant_tests_for_octave_equivale= nce/links/09e4151228c5ace7d7000000.pdf" rel=3D"noreferrer" target=3D"_blank">https://www.resear= chgate.net/<wbr>profile/Lauren_Guillette/<wbr>publication/235376278_<wbr>= Chickadees_fail_standardized_<wbr>operant_tests_for_octave_<wbr>equivalen= ce/links/<wbr>09e4151228c5ace7d7000000.pdf</a><br> &gt;<br> &gt; Octave equivalence is pretty strong for tones with enough harmonics, for reasons that Alain describes.=C2=A0 This paper shows that humans have some octave generalization even with pure sine waves, and that the birds do not.=C2=A0 This likely points to different mechanisms.<br> &gt;<br> &gt; For matching based on common frequencies of partials, you need some partials in common, which is not the case here, due to the signals being sine waves (no upper partials).=C2=A0 For matching based on common perio= ds, or common peaks in autocorrelation functions, sine waves an octave apart are close, because the higher one is also periodic at the period of the lower one.<br> &gt;<br> &gt; So maybe this argues that humans use more period-based matching and birds use only frequency (cochlear place) matching?=C2=A0 Maybe the experiment sho= uld be repeated with tones that have at least a second harmonic, and see if that leads to birds doing octave generalization by matching one tone's fundamental to another's second harmonic?=C2=A0 This would be a better w= ay to get at pitch height versus chroma, perhaps.<br> &gt;<br> &gt; Dick<br> &gt;<br> &gt;<br> &gt; On Sat, Sep 24, 2016 at 12:59 AM, Alain de Cheveigne &lt;<a moz-do-not-send=3D"true" href=3D"mailto:alain.de.cheveigne@xxxxxxxx">alain.de.chev= eigne@xxxxxxxx</a>&gt; wrote:<br> &gt; Hi Ani,<br> &gt;<br> &gt; Octave =E2=80=9Cequivalence=E2=80=9D is an emergent = property of both pattern-matching and autocorrelation models of pitch. All harmonics of the tone at the octave belong to the harmonic series of the lower tone.=C2=A0 Likewise autocorrelation peaks of the lower tone coincide with peaks of the tone at the octave.=C2=A0 Some neural instantiations of these models are Shihab Shamma=E2=80=99= s harmonic template model, or Cariani=E2=80=99s work on autocorrelation (based on Licklider=E2=80=99s ideas), and= there are many others.=C2=A0 Whether or not any specific model = is supported by anatomical or electrophysiological data is less clear.<br> &gt;<br> &gt; Actually =E2=80=9Cequivalence=E2=80=9D is a misnomer= . The relation is not commutative: the harmonics of the lower tone do not all belong to the harmonic series of the octave.=C2=A0 Likewise peaks of the autocorrelation of the octave tone are not all peaks of the lower tone.=C2=A0 Thus these mod= els would predict an asymmetry in the perceptual similarity between octaves (i.e. an octave tone =E2=80=9Cresembles=E2= =80=9D the lower tone but not vice-versa).=C2=A0 I don=E2=80=99t kno= w of any relevant behavioral data or music-theoretical results on this.<br> &gt;<br> &gt; Alain<br> &gt;<br> &gt; =E2=80=94<br> &gt; de Cheveign=C3=A9, A. (2005) Pitch perception models. In: Pitch - Neural coding and perception (Plack C, Oxenham A, eds). New York: Springer, 169-233. (<a moz-do-not-send=3D"true" href=3D"http://audition.ens.fr/adc/pdf/2005_pitch_SHAR.= pdf" rel=3D"noreferrer" target=3D"_blank">http://audition.en= s.fr/adc/<wbr>pdf/2005_pitch_SHAR.pdf</a>)<br> &gt; Shamma S, and Klein D (2000) The case of the missing pitch templates: how harmonic templates emerge in the early auditory system. J Acoust Soc Am 107:2631-2644.<br> &gt; Cariani PA, and Delgutte B (1996b) Neural correlates of the pitch of complex tones. II. Pitch shift, pitch ambiguity, phase-invariance, pitch circularity, rate-pitch and the dominance region for pitch. J Neurophysiol 76:1717-1734.<br> &gt; Licklider JCR (1951) A duplex theory of pitch perception (reproduced in Schubert 1979, 155-160). Experientia 7:128-134.<br> &gt;<br> &gt;<br> &gt; &gt; On 23 Sep 2016, at 13:06, Patel, Aniruddh D. &lt;<a moz-do-not-send=3D"true" href=3D"mailto:a.patel@xxxxxxxx">a.patel@xxxxxxxx</a>= &gt; wrote:<br> &gt; &gt;<br> &gt; &gt; Dear List,<br> &gt; &gt;<br> &gt; &gt; Is anyone aware on theoretical or empirical papers on the neural mechanisms of octave equivalence in auditory perception?<br> &gt; &gt;<br> &gt; &gt; Interestingly, recent works suggests that songbirds may not perceive octave equivalence:<br> &gt; &gt;<br> &gt; &gt; Hoeschele, M., Weisman, R. G., Guillette, L. M., Hahn, A. H., &amp; Sturdy, C. B. (2013). Chickadees fail standardized operant tests for octave equivalence. Animal cognition, 16(4), 599-609.<br> &gt; &gt;<br> &gt; &gt; Thanks,<br> &gt; &gt;<br> &gt; &gt; Ani Patel<br> &gt; &gt;<br> &gt; &gt; Aniruddh D. Patel<br> &gt; &gt; Professor<br> &gt; &gt; Dept. of Psychology<br> &gt; &gt; Tufts University<br> &gt; &gt; 490 Boston Ave.<br> &gt; &gt; Medford, MA 02155<br> &gt; &gt;<br> &gt; &gt; Senior Fellow<br> &gt; &gt; Canadian Institute for Advanced Research (CIFAR)<br> &gt; &gt; Azrieli Program in Brain, Mind, &amp; Consciousness<br> &gt; &gt;<br> &gt; &gt; <a moz-do-not-send=3D"true" href=3D"mailto:a.patel@xxxxxxxx">a.patel@xxxxxxxx</a>= <br> &gt; &gt; <a moz-do-not-send=3D"true" href=3D"http://ase.tufts.edu/psychology/people/patel/" rel=3D"noreferrer" target=3D"_blank">http://ase.tufts.e= du/<wbr>psychology/people/patel/</a><br> &gt;<br> <br> </div> </div> </blockquote> </div> <br> </div> </blockquote> <br> </body> </html> --------------45B4BA9FA07D68D579A52968--


This message came from the mail archive
/var/www/html/postings/2016/
maintained by:
DAn Ellis <dpwe@ee.columbia.edu>
Electrical Engineering Dept., Columbia University