Subject: Re: neurophysiological studies of the missing fundamental? From: Alain de Cheveigne <alain(at)LINGUIST.JUSSIEU.FR> Date: Tue, 19 Oct 1993 11:40:50 +0100>Does anyone know of any neurophysiological studies that have looked at >the phenomenon of the "missing fundamental"? Here's some stuff from my database. Specifically concerning the "missing fundamental", you should look at Evans (1978, 1983, 1986) and his discussion with Whitfield (1978, 1979, 1980), see also Moore (1980). Widening the topic a bit, "missing fundamental phenomena" can be explained if we suppose that the auditory system derives pitch from the period of discharge of auditory-nerve fibers that do not resolve individual partials (this period is the inverse of the missing fundamental), and/or from the shortest common super-period of fibers that do resolve partials (this common super-period is also the inverse of the missing fundamental). This idea seems to have been first proposed by Fletcher (1929, quoted by Schubert 1978). Licklider (1956, 1959, 1962) proposed a neural processing model to explain how this information could be extracted from the auditory nerve. Others have elaborated this model (Lyon 1984, 1986; Moore, 1982; van Noorden 1982; de Cheveigne, 1986; Lazzaro and Mead, 1989; Slaney 1990; Meddis and Hewitt 1988, 1991). Evidence for synchrony of discharge, needed by such mechanisms, can be found in early papers by Rose et al. (1967, 1968, 1969) and Kiang (1965). See Johnson (1980) for the frequency limits of synchrony. See Lagner (1981, 1983, 1992), Lagner and Schreiner (1988) and Schreiner and Lagner (1988) for evidence that might be interpreted as supporting Licklider's model. There's also lots of evidence for the related Jeffress model of binaural processing. Speech has rather little energy at the fundamental. In that sense, the physiological representation of speech F0 is relevant to your issue. See Delgutte (1984), Delgutte and Kiang (1984), Javel (1980), Kim and Leonard (1988), Miller and Sachs (1984), Young and Sachs (1979), Palmer et al. (1986). You might also look into work on the representation of the F0s of mixed vowels (Palmer 1988, 1990, 1992; de Cheveigne 1993; Meddis and Hewitt 1992) All this is rather biased in favor of time-domain processing and the Licklider model. Maybe someone else could provide more references in favor of other models? I hope this helps, Alain. --- de Cheveigne, A. (1986). "A pitch perception model", Proc. IEEE ICASSP, pp. 897-900. de Cheveigne, A. (1993). "Separation of concurrent harmonic sounds: Fundamental frequency estimation and a time-domain cancellation model of auditory processing.," JASA 93, pp. 3271-3290. Delgutte, B. (1984). "Speech coding in the auditory nerve: II. Processing schemes for vowel-like sounds," JASA 75, pp. 879-886. Delgutte, B. and N. Y.-S. Kiang. (1984). "Speech coding in the auditory nerve: I. Vowel-like sounds," JASA 75, pp. 866-878. Delgutte, B. and N. Y.-S. Kiang. (1984). "Speech coding in the auditory nerve: V. Vowels in background noise," JASA 75, pp. 908-918. Evans, E. F. (1986). Pitch and cochlear nerve fiber discharge patterns. In B. C. J. Moore, & R. D. Patterson (Ed.), Auditory frequency selectivity (pp. 253-264). Plenum Press. Evans, E. F. (1983). "Pitch and cochlear nerve fibre temporal discharge patterns," in Hearing-Physiological bases and psychophysics, edited by R. Klinke and R. Hartmann (Springer-Verlag, Berlin), pp. 140-146. Evans, E. F. (1978). "Place and time coding of frequency in the peripheral auditory system: Some physiological pros and cons," Audiology 17, pp. 369-420. Javel, E. (1980). "Coding of AM tones in the chinchilla auditory nerve: implications for the pitch of complex tones," JASA 68, pp. 133-146. Johnson, D. H. (1980). "The relationship between spike rate and synchrony in responses of auditory-nerve fibers to single tones," JASA 68, pp. 1115-1122. Kiang, N. Y.-S. (1965). "Discharge patterns of single fibers in the cat's auditory nerve", MIT research monograph 35, pp 154. Kim, D. O. and G. Leonard. (1988). "Pitch-period following response of cat cochlear nucleus neurons to speech sounds," in Basic issues in hearing, edited by H. Duifhuis, J. W. Horst and H. P. Wit (Academic Press, London), pp. 252-260. Langner, G. (1981). "Neuronal mechanisms for pitch analysis in the time domain," Exp. Brain Res. 44, pp. 450-454. Langner, G. (1983). "Evidence for neuronal periodicity detection in the auditory system of the guinea fowl: implications for pitch analysis in the time domain," Exp. Brain Res. 52, pp. 333-355. Langner, G. (1983). "Neuronal mechanisms for a periodicity analysis in the time domain," in Hearing-Physiological bases and psychophysics, edited by R. Klinke and R. Hartmann (Springer-Verlag, Berlin), pp. 334-341. Langner, G. (1992). "Periodicity coding in the auditory system," Hearing Research 60, pp. 115-142. Langner, G. and C. E. Schreiner. (1988). "Periodicity coding in the inferior colliculus of the cat. I. Neuronal mechanisms," J. Neurophysiol. 60, pp. 1799-1822. Lazzaro, J. and C. Mead. (1989). "Silicon modeling of pitch perception," Proc. Natl. Acad. Sci. USA 86, pp. 9597-9601. Licklider, J. C. R. (1956). "Auditory frequency analysis," in Information theory, edited by C. Cherry (Butterworth, London), pp. 253-268. Licklider, J. C. R. (1959). "Three auditory theories," in Psychology, a study of a science, edited by S. Koch (McGraw-Hill, New York), pp. 41-144. Licklider, J. C. R. (1962). "Periodicity pitch and related auditory process models," International Audiology 1, pp. 11-36. Lyon , R. F. and L. Dyer. (1986). "Experiments with a computational model of the cochlea", Proc. IEEE ICASSP, pp. Lyon, R. (1984). "Computational models of neural auditory processing", IEEE ICASSP, pp. 36.1.(1-4). Meddis, R. and M. Hewitt. (1988). "A computational model of low pitch judgement," in Basic issues in hearing, edited by H. Duifuis, J. W. Horst and H. P. Witt (Academic, London), pp. 148-153. Meddis, R. and M. J. Hewitt. (1991). "Virtual pitch and phase sensitivity of a computer model of the auditory periphery. I: pitch identification," JASA 89, pp. 2866-2882. Meddis, R. and M. J. Hewitt. (1991). "Virtual pitch and phase sensitivity of a computer model of the auditory periphery. II: phase sensitivity," JASA 89, pp. 2883-2894. Meddis, R. and M. J. Hewitt. (1992). "Modeling the identification of concurrent vowels with different fundamental frequencies," JASA 91, pp. 233-245. Miller, M. I. and M. B. Sachs. (1984). "Representation of voice pitch in discharge patterns of auditory-nerve fibers," Hearing Research 14, pp. 257-279. Moore, B. C. J. (1980). "Neural interspike intervals and pitch," Audiology 19, pp. 363-365. Moore, B. C. J. (1982). An introduction to the psychology of hearing (Academic Press, London). p. Moller, A. R. (1979). "Coding of complex sounds in the auditory nervous system," in Hearing mechanisms and speech, edited by O. Creutzfeldt, H. Scheich and C. Schzeiner (Springer-Verlag, Berlin), pp. 45-54. van Noorden, L. (1982). "Two channel pitch perception," in Music, mind, and brain, edited by M. Clynes (Plenum press, London), pp. 251-269. Palmer, A. R. (1988). "The representation of concurrent vowels in the temporal discharge patterns of auditory nerve fibers," in Basic issues in hearing, edited by H. Duifhuis, J. W. Horst and H. P. Wit (Academic Press, London), pp. 244-251. Palmer, A. R. (1990). "The representation of the spectra and fundamental frequencies of steady-state single- and double-vowel sounds in the temporal discharge patterns of guinea pig cochlear-nerve fibers," J. Acoust. Soc. Am. 88, pp. 1412-1426. Palmer, A. R., I. M. Winter and C. J. Darwin. (1986). "The representation of steady-state vowel sounds in the temporal discharge patterns of the guinea pig cochlear nerve and primarylike cochlear nucleus neurons," JASA 79, pp. 100-113. Palmer, A. R. (1992). "Segregation of the responses to paired vowels in the auditory nerve of the guinea-pig using autocorrelation," in Audition speech and language, edited by B. Schouten (Mouton-DeGruyter, Berlin), pp. (in press). Rose, J. E., J. F. Brugge, D. J. Anderson and J. E. Hind. (1967). "Phase-locked response to low-frequency tones in single auditory nerve fibers of the squirrel monkey," J.Neurophysiol. 30, pp. 769-793. Rose, J. E., J. F. Brugge, D. J. Anderson and J. E. Hind. (1968). "Patterns of activity in single auditory nerve fibres of the squirrel monkey," in Hearing mechanisms in vertebrates, edited by A. V. S. De Reuk and J. Knight (Churchill, London), pp. 144-168. Rose, J. E., J. F. Brugge, D. J. Anderson and J. E. Hind. (1969). "Some possible neural correlates of combination tones," J. Neurophysiol. 32, pp. 402-423. Rose, J. E., L. M. Kitzes, M. M. Gibson and J. E. Hind. (1974). "Observations on phase-sensitive neurons of anteroventral cochlear nucleus of the cat: nonlinearity of cochlear output," J. Neurophysiol. 37, pp. 218-253. Schreiner, C. E. and G. Langner. (1988). "Coding of temporal patterns in the central auditory nervous system," in Auditory function - Neurobiological bases of hearing, edited by G. M. Edelman, W. E. Gall and W. M. Cowan (Wiley, New York), pp. 337-361. Schreiner, C. E. and G. Langner. (1988). "Periodicity coding in the inferior colliculus of the cat. II. Topographical organization," J. Neurophysiol. 60, pp. 1823-1840. Schubert, E. (1978). "History of research on hearing," in Handbook of perception, edited by E. C. Carterette and M. P. Friedman (Academic Press, New York), pp. 41-80. Slaney. (1990). "A perceptual pitch detector", ICASSP-90, pp. 357-360. van Noorden, L. (1982). "Two channel pitch perception," in Music, mind, and brain, edited by M. Clynes (Plenum press, London), pp. 251-269. Young, E. D. and M. B. Sachs. (1979). "Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers," JASA 66, pp. 1381-1403. Whitfield, I. C. (1978). "The neural code," in Handbook of perception, vol IV, edited by E. C. Carterette and M. P. Friedman (Academic Press, New York), pp. 163-183. Whitfield, I. C. (1979). "Periodicity, pulse interval and pitch," Audiology 18, pp. 507-512. Whitfield, I. C. (1980). "Theory and experiment in so-called pulse-interval pitch," Audiology 20, pp. 86-88. --- ------------------------------------------------------------------ Alain de Cheveigne' phone: (33) (1) 44273633 fax: (33) (1) 44277919 e-mail: alain(at)linguist.jussieu.fr NeXT-format: nalain(at)linguist.jussieu.fr nihongo: jalain(at)linguist.jussieu.fr mail: Laboratoire de Linguistique Formelle, CNRS / Universite' Paris 7, case 7003, 2 place Jussieu, 75251 Paris CEDEX 05, FRANCE. ------------------------------------------------------------------