Re: Criteria for sound design in web applications

[John Neuhoff <jneuhoff@xxxxxxxxxxx>]

Dear Philipp, 

Scott Lipscomb has done some related work in this area in film (see
references below). I would also argue that this topic does fit quite well
within the realm of auditory display.  Stephen Brewster has presented A/V
work in this area at recent auditory display meetings (ICAD).  The
proceedings are online at www.icad.org. 

Lipscomb, S.D. (1997).  Perceptual measures of visual and auditory cues in
film music.  Journal of the Acoustical Society of America, 101(5, ii), p.
3190.

Lipscomb, S.D. (1995).  Cognition of musical and visual accent structure
alignment in film and animation.  In D. Wessel's (Ed.) Proceedings of the
Conference of the Society for Music Perception and Cognition, 35.

Lipscomb, S.D. & Kendall R.A. (1994).  Perceptual judgment of the
relationship between musical and visual components in film.
Psychomusicology, 13(1), 60-98.

Walker, A. & Brewster, S. (2001). SITTING TOO CLOSE TO THE SCREEN CAN BE BAD
FOR YOUR EARS: A STUDY OF AUDIO-VISUAL LOCATION DISCREPANCY DETECTION UNDER
DIFFERENT VISUAL PROJECTIONS. Proceedings of the 2001 International
Conference on Auditory Display, Espoo, Finland, July 29-August 1, 2001

-John
________________________________
John G. Neuhoff
Department of Psychology
The College of Wooster 
Wooster, OH 44691
Phone: 330-263-2475 
Fax: 928-244-5577
http://jneuhoff.com

************************
Look for:
"Ecological Psychoacoustics"
from Academic Press June, 2004
http://www.jneuhoff.com/ecopsyc.htm
************************************


> -----Original Message-----
> From: AUDITORY Research in Auditory Perception 
> [mailto:AUDITORY@LISTS.MCGILL.CA] On Behalf Of Philipp C. Jugert
> Sent: Thursday, November 20, 2003 10:06 AM
> To: AUDITORY@LISTS.MCGILL.CA
> Subject: Criteria for sound design in web applications
> 
> 
> Hello,
> 
> I am looking for research on audiovisual integration in web 
> applications.
> We are trying to develop a general framework for designing 
> sound and music
> for websites. I suppose this is different from the topic of auditory
> display (auditory icons, earcons, sonification) which has already been
> covered in great detail. We are looking for an optimal 
> congruence between
> visual and auditory cues. There're also more fundamental 
> questions in terms
> of cognitive processing. How is a feeling of congruence 
> established in a
> subject's mind? What is the emotional impact of internet 
> sound? What is the
> use, what are the goals of using sound in web applications? 
> What are the
> personal and situational determinants for the use and acceptance of
> internet sound? These are some questions to begin with. (I am 
> NOT looking
> for technical device on programing, etc.)
> 
> Any contribution to the matter would be highly appreciated.
> 
> Regards,
> Philipp
>