Re: [AUDITORY] apps for web-based listening tests

[Sam Mathias <samuel.mathias@xxxxxxxxx>]

Gin Best et al. created this extremely helpful wiki on the topic of remote psychoacoustical testing: https://www.spatialhearing.org/remotetesting/

I used this resource and others to make a decision for our lab. We went with Gorilla (https://gorilla.sc/), which we chose after surveying the available options because:

1. It was not self-hosted, so we didn't have to set up our own server.
2. Many simple tests can be created without code. We had ~20 tests to deploy quickly, and didn't have the time/manpower to learn a new web framework.
3. Easily presents pre-generated audio, video, and images.
4. Reasonably cheap, $1-2 per participant per experiment, and experiments can be many sessions.
5. We know some folks who are also using it and they seem happy enough.
6. They have a helpful, responsive support team.
7. They have published some of their data on reaction times.

Potential disadvantages:

1. Suitable for simple designs (e.g., 2AFC w/ method of constant stimuli), perhaps not for others (e.g., staircases).
2. Data munging and analysis must be done offline.
3. While you can add your own _javascript_ for special functionality, their API seems a bit clunky and limited.
4. We've not actually rolled out our studies yet. Perhaps my opinion might change once we've collected real data.

Hope this is helpful.

On Wed, 13 Jan 2021 at 03:46, Borys Kowalewski <borys.k@xxxxxxxxx> wrote:

Hello Jan,

Good to hear from you!

For paired comparisons, ABX etc. you might find SenseLabOnline interesting. It allows you to create a multidimensional design and prepare a simple graphical summary. You can also download the raw data in a JSON file for further analysis. However, it is very much a quality- and preference-evaluation tool, and except for the ABX it does not support the typical “performance-based” n-AFC tests with wrong and correct answers. Adaptive procedures are not an option either, since all the tests require pre-loading of wave files.

Hopefully other list members can suggest viable alternatives :)

All best,

Borys

On Wed, Jan 13, 2021 at 06:23 Jan Felcyn <janaku@xxxxxxxxxx> wrote:

Dear List!

 

I am looking for some web-based apps which allow to create listening tests. By creating listening tests I mean rather simple approach – like e.g. tests from Music Lab. Just playin’ stereo audio files, gathering responses and aggregate them in one file. One important feature is that it should be possible to create psychoacoustic tests like pair comparisons, 2AFS and so on.

 

Do you know any web-based platform for such thing? I’ve heard about BRAMS but never used it. I know Python and I know that I can use Django, but maybe there is something already prepared for such tests?

 

Thanks in advance for all comments!

 

Regards

 

---

Jan Felcyn PhD

Chair of Acoustics,

Adam Mickiewicz University,

Poznań, Poland