Subject: Re: [AUDITORY] Registered reports From: Gaston Hilkhuysen <ghilkhuysen@xxxxxxxx> Date: Tue, 5 Jun 2018 09:24:22 +0100 List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>--0000000000000d4d46056de0c795 Content-Type: text/plain; charset="UTF-8" Dear Christine, Thank you very much for expressing your opinion. From your wording, I deduce that the topic holds your interest. But I was wondering whether you would be willing to provide the reasoning leading to your opinion. I think this might open up a discussion, which I assume the auditory list is al about. I can see Mrs (!) Tim Schoof's (PhD) point about what I tend to call 'data mining'. On the other side, stringent methodology and subsequent analysis might further reduce creativity in science. Looking forward to an interesting discussion, Yours, -Gaston. On 5 June 2018 at 08:47, julienbesle <julienbesle@xxxxxxxx> wrote: > Dear Mrs Rankovic, > > I think you may have misread Mr Schoof's email. It says that if the > pre-registration documents make it through peer-review, they are " > *provisionally* accepted for publication". I don't think this excludes > rejecting the manuscript if the subsequent data collection or analysis is > of poor quality. In fact, as this page <https://cos.io/rr/> illustrates, > manuscripts can still be rejected at the second stage of review (which > happens after the data have been collected and analyzed). > Pre-registration helps tackle important, and sometimes underestimated, > problems in scientific publishing, namely lack of replication, selective > reporting and publication bias, and shouldn't be dismissed offhand. > > All the best, > > Mr Besle > > > > On 04/06/2018 14:51, Christine Rankovic wrote: > > Mr. Schoof: > > > > It is beyond ridiculous to accept partial manuscripts for publication. > > Christine Rankovic, PhD > > Scientist, Speech and Hearing > > Newton, MA USA > > rankovic@xxxxxxxx > > > > > > *From:* AUDITORY - Research in Auditory Perception [ > mailto:AUDITORY@xxxxxxxx <AUDITORY@xxxxxxxx>] *On Behalf Of > *Schoof, Tim > *Sent:* Monday, June 04, 2018 4:06 AM > *To:* AUDITORY@xxxxxxxx > *Subject:* Registered reports > > > > Dear list, > > > > I'm going to try and get hearing science journals to start offering > registered reports. These reports are basically peer-reviewed > pre-registration documents where you outline your methods and proposed > analyses. If this document makes it through peer-review, the manuscript is > provisionally accepted for publication. This process should reduce certain > questionable research practices, such as selective reporting of results and > publication bias. If you're sceptical about registered reports, the Center > for Open Science has compiled a nice FAQ list that might address some of > your concerns: https://cos.io/rr/ > > > > I think this is the direction science is going in now and it would be > great if hearing science joined in. I plan to contact as many hearing > science journals as possible. I'm compiling a list of journals to contact. > Please add to this list if I'm missing anything: > https://tinyurl.com/yaf9r7bk. I don't think any of these journals offer > (or are in the process of offering) registered reports yet, but correct me > if I'm wrong. > > > > If you agree that registered reports are a good idea and want to sign the > letter I intend to send (see here for a template: > https://osf.io/3wct2/wiki/Journal%20Requests/), let me know and I'll add > you to the list. And please spread the word of course. The more people > agree, the more likely it is we can get some of these journals on board! > > > > Best, > > > Tim Schoof > > > > -- > > Research Associate > > UCL Speech, Hearing and Phonetic Sciences > > > > Chandler House > > 2 Wakefield Street > > London WC1N 1PF > > United Kingdom > > > > > -- > ------------------------------------- > Julien Besle > Farha Building > El Kalaa Street > Al Manara > Beirut > Lebanon > > tel: +961 78 980 317 > ------------------------------------- > > -- Gaston Hilkhuysen Research Associate UCL Speech, Hearing and Phonetic Sciences Chandler House 2 Wakefield Street London WC1N 1PF *PLEASE NOTE* UCL restrictive data-protection policy prohibits usage of any other email service than live@xxxxxxxx and additionally requires users to crypt their personal portable devices if these have access to the UCL email system. Consequently messages sent to G.Hilkhuysen@xxxxxxxx will be monitored sparsely and during working days only. If your message demands prompt response, please use my private email account: GHilkhuysen@xxxxxxxx --0000000000000d4d46056de0c795 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>Dear Christine,</div><div><br></div><div>Thank you ve= ry much for expressing your opinion. From your wording, I deduce that the t= opic holds your interest. But I was wondering whether you would be willing = to provide the reasoning leading to your opinion. I think this might open u= p a discussion, which I assume the auditory list is al about.=C2=A0 <br></d= iv><div>I can see Mrs (!) Tim Schoof's (PhD) point about what I tend to= call 'data mining'.=C2=A0 On the other side, stringent methodology= and subsequent analysis might further reduce creativity in science.</div><= div><br></div><div>Looking forward to an interesting discussion,</div><div>= <br></div><div>Yours,</div><div>-Gaston.<br></div></div><div class=3D"gmail= _extra"><br><div class=3D"gmail_quote">On 5 June 2018 at 08:47, julienbesle= <span dir=3D"ltr"><<a href=3D"mailto:julienbesle@xxxxxxxx" target=3D"_= blank">julienbesle@xxxxxxxx</a>></span> wrote:<br><blockquote class=3D"= gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-= left:1ex"> =20 =20 =20 <div text=3D"#000000" bgcolor=3D"#FFFFFF"> <div class=3D"m_7650963755614386523moz-cite-prefix">Dear Mrs Rankovic,<= br> <br> I think you may have misread Mr Schoof's email. It says that if the pre-registration documents make it through peer-review, they are "<b>provisionally</b> accepted for publication". I don&= #39;t think this excludes rejecting the manuscript if the subsequent data collection or analysis is of poor quality. In fact, as <a href=3D"htt= ps://cos.io/rr/" target=3D"_blank">this page</a> illustrates, manuscripts can still be rejected at the second stage of review (which happens after the data have been collected and analyzed).<br> Pre-registration helps tackle important, and sometimes underestimated, problems in scientific publishing, namely lack of replication, selective reporting and publication bias, and shouldn't be dismissed offhand.<br> <br> All the best,<br> <br> Mr Besle<div><div class=3D"h5"><br> <br> <br> On 04/06/2018 14:51, Christine Rankovic wrote:<br> </div></div></div><div><div class=3D"h5"> <blockquote type=3D"cite"> =20 =20 =20 <div class=3D"m_7650963755614386523WordSection1"> <div> <div style=3D"border:none;border-top:solid #b5c4df 1.0pt;padding:= 3.0pt 0in 0in 0in"> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-fam= ily:"Calibri","sans-serif";color:#1f497d">Mr. Schoof:<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-fam= ily:"Calibri","sans-serif";color:#1f497d"><u></u>=C2=A0= <u></u></span></p> </div> </div> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d">It is beyond ridiculous to accept partial manuscripts for publication.<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d"> <u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d">Christine Rankovic, PhD<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d">Scientist, Speech and Hearing<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d">Newton, MA=C2=A0 USA<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d"><a class=3D"m_765= 0963755614386523moz-txt-link-abbreviated" href=3D"mailto:rankovic@xxxxxxxx= ion.com" target=3D"_blank">rankovic@xxxxxxxx</a><u></u><u></u></spa= n></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d"><u></u>=C2=A0<u><= /u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11.0pt;font-family:= "Calibri","sans-serif";color:#1f497d"><u></u>=C2=A0<u><= /u></span></p> <p class=3D"MsoNormal"><b><span style=3D"font-size:10.0pt;font-fami= ly:"Tahoma","sans-serif"">From:</span></b><span style= =3D"font-size:10.0pt;font-family:"Tahoma","sans-serif""= > AUDITORY - Research in Auditory Perception [<a class=3D"m_7650963755614386523moz-txt-link-freetext" href= =3D"mailto:AUDITORY@xxxxxxxx" target=3D"_blank">mailto:AUDITORY@xxxxxxxx= S.MCGILL.<wbr>CA</a>] <b>On Behalf Of </b>Schoof, Tim<br> <b>Sent:</b> Monday, June 04, 2018 4:06 AM<br> <b>To:</b> <a class=3D"m_7650963755614386523moz-txt-link-abbrev= iated" href=3D"mailto:AUDITORY@xxxxxxxx" target=3D"_blank">AUDITORY@xxxxxxxx= LISTS.MCGILL.CA</a><br> <b>Subject:</b> Registered reports<u></u><u></u></span></p> <p class=3D"MsoNormal"><u></u>=C2=A0<u></u></p> <div id=3D"m_7650963755614386523divtagdefaultwrapper"> <div> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black">Dear list,<u></u><u></u></span></p> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black"><u></u>=C2=A0<u></u></span></p> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black">I'm going to try and get hearing science journals to start offering registered reports. These reports are basically peer-reviewed pre-registration documents where you outline your methods and proposed analyses. If this document makes it through peer-review, the manuscript is provisionally accepted for publication. This process should reduce certain questionable research practices, such as=C2=A0selective reporting of results and publication bias. If you're sceptical about registered reports,=C2= =A0the Center for Open Science has compiled a nice FAQ list that might address some of your concerns: <a href=3D"https:= //cos.io/rr/" id=3D"m_7650963755614386523LPlnk151566" target=3D"_blank">htt= ps://cos.io/rr/</a><u></u><u></u></span></p> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black"><u></u>=C2=A0<u></u></span></p> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black">I think this is the direction science is going in now and it would be great if hearing science joined in. I plan to contact as many hearing science journals as possible. I'm compiling a list of journals to contact. Please add to this list if I'm missing anything: <a href=3D"https:= //tinyurl.com/yaf9r7bk" id=3D"m_7650963755614386523LPlnk940137" target=3D"_= blank">https://tinyurl.com/yaf9r7bk</a>. I don't think any of these journals offer (or are in th= e process of offering) registered reports yet, but correct me if I'm wrong.<u></u><u></u></span></p> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black"><u></u>=C2=A0<u></u></span></p> <p><span style=3D"font-family:"Calibri","sans-se= rif";color:black">If you agree that registered reports are a good idea and want to sign the letter I intend to send (see here for a template: <a href=3D"https://osf.io/3wct2/wiki/Journal%20Re= quests/" id=3D"m_7650963755614386523LPlnk473363" target=3D"_blank">https://= osf.io/3wct2/wiki/<wbr>Journal%20Requests/</a>), let me know and I'll add you to the list. And please spread the word of course. The more people agree, the more likely it is we can get some of these journals on board! <u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:black"><u></u>=C2=A0<u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:black">Best,<u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:black"><br> Tim Schoof<u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:black"><u></u>=C2=A0<u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">--</span><spa= n style=3D"font-family:"Calibri","sans-serif";color:bla= ck"><u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">Research Associate</span><span style=3D"font-family:"Calibri&qu= ot;,"sans-serif";color:black"><u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">UCL Speech, Hearing and Phonetic Sciences</span><span style=3D"= font-family:"Calibri","sans-serif";color:black"><u></u>= <u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:black"><u></u>=C2=A0<u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">Chandler House</span><span style=3D"font-family:"Calibri",= "sans-serif";color:black"><u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">2 Wakefield Street</span><span style=3D"font-family:"Cal= ibri","sans-serif";color:black"><u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">London WC1N 1PF</span><span style=3D"font-family:"Calibri&quo= t;,"sans-serif";color:black"><u></u><u></u></span></p> </div> <div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri= ","sans-serif";color:#757b80;background:white">United Kingdom</span><span style=3D"font-family:"Calibri"= ;,"sans-serif";color:black"><u></u><u></u></span></p> </div> <p class=3D"MsoNormal"><span style=3D"font-family:"Calibri&q= uot;,"sans-serif";color:black"><u></u>=C2=A0<u></u></span></p> </div> </div> </blockquote> <p><br> </p> </div></div><span class=3D"HOEnZb"><font color=3D"#888888"><pre class= =3D"m_7650963755614386523moz-signature" cols=3D"72">--=20 ------------------------------<wbr>------- Julien Besle Farha Building El Kalaa Street Al Manara Beirut Lebanon tel: +961 78 980 317 ------------------------------<wbr>------- </pre> </font></span></div> </blockquote></div><br><br clear=3D"all"><br>-- <br><div class=3D"gmail_sig= nature" data-smartmail=3D"gmail_signature"><div dir=3D"ltr"><div><div dir= =3D"ltr"><div>Gaston Hilkhuysen<br>Research Associate<br>UCL Speech, Hearin= g and Phonetic Sciences<br>Chandler House<br>2 Wakefield Street<br>London W= C1N 1PF<br><br></div><div><b>PLEASE NOTE</b></div><div>UCL restrictive data= -protection policy prohibits usage of any other=20 email service than live@xxxxxxxx and additionally requires users to crypt=20 their personal portable devices if these have access to the UCL email=20 system. Consequently messages sent to <a href=3D"mailto:G.Hilkhuysen@xxxxxxxx" target=3D"_blank">G.Hilkhuysen@xxxxxxxx= l.ac.uk</a> will=C2=A0be monitored sparsely and during working days only. If your=20 message demands prompt response, please use my private email account: <a href=3D"mailto:GHilkhuysen@xxxxxxxx" target=3D"_blank">GHilkhuysen@xxxxxxxx= l.com</a>.</div></div></div></div></div> </div> --0000000000000d4d46056de0c795--