Subject: [AUDITORY] CHiME 2023 Challenge - call for proposals / deadline 26th Sept From: Jon Barker <00000196bd06e182-dmarc-request@xxxxxxxx> Date: Tue, 12 Jul 2022 11:49:28 +0100--000000000000dfcab505e3996cf1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable *CHiME 2023 Challenge - Call for Proposals**https://www.chimechallenge.org <https://www.chimechallenge.org/>* Submission deadline - 26 Sept 2022 --- CHiME is a challenge series whose purpose is to produce scientific advances in the field of distant microphone speech processing. The challenge=E2=80= =99s six previous iterations from 2011 until 2020 have resulted in major improvements in word error rate and diarisation error rate for single-speaker voice commands in various environments and for multi-speaker conversations in homes. These six previous iterations have been centrally organised. We now wish to introduce a more open model, where the annual CHiME Challenge features independent tasks organised by teams who work within a schedule defined by the CHiME Steering Group. Teams will be responsible for managing the tasks, i.e., providing data and instructions, scoring submissions and results, etc. The CHiME Steering Group will then work to support teams in the development of their task. The Steering Group will also organise a CHiME workshop where the tasks will be presented. The CHiME Steering Group *is now inviting task proposals* for the CHiME 2023 Challenge. Proposed tasks will be *evaluated according to the following criteria*: - relevance to the CHiME goals - methodology - ie. likelihood to lead to robust and novel scientific findings - accessibility - i.e. how easy is it for teams to engage with - feasibility - likelihood to complete on schedule, risk management - reproducibility - e.g. openness of data, baseline - diversity - amongst organisers and expected participants, e.g. academia vs industry, geography, gender etc. We wish to foster a collaborative proposal process that minimises overlap between proposals. To this end, if you are considering proposing a task, please sign up to the CHiME mailing list and feel free to discuss your plans. Or if you wish information to be shared more privately, i.e., amongst other bidders only, then you may share details or initial plans with the CHiME Steering Group who will then share with others whose plans may overlap. *Proposal* Task bidders should submit a task proposal for review by the Steering Group. The proposal should be a maximum of two pages (pdf format preferred) including the following information: - Task name - Coordinators - Keywords (e.g. enhancement, diarization, speaker recognition, etc) - Definition (one sentence) - Short description (incl. research question the task is tackling) - Dataset description: development, evaluation (short description, how much data is already available and prepared, how long would it - take to prepare the rest, mention if you allow external data/transfer learning or not) - Evaluation method / metric - Baseline system (brief description, planned method if you do not have one from a previous challenge) - List of expected participants - Contact person (for main communication, website) *Submission* The proposal should be sent to the CHiME Steering Group ( chimech...@xxxxxxxx <https://groups.google.com/>) by 26th September. The Steering Group will review the proposals and provide feedback by 10th October. In case task amendments are requested, the task acceptance decision will be finalized by 4th November. *Important dates* - 26 Sept 2022 - Submission of task proposals - 10 Oct 2022 - Feedback from Steering Group - 21 Oct 2022 - Resubmission of conditionally accepted proposals - 4 Nov 2022 - Notification of acceptance - 1 Feb 2023 - Challenge opening - 30 June 2023 - Challenge Submission deadline - 25 Aug 2023 - Interspeech satellite workshop (details TBC) For further information visit https://www.chimechallenge.org *CHiME Steering Group * - Jon Barker Univ. of Sheffield, UK - Emmanuel Vincent Inria, France - Shinji Watanabe Carnegie Mellon Univ., USA - Michael Mandel CUNY/META, USA - Marc Delcroix NTT, Japan - Leibny Paola Garcia Perera Johns Hopkins Univ., USA --000000000000dfcab505e3996cf1 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,Ro= botoDraft,Helvetica,Arial,sans-serif;font-size:14px"><b>CHiME 2023 Challeng= e - Call for Proposals<br class=3D"gmail-Apple-interchange-newline"></b><b>= <a href=3D"https://www.chimechallenge.org/" target=3D"_blank" rel=3D"nofoll= ow" style=3D"text-decoration-line:none;color:rgb(26,115,232)">https://www.c= himechallenge.org</a></b></div><div style=3D"color:rgba(0,0,0,0.87);font-fa= mily:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">Submissi= on deadline - 26 Sept 2022</div><div style=3D"color:rgba(0,0,0,0.87);font-f= amily:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">---</di= v><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helve= tica,Arial,sans-serif;font-size:14px"><br></div><div style=3D"color:rgba(0,= 0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-si= ze:14px">CHiME is a challenge series whose purpose is to produce scientific= advances in the field of distant microphone speech processing. The challen= ge=E2=80=99s six previous iterations from 2011 until 2020 have resulted in = major improvements in word error rate and diarisation error rate for single= -speaker voice commands in various environments and for multi-speaker conve= rsations in homes. These six previous iterations have been centrally organi= sed.</div><br style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraf= t,Helvetica,Arial,sans-serif;font-size:14px"><div style=3D"color:rgba(0,0,0= ,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:= 14px">We now wish to introduce a more open model, where the annual CHiME Ch= allenge features independent tasks organised by teams who work within a sch= edule defined by the CHiME Steering Group. Teams will be responsible for ma= naging the tasks, i.e., providing data and instructions, scoring submission= s and results, etc. The CHiME Steering Group will then work to support team= s in the development of their task. The Steering Group will also organise a= CHiME workshop where the tasks will be presented.</div><br style=3D"color:= rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;= font-size:14px"><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,Rob= otoDraft,Helvetica,Arial,sans-serif;font-size:14px">The CHiME Steering Grou= p=C2=A0<b>is now inviting task proposals</b>=C2=A0for the CHiME 2023 Challe= nge.=C2=A0</div><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,Rob= otoDraft,Helvetica,Arial,sans-serif;font-size:14px"><br></div><div style=3D= "color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans= -serif;font-size:14px">Proposed tasks will be=C2=A0<b>evaluated according t= o the following criteria</b>:</div><br style=3D"color:rgba(0,0,0,0.87);font= -family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"><div = style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Ar= ial,sans-serif;font-size:14px">- relevance to the CHiME goals</div><div sty= le=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial= ,sans-serif;font-size:14px">- methodology - ie. likelihood to lead to robus= t and novel scientific findings</div><div style=3D"color:rgba(0,0,0,0.87);f= ont-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- = accessibility - i.e. how easy is it for teams to engage with</div><div styl= e=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,= sans-serif;font-size:14px">- feasibility - likelihood to complete on schedu= le, risk management</div><div style=3D"color:rgba(0,0,0,0.87);font-family:R= oboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- reproducibil= ity - e.g. openness of data, baseline</div><div style=3D"color:rgba(0,0,0,0= .87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14= px">- diversity - amongst organisers and expected participants, e.g. academ= ia vs industry, geography, gender etc.</div><br style=3D"color:rgba(0,0,0,0= .87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14= px"><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Hel= vetica,Arial,sans-serif;font-size:14px">We wish to foster a collaborative p= roposal process that minimises overlap between proposals. To this end, if y= ou are considering proposing a task, please sign up to the CHiME mailing li= st and feel free to discuss your plans. Or if you wish information to be sh= ared more privately, i.e., amongst other bidders only, then you may share d= etails or initial plans with the CHiME Steering Group who will then share w= ith others whose plans may overlap.</div><br style=3D"color:rgba(0,0,0,0.87= );font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"= ><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvet= ica,Arial,sans-serif;font-size:14px"><b>Proposal</b></div><br style=3D"colo= r:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-seri= f;font-size:14px"><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,R= obotoDraft,Helvetica,Arial,sans-serif;font-size:14px">Task bidders should s= ubmit a task proposal for review by the Steering Group. The proposal should= be a maximum of two pages (pdf format preferred) including the following i= nformation:</div><br style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,Rob= otoDraft,Helvetica,Arial,sans-serif;font-size:14px"><div style=3D"color:rgb= a(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;fon= t-size:14px">- Task name</div><div style=3D"color:rgba(0,0,0,0.87);font-fam= ily:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- Coordin= ators</div><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDr= aft,Helvetica,Arial,sans-serif;font-size:14px">- Keywords (e.g. enhancement= , diarization, speaker recognition, etc)</div><div style=3D"color:rgba(0,0,= 0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size= :14px">- Definition (one sentence)</div><div style=3D"color:rgba(0,0,0,0.87= );font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"= >- Short description (incl. research question the task is tackling)</div><d= iv style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica= ,Arial,sans-serif;font-size:14px">- Dataset description: development, evalu= ation (short description, how much data is already available and prepared, = how long would it - take to prepare the rest, mention if you allow external= data/transfer learning or not)</div><div style=3D"color:rgba(0,0,0,0.87);f= ont-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- = Evaluation method / metric</div><div style=3D"color:rgba(0,0,0,0.87);font-f= amily:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- Basel= ine system (brief description, planned method if you do not have one from a= previous challenge)</div><div style=3D"color:rgba(0,0,0,0.87);font-family:= Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- List of exp= ected participants</div><div style=3D"color:rgba(0,0,0,0.87);font-family:Ro= boto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- Contact perso= n (for main communication, website)</div><br style=3D"color:rgba(0,0,0,0.87= );font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"= ><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvet= ica,Arial,sans-serif;font-size:14px"><b>Submission</b></div><br style=3D"co= lor:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-se= rif;font-size:14px"><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto= ,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">The proposal should= be sent to the CHiME Steering Group (<a href=3D"https://groups.google.com/= " rel=3D"nofollow" style=3D"text-decoration-line:none;color:rgb(26,115,232)= ">chimech...@xxxxxxxx</a>) by 26th September. The Steering Group will revi= ew the proposals and provide feedback by 10th October. In case task amendme= nts are requested, the task acceptance decision will be finalized by 4th No= vember.</div><br style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoD= raft,Helvetica,Arial,sans-serif;font-size:14px"><div style=3D"color:rgba(0,= 0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-si= ze:14px"><b>Important dates</b></div><br style=3D"color:rgba(0,0,0,0.87);fo= nt-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"><di= v style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,= Arial,sans-serif;font-size:14px">- 26 Sept 2022 - Submission of task propos= als</div><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraf= t,Helvetica,Arial,sans-serif;font-size:14px">- 10 Oct 2022 - Feedback from = Steering Group</div><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto= ,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- 21 Oct 2022 - Res= ubmission of conditionally accepted proposals</div><div style=3D"color:rgba= (0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font= -size:14px">- 4 Nov 2022 - Notification of acceptance</div><div style=3D"co= lor:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-se= rif;font-size:14px">- 1 Feb 2023 - Challenge opening</div><div style=3D"col= or:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-ser= if;font-size:14px">- 30 June 2023 - Challenge Submission deadline</div><div= style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,A= rial,sans-serif;font-size:14px">- 25 Aug 2023 - Interspeech satellite works= hop (details TBC)</div><br style=3D"color:rgba(0,0,0,0.87);font-family:Robo= to,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"><div style=3D"col= or:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-ser= if;font-size:14px">For further information visit=C2=A0<a href=3D"https://ww= w.chimechallenge.org/" target=3D"_blank" rel=3D"nofollow" style=3D"text-dec= oration-line:none;color:rgb(26,115,232)">https://www.chimechallenge.org</a>= </div><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,RobotoDraft,H= elvetica,Arial,sans-serif;font-size:14px"><br></div><div style=3D"color:rgb= a(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;fon= t-size:14px"><b>CHiME Steering Group=C2=A0</b></div><div style=3D"color:rgb= a(0,0,0,0.87);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;fon= t-size:14px"><b><br></b></div><div style=3D"color:rgba(0,0,0,0.87);font-fam= ily:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">- Jon Bar= ker Univ. of Sheffield, UK<br>- Emmanuel Vincent Inria, France<br>- Shinji = Watanabe Carnegie Mellon Univ., USA<br>- Michael Mandel CUNY/META, USA<br>-= Marc Delcroix NTT, Japan<br>- Leibny Paola Garcia Perera Johns Hopkins Uni= v., USA<br></div><div style=3D"color:rgba(0,0,0,0.87);font-family:Roboto,Ro= botoDraft,Helvetica,Arial,sans-serif;font-size:14px"><br></div><div dir=3D"= ltr" class=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div dir= =3D"ltr"><div dir=3D"ltr"><br><div><br></div></div></div></div></div> --000000000000dfcab505e3996cf1--