Subject: Re: [AUDITORY] Registered reports From: Les Bernstein <lbernstein@xxxxxxxx> Date: Wed, 6 Jun 2018 09:41:26 -0400 List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>--------------9C7BB95DBEB9D8C4FEF7800F Content-Type: text/html; charset="windows-1252" Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by edgeum1.it.mcgill.ca id w56DgKgu006620 <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dwindows-1252"> </head> <body text=3D"#000000" bgcolor=3D"#FFFFFF"> <font size=3D"-1" face=3D"Verdana">Thanks for your response.=A0 Note = that I mentioned a number of issues that I identify as problems and shortcomings and not just a single one.=A0 That the "results" section of a Stage 2 submission allows for "exploratory analysis" hardly addresses the issues I raised with regard to hypotheses, follow-up and control experiments, choice of PRIMARY statistical tests, and archival value.=A0 Furthermore, the "exploratory" analyses you cite are clearly considered subordinate to the pre-approved "confirmatory analyses."=A0 See Nosek and Lakens (2014).=A0 As I see it, that's unnecessarily restrictive.<br> <br> Yes, we do "</font><font size=3D"-1" face=3D"Verdana">move more like a carpenter trying to adapt and adjust things in real time."=A0 Registered reports ask that we plan most, if not all, of our measurements, cuts, and adjustments in advance. They are anathema to the process.<br> <br> I agree with Nilesh's comments, especially, "</font><font size=3D"-1" face=3D"Verdana">Aren't we, as researchers, possessed o= f sufficient integrity and ethics to present our research in the correct light? If this core value is missing, I fear no external policing is going to help."<br> <br> When the "controls" proposed for a system in order to address various ills degrade substantially the utility of that system, then the cure is worse than the disease.=A0 I, for one, am not in favor of the trade-off necessitated by registered reports.=A0 As Nilesh points out, if registered reports are not to be considered compulsory, then much (but certainly not all) of this is moot.<br> <br> For the record, I think there is little to suggest that people who incorrectly assign gender in these informal discussions might not pay the requisite attention to their scientific work.=A0 Comments suggesting that hardly advance the discourse.<br> <br> Les Bernstein <br> <br> <br> </font> <div class=3D"moz-cite-prefix">On 6/6/2018 2:09 AM, Massimo Grassi wrote:<br> </div> <blockquote type=3D"cite" cite=3D"mid:28254_1528266405_5B177EA4_28254_112_1_533f202b-ce6c-8e58-226e= -d515f154b519@xxxxxxxx">First of all I would like to thank Tim for the initiative. <br> <br> A few replies and comments: <br> - registered reports have the results section divided in the parts: the <br> "planned analysis" (those you discussed with editor and reviewers) and <br> the "new exploratory analysis". Therefore, I do not see the problem <br> risen by Les. <br> <br> - in my opinion registered reports rise the standard level of current <br> science. Registered reports (like a preregistration but even better) <br> reveal how limited is our ability to predict. It is difficult to predict <br> how the data will look like, what data point will be an outlier, whether <br> data should be analysed in this or that way. We teach to students that <br> the path of science is hypothetical deductive. In reality we move more <br> like a carpenter trying to adapt and adjust things in real time. <br> <br> - about the possible "uncontrolled dissemination of null results", I <br> think that (for science) the current uncontrolled dissemination of type <br> I errors is worse. <br> <br> A nice day to everybody from a summer-sunny Italy, <br> <br> m <br> <br> <blockquote type=3D"cite">Dear List, <br> <br> For this topic, I'll violate my rule of not posting replies here.=A0 I <br> agree with Ms. Rankovic.=A0 I sure did not miss the substance and detail <br> of Mr. Schoof's email.=A0 I also read over the information in the links. <br> Indeed, the proposed plan provides for a second review.=A0 It seems to me, <br> however, that the provisional acceptance is a key aspect of the <br> process.=A0 If it were the case that manuscripts were rejected upon second <br> review with substantial frequency, then the philosophy of the registered <br> report would be violated and the system would collapse.=A0 So, unless <br> there are egregious errors or flaws in the full manuscript, it seems <br> that it would be published.=A0 Note that, in this linked referenc= e <br> <a class=3D"moz-txt-link-rfc2396E" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__orca.cf.ac.uk_59475_1_AN2.pdf&d=3DDwIF-g&= ;c=3DEZxp_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953= G-STHGpPJm2-pYYYSPmTwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dG= ImHRwg&s=3DxRzBGFFamRFpRq-4vpkcn53I8ams157EIPZqLQYMQ4w&e=3D"><= https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__orca.cf.ac.uk_5947= 5_1_AN2.pdf&d=3DDwIF-g&c=3DEZxp_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9y= fotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPmTwJk3sWM&m=3DcIk_-c7= SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&s=3DxRzBGFFamRFpRq-4vpkcn53I8ams= 157EIPZqLQYMQ4w&e=3D></a>, publication is assumed to be <br> "guaranteed." <br> <br> In my opinion, the criticism found within the FAQ here <br> <a class=3D"moz-txt-link-rfc2396E" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwIF-g&c=3DEZxp_D7cDnouwj= 5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPm= TwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&s=3D6kZP= zct7RuQPCnXf4yq-j_iight0Mx1-rD1hGvqvaLE&e=3D"><https://urldefense.= proofpoint.com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwIF-g&c=3DEZx= p_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpP= Jm2-pYYYSPmTwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&a= mp;s=3D6kZPzct7RuQPCnXf4yq-j_iight0Mx1-rD1hGvqvaLE&e=3D></a>, that "The Registered Reports model is based on a <br> na=EFve conceptualisation of the scientific method." is well-founded! The <br> reply offered to counter that criticism is quite weak and unconvincing. <br> I would replace "scientific method" in that criticism with "the way good <br> science is done." <br> <br> Question 17 in Chambers et al. (2014-- linked above) provides an apt <br> example.=A0 In the process of conducting complex experiments, it is very <br> often the case that unexpected results lead to important follow-up or <br> control experiments.=A0 Chambers et al. handle this issue by proposing <br> that in Stage 1 of a registered report, contingencies be stated such <br> that "If A is observed, then we will..."=A0 That, of course, assumes that <br> one knows the decision tree in advance!=A0 In my experience, science <br> simply does not work that way. <br> <br> While I find the intent of registered reports to be laudable, in my <br> opinion, it substitutes one potential set of problems with another based <br> on a narrow view of how science proceeds.=A0 Indeed, one may have a <br> hypothesis to be tested and gather a set of data to address it only to <br> find that the results support a substantially altered view.=A0 Is that, <br> NECESSARILY, the dreaded "HARKing?"=A0 I think not.=A0 Scientific thought <br> and inquiry do not always proceed in a linear fashion.=A0 One cannot and <br> should not always know the precise questions or list of contingencies a <br> priori and be restricted to answering only those.=A0 Then there are <br> experiments in which there are no specific hypotheses.=A0 They ma= y be of <br> the form, "What is the effect of variable A on measurements of X?" <br> Assuming the question is non-trivial, those are often the most revealing <br> experiments because any outcome is of interest.=A0 There is no "positive" <br> or "negative."=A0 Sure, one can cast such experiments in terms of <br> hypotheses but doing so often involves a contrivance. <br> <br> Then there is the matter of "p-hacking" and what I would call <br> "statistics shopping."=A0 Indeed, it is a problem.=A0 Unexpected outcomes <br> and patterns of data in a complex experiment often require one to choose <br> the appropriate statistic after the fact. It is sometimes the correct <br> thing to do!=A0 Whether it is proper can and should be judged by reviewers <br> with the requisite expertise.=A0 Good peer-review should distinguish <br> between p-hacking and a rational choice that conveys information and <br> "truth."=A0 The notion that one can and should use only the statistic <br> decided upon in advance is unnecessary restrictive. <br> <br> Finally, there is the matter of archival value.=A0 According to Chambers <br> et al., "...if the rationale and methods are sound then the journal <br> should agree to publish the final paper regardless of the specific <br> outcome."=A0 It is often the case that rationale and methods are sound but <br> the data provide no substantial advance or archival value.=A0 I'm not sure <br> that "approving" a method and rationale and virtually guaranteeing <br> publication will afford the same level of judgment in terms of archival <br> value that is afforded by the current system. <br> <br> Les Bernstein <br> <br> -- <br> *Leslie R. Bernstein, Ph.D. **| *Professor <br> Depts. of Neuroscience and Surgery (Otolaryngology)| UConn School of <br> Medicine <br> 263 Farmington Avenue, Farmington, CT 06030-3401 <br> Office: 860.679.4622 | Fax: 860.679.2495 <br> <br> <br> <br> <br> <br> <br> <br> <a class=3D"moz-txt-link-rfc2396E" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwMFAg&c=3DEZxp_D7cDnouwj= 5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPm= TwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9qeDUDnFKUymDoKpI&s=3DvXqZ= BKaP1dUovPzwBwC5DalLCB6UxwKuM9x_SQCbw5I&e=3D"><https://urldefense.= proofpoint.com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwMFAg&c=3DEZx= p_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpP= Jm2-pYYYSPmTwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9qeDUDnFKUymDoKpI&a= mp;s=3DvXqZBKaP1dUovPzwBwC5DalLCB6UxwKuM9x_SQCbw5I&e=3D></a> <br> <br> On 6/4/2018 7:51 AM, Christine Rankovic wrote: <br> <blockquote type=3D"cite"> <br> Mr. Schoof: <br> <br> It is beyond ridiculous to accept partial manuscripts for publication. <br> <br> Christine Rankovic, PhD <br> <br> Scientist, Speech and Hearing <br> <br> Newton, MA=A0 USA <br> <br> <a class=3D"moz-txt-link-abbreviated" href=3D"mailto:rankovic@xxxxxxxx= rticulation.com">rankovic@xxxxxxxx</a> <br> <br> *From:*AUDITORY - Research in Auditory Perception <br> [<a class=3D"moz-txt-link-freetext" href=3D"mailto:AUDITORY@xxxxxxxx= TS.MCGILL.CA">mailto:AUDITORY@xxxxxxxx</a>] *On Behalf Of *Schoof,= Tim <br> *Sent:* Monday, June 04, 2018 4:06 AM <br> *To:* <a class=3D"moz-txt-link-abbreviated" href=3D"mailto:AUDI= TORY@xxxxxxxx">AUDITORY@xxxxxxxx</a> <br> *Subject:* Registered reports <br> <br> Dear list, <br> <br> I'm going to try and get hearing science journals to start offering <br> registered reports. These reports are basically peer-reviewed <br> pre-registration documents where you outline your methods and proposed <br> analyses. If this document makes it through peer-review, the <br> manuscript is provisionally accepted for publication. This process <br> should reduce certain questionable research practices, such <br> as=A0selective reporting of results and publication bias. If you're <br> sceptical about registered reports,=A0the Center for Open Science has <br> compiled a nice FAQ list that might address some of your concerns: <br> <a class=3D"moz-txt-link-freetext" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwIF-g&c=3DEZxp_D7cDnouwj= 5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPm= TwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&s=3D6kZP= zct7RuQPCnXf4yq-j_iight0Mx1-rD1hGvqvaLE&e=3D">https://urldefense.proo= fpoint.com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwIF-g&c=3DEZxp_D7= cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-= pYYYSPmTwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&s= =3D6kZPzct7RuQPCnXf4yq-j_iight0Mx1-rD1hGvqvaLE&e=3D</a> <br> <a class=3D"moz-txt-link-rfc2396E" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwMFAg&c=3DEZxp_D7cDnouwj= 5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPm= TwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9qeDUDnFKUymDoKpI&s=3DvXqZ= BKaP1dUovPzwBwC5DalLCB6UxwKuM9x_SQCbw5I&e=3D"><https://urldefense.= proofpoint.com/v2/url?u=3Dhttps-3A__cos.io_rr_&d=3DDwMFAg&c=3DEZx= p_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpP= Jm2-pYYYSPmTwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9qeDUDnFKUymDoKpI&a= mp;s=3DvXqZBKaP1dUovPzwBwC5DalLCB6UxwKuM9x_SQCbw5I&e=3D></a> <br> <br> I think this is the direction science is going in now and it would be <br> great if hearing science joined in. I plan to contact as many hearing <br> science journals as possible. I'm compiling a list of journals to <br> contact. Please add to this list if I'm missing anything: <br> <a class=3D"moz-txt-link-freetext" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__tinyurl.com_yaf9r7bk&d=3DDwIF-g&c=3DEZxp= _D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJ= m2-pYYYSPmTwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&am= p;s=3DFl55cQMuY6Cn7PFOEwuqgjqGAQtlsR7NYOdkaI_RRTk&e=3D">https://urlde= fense.proofpoint.com/v2/url?u=3Dhttps-3A__tinyurl.com_yaf9r7bk&d=3DDw= IF-g&c=3DEZxp_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2Gwel= GcMR4953G-STHGpPJm2-pYYYSPmTwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_P= Qgl784dGImHRwg&s=3DFl55cQMuY6Cn7PFOEwuqgjqGAQtlsR7NYOdkaI_RRTk&e=3D= </a> <br> <a class=3D"moz-txt-link-rfc2396E" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__tinyurl.com_yaf9r7bk&d=3DDwMFAg&c=3DEZxp= _D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJ= m2-pYYYSPmTwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9qeDUDnFKUymDoKpI&am= p;s=3Dsk2rFf3fImx-wI9S05uLc7WYgADb5BupEMAQvL3hz-0&e=3D"><https://u= rldefense.proofpoint.com/v2/url?u=3Dhttps-3A__tinyurl.com_yaf9r7bk&d=3D= DwMFAg&c=3DEZxp_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2Gw= elGcMR4953G-STHGpPJm2-pYYYSPmTwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9= qeDUDnFKUymDoKpI&s=3Dsk2rFf3fImx-wI9S05uLc7WYgADb5BupEMAQvL3hz-0&= e=3D></a>. <br> I don't think any of these journals offer (or are in the process of <br> offering) registered reports yet, but correct me if I'm wrong. <br> <br> If you agree that registered reports are a good idea and want to sign <br> the letter I intend to send (see here for a template: <br> <a class=3D"moz-txt-link-freetext" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__osf.io_3wct2_wiki_Journal-2520Requests_&d=3D= DwIF-g&c=3DEZxp_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2Gw= elGcMR4953G-STHGpPJm2-pYYYSPmTwJk3sWM&m=3DcIk_-c7SKniTJf2iixjaXS97xJ6= _PQgl784dGImHRwg&s=3Dr5scpjih3g7j40BYOnKUxciReSgJk5-gYiaotlV12wM&= e=3D">https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__osf.io_3wct2= _wiki_Journal-2520Requests_&d=3DDwIF-g&c=3DEZxp_D7cDnouwj5YEFHgXu= SKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPmTwJk3sWM= &m=3DcIk_-c7SKniTJf2iixjaXS97xJ6_PQgl784dGImHRwg&s=3Dr5scpjih3g7j= 40BYOnKUxciReSgJk5-gYiaotlV12wM&e=3D</a> <br> <a class=3D"moz-txt-link-rfc2396E" href=3D"https://urldefense.proofpoint.= com/v2/url?u=3Dhttps-3A__osf.io_3wct2_wiki_Journal-2520Requests_&d=3D= DwMFAg&c=3DEZxp_D7cDnouwj5YEFHgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2Gw= elGcMR4953G-STHGpPJm2-pYYYSPmTwJk3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9= qeDUDnFKUymDoKpI&s=3DG-jhAt3_0f5cPPX7aRpPgVfihZYm_ZTuPohnhVfxWFw&= e=3D"><https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__osf.io_3= wct2_wiki_Journal-2520Requests_&d=3DDwMFAg&c=3DEZxp_D7cDnouwj5YEF= HgXuSKoUq2zVQZ_7Fw9yfotck&r=3D2Pw2GwelGcMR4953G-STHGpPJm2-pYYYSPmTwJk= 3sWM&m=3DSr0Ep-Gx1c9KJlrgGBL4rmcUvd9qeDUDnFKUymDoKpI&s=3DG-jhAt3_= 0f5cPPX7aRpPgVfihZYm_ZTuPohnhVfxWFw&e=3D></a>), <br> let me know and I'll add you to the list. And please spread the word <br> of course. The more people agree, the more likely it is we can get <br> some of these journals on board! <br> <br> Best, <br> <br> <br> Tim Schoof <br> <br> -- <br> <br> Research Associate <br> <br> UCL Speech, Hearing and Phonetic Sciences <br> <br> Chandler House <br> <br> 2 Wakefield Street <br> <br> London WC1N 1PF <br> <br> United Kingdom <br> <br> </blockquote> <br> <br> <br> </blockquote> <br> </blockquote> <br> <br> <div class=3D"moz-signature">-- <br> <meta http-equiv=3D"content-type" content=3D"text/html; charset=3Dwindows-1252"> <title></title> <b><span style=3D"font-size:10.0pt;font-family:"Arial",sans-se= rif; mso-fareast-font-family:"Times New Roman \;color\:\#002048"">Leslie R. Bernstein, Ph.D. </span></b>= <b><span style=3D"font-size:10.0pt;font-family:"Arial",sans-serif; mso-fareast-font-family:"Times New Roman \;color\:\#585858"">| </span></b><span style=3D"font-size:10.0pt;font-family:"Arial",sans-serif;mso-fa= reast-font-family:"Times New Roman \;color\:\#585858"">Professor</span><span style=3D"mso-fareast-font-family: "Times New Roman""><o= :p></o:p></span><span style=3D"font-size:10.0pt;font-family:"Arial",sans-serif; mso-fareast-font-family:"Times New Roman \;color\:\#585858""><br> Depts. of Neuroscience and Surgery (Otolaryngology)| UConn School of Medicine </span><br> <span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858""></span><span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858"">263 Farmington Avenue, Farmington, CT 06030-3401</span><br> <span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858""></span><span style=3D"font-size:10.0pt;font-family:"Arial",sans-seri= f; mso-fareast-font-family:"Times New Roman \;color\:\#585858"">Office: 860.679.4622 | Fax: 860.679.2495<br> <br> <img alt=3D"" src=3D"cid:part1.DC231007.E3E39255@xxxxxxxx" height=3D"48" width=3D"125"><br> </span> </div> </body> </html> --------------9C7BB95DBEB9D8C4FEF7800F Content-Type: image/png; name="uconnhealth_stacked_blue_email.png" Content-ID: <part1.DC231007.E3E39255@xxxxxxxx> Content-Disposition: inline; filename="uconnhealth_stacked_blue_email.png" Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAAH0AAAAwCAMAAAALmIWlAAAAGXRFWHRTb2Z0d2FyZQBBZG9i ZSBJbWFnZVJlYWR5ccllPAAAADNQTFRFKzVYHCZM4eLn8PHzpKi30dTbaG+IlZqrs7fDWWB8 O0Nkd32UwsXPSlJwhoufDRhA////A68jmAAAABF0Uk5T/////////////////////wAlrZli AAACYklEQVR42uzY22KDIAwAUC7e6gjw/187gUC4OetaupflaTXKWSuBKNMuJptC+QMCP20a uPHBQCubBWU46K24uB7NfZ58ZqaMP8D8AEBHtT/goXnB8WPwBf8r1WYUXWxUOZobHcJXIMcf ONclmE4s0lrRzYBIOjvTjX5WV6YbP2ZQJ6TWjfiAbuYzHW7p+xpuolQrP83sjQ5nupnu6Lqa J92MbnSznulcfkBHpNXNY6y+c0JKnWX1eFeflQt5qcNESKnrQMrf6LSAXeiWkEoXdOU4nZBK xzPnoTohtW5ZZyK8W09Io6tYjyP1iDS6XbAeh815S0irS6zHUfXuB0Ok1S3W41AdEWh1/Nb7 UD1bWytd0LY4ThdnerYbBJ1taT5XBmy4J8mNnWagp5fbba6HeiTdneK6vNgoFj0EhyO4eSZT 6AlpdNXoNzqYi94GbIU0eqhHp3d5drRf4heZUo9Iq8vYptup6VB37H6m/W6m0hFpdaxH3/yK 9cHpVq5Zy59n2GMV/QxPGdV9NElPE9njyOozsfWWKq6j7bLuw97KPBnM/mX86//6n+tH/yLK P7AUXcyd80Lx53WnspB47ty5qKND1gLockfIFzHR7srpQ7X0+6GgHPNFXedPyaN1CPFli71z +ZBeTxbcI2RXxwOQj/lW/Ui610Z6gA4a32WRrssXYbO76V/Zy6FLnZVj/qCnqGcdZE1DeFKc ntWrMV/RZXCh7B/fpF/+8tQQx6J74y9/Oeuyrm75+Jyf8oKWH9CL1SYNJtJ91HTOAD2fdjPN 9UcsumwmDNYXqvPtOLa9pH8LMACnoV0siZAyOAAAAABJRU5ErkJggg== --------------9C7BB95DBEB9D8C4FEF7800F--