<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20120330//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd">
<!--<?xml-stylesheet type="text/xsl" href="article.xsl"?>-->
<article article-type="research-article" dtd-version="1.2" xml:lang="en" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<front>
<journal-meta>
<journal-id journal-id-type="issn">2767-0279</journal-id>
<journal-title-group>
<journal-title>Glossa Psycholinguistics</journal-title>
</journal-title-group>
<issn pub-type="epub">2767-0279</issn>
<publisher>
<publisher-name>eScholarship Publishing</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.5070/G601153</article-id>
<article-categories>
<subj-group>
<subject>Brief article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Prediction in the maze: Evidence for probabilistic pre-activation from the English <italic>a/an</italic> contrast</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Husband</surname>
<given-names>E. Matthew</given-names>
</name>
<email>matthew.husband@ling-phil.ox.ac.uk</email>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
</contrib-group>
<aff id="aff-1"><label>1</label>University of Oxford, UK</aff>
<pub-date publication-format="electronic" date-type="pub" iso-8601-date="2022-09-19">
<day>19</day>
<month>09</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>1</volume>
<issue>1</issue>
<elocation-id>7</elocation-id>
<permissions>
<copyright-statement>Copyright: &#x00A9; 2022 The Author(s)</copyright-statement>
<copyright-year>2022</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See <uri xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</uri>.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://glossapsycholinguistics.journalpub.escholarship.org/articles/10.5070/G601153/"/>
<abstract>
<p>The idea that comprehenders predict upcoming linguistic content has become core to many theories of language processing. Experimental studies exploiting morphosyntactic and phonotactic constraints on a word form preceding a high cloze target word have been key to underpinning predictive accounts of comprehension, but investigating these tight sequential contrasts with traditional behavioral methods is difficult. The <italic>maze task</italic>, with its more focal measure of incremental processing, may provide a cheap and easy methodology to study early cues to prediction. An experiment investigating the <italic>a/an</italic> contrast (<xref ref-type="bibr" rid="B5">DeLong, Urbach, &amp; Kutas, 2005</xref>; <xref ref-type="bibr" rid="B19">Nieuwland, et al., 2018</xref>) using A-maze (<xref ref-type="bibr" rid="B3">Boyce, Futrell, &amp; Levy, 2020</xref>) finds that unexpected articles, as well as nouns, elicit slower focal response times. Response times are also shown to be inversely related to noun cloze probabilities, with slower responders showing larger effects of expectation. This study demonstrates that the maze task can be sensitive to expectation and is a useful alternative methodology for investigating prediction in comprehension.</p>
</abstract>
</article-meta>
</front>
<body>
<sec>
<title>Introduction</title>
<p>The past two decades has seen a resurgence of interest in the idea that comprehenders routinely engage in prediction of upcoming linguistic content. Prediction is now often assumed to occur along all levels of linguistic representation, from semantics and morphosyntax to phonology/orthography, serving to facilitate the access and integration of bottom-up information into unfolding sentential and discourse representations.</p>
<p>A key observation supporting theories that comprehenders predict upcoming words comes from experimental research that exploits morphosyntactic and phonotactic constraints on the form of words that precede high cloze target words. DeLong, Urbach, and Kutas (<xref ref-type="bibr" rid="B5">2005</xref>) uses the phonotactic constraints of English indefinite articles to investigate probabilistic pre-activation of expected (high-cloze) nouns. They presented participants with highly constraining contexts like &#8220;<italic>The day was breezy so the boy went outside to fly&#8230;</italic>&#8221; and manipulated the article and noun so that the noun was either expected, <italic>a kite</italic>, or unexpected, <italic>an airplane</italic>. The amplitude of the N400 elicited by the preceding <italic>a/an</italic> articles was found to decrease as the cloze probability of nouns increased. Other ERP studies investigating morphosyntactic constraints (<xref ref-type="bibr" rid="B8">Foucart, et al., 2014</xref>; <xref ref-type="bibr" rid="B16">Martin, et al., 2018</xref>; <xref ref-type="bibr" rid="B20">Otten &amp; Van Berkum, 2009</xref>; <xref ref-type="bibr" rid="B25">Wicha, Moreno, &amp; Kutas, 2004</xref>), phonotactic constraints (Martin, et al., 2013), or both (<xref ref-type="bibr" rid="B12">Ito, et al., 2020</xref>) report evidence for pre-activation of target nouns on preceding articles. Although some studies have not successfully replicated these effects (<xref ref-type="bibr" rid="B13">Ito, Martin, &amp; Nieuwland, 2017</xref>; <xref ref-type="bibr" rid="B18">Nieuwland, Arkhipova, &amp; Rodr&#237;guez-G&#243;mez, 2020</xref>; <xref ref-type="bibr" rid="B19">Nieuwland, et al., 2018</xref>), taken together this research has underpinned theories of prediction in language comprehension by providing unambiguous evidence for predictive processes.</p>
<p>Critical to the success of some of these studies is the high temporal resolution and word-by-word presentation typical of ERP methodology in reading. This is particularly true for phonotactic/orthographic constraints which occur between adjacent words. These tight sequential constraints prevent researchers from investigating these phenomena with traditional incremental reading tasks. Self-paced reading is one of the most commonly used techniques and is relatively cheap, especially with recent innovations in online participant crowdsourcing and web-based stimulus delivery. However, it is difficult to isolate effects on a specific word due to well-known spillover effects which smear processing differences across multiple words (<xref ref-type="bibr" rid="B17">Mitchell, 1984</xref>; <xref ref-type="bibr" rid="B27">Witzel, Witzel, &amp; Forster, 2012</xref>). Eye movements in reading are also a poor measure. Short functional words are often skipped during reading and are likely available in parafoval preview, requiring very careful experimental manipulation to isolate effects on them (<xref ref-type="bibr" rid="B1">Balota, Pollatsek, &amp; Rayner, 1985</xref>; <xref ref-type="bibr" rid="B4">Cutter, Martin, &amp; Sturt, 2020</xref>).</p>
<p>Research on prediction has been held back by the lack of a cheap and easy behavioral methodology to study early cues to prediction error (cf. <xref ref-type="bibr" rid="B24">Van Berkum, et al., 2005</xref>). The maze task, however, offers an alternative incremental reading method that can address some of the potential shortcomings of the methods mentioned above (<xref ref-type="bibr" rid="B7">Forster, Guerrera, &amp; Elliot, 2009</xref>). In maze tasks, sentences are presented to participants as a sequence of choices between two alternatives. One alternative is the correct continuation of the sentence while the other is a distractor. Distractors are real words that are anomalous given current sentence context (G(rammaticality)-maze) or pseudowords (L(exicality)-maze). Maze tasks have been shown to deliver focal measures of processing difficulty, with effects occurring on their trigger word, that are comparable to self-paced reading and eye tracking (<xref ref-type="bibr" rid="B27">Witzel, Witzel, &amp; Forster, 2012</xref>; <xref ref-type="bibr" rid="B26">Witzel &amp; Forster, 2014</xref>).</p>
<p>Maze tasks have been difficult to implement because pairing a distractor word to each word in all sentence material was labor-intensive and prone to researcher error. Addressing these difficulties, Boyce, Futrell, and Levy (<xref ref-type="bibr" rid="B3">2020</xref>) used natural language processing to automate distractor selection, creating the A(uto)-maze. They demonstrated that the A-maze elicited focal reading time effects on the disambiguating word of three types of attachment ambiguities with online participants. A-Maze effects were comparable to G-maze and more sensitive than L-maze and self-paced reading.</p>
<p>Given that focal effects can be found with A-maze, A-maze response times might also isolate prediction error effects on expectation-mismatching article forms preceding unexpected nouns. As a participant-controlled continuous temporal measure, A-maze response times might also provide new information about predictive processing, e.g. via natural differences in participant&#8217;s comprehension speed. To investigate these possibilities, an A-maze task was conducted on high cloze probability sentence contexts manipulating noun predictability and the form their immediately preceding articles.</p>
</sec>
<sec>
<title>Experiment</title>
<sec sec-type="methods">
<title>Method</title>
<p><italic>Participants</italic>. 40 native UK English speakers (24 female, 14 male, 1 other; ages 18&#8211;71, avg.: 35, sd.: 14) were recruited on Prolific (<xref ref-type="bibr" rid="B21">Peer, et al., 2017</xref>) and paid &#163;5 for participation. One participant&#8217;s results did not transfer, leaving 39 participants for initial analysis.</p>
<p><italic>Items</italic>. 80 sentence contexts were combined with two possible continuations, an expected and an unexpected indefinite article plus noun combination, from Nieuwland et al.&#8217;s (<xref ref-type="bibr" rid="B19">2018</xref>) replication of DeLong, Urbach, and Kutas (<xref ref-type="bibr" rid="B5">2005</xref>). Each article-noun combination appeared once as the expected continuation and the other as the unexpected continuation in different contexts, for 160 sentences total. Median cloze probability for expected articles was 0.75 (min 0.16; mean 0.74; max 1.00), for expected nouns 0.90 (min 0.23; mean 0.82; max 1.00), for unexpected articles 0.02 (min 0.00; mean 0.08; max 0.39), and for unexpected nouns 0.00 (min 0.00; mean 0.09; max 0.77). Expected article and noun cloze probability correlation was 0.24, and 0.10 for unexpected conditions. Sentences were divided in to two lists of 80 sentences each. Each article-noun combination appeared only once per list. A yes/no comprehension question followed 21 of the sentences.</p>
<p>Distractor words were generated using A-maze (<xref ref-type="bibr" rid="B3">Boyce, Futrell, &amp; Levy 2020</xref>; <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://vboyce.github.io/Maze/">https://vboyce.github.io/Maze/</ext-link>) with the Gulordava language model (<xref ref-type="bibr" rid="B9">Gulordava, et al., 2018</xref>). This process selected a distractor word for all words but the first of each sentence stimulus. Distractor words were matched in terms of length and approximate frequency to the correct continuation word and were low probability given the left sentence context of that word. The left/right position of correct and distractor words was randomized, except for the first word of each sentence where the correct word was presented on the left against a distractor &#8220;x-x-x&#8221;. Examples are given in <xref ref-type="table" rid="T1">Table 1</xref> and a full stimulus set including paired distractors and comprehension questions are available at <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://osf.io/frdtm/">https://osf.io/frdtm/</ext-link>.</p>
<table-wrap id="T1">
<label>Table 1</label>
<caption>
<p>Example sentences and distractors generated by A-maze. Target articles and nouns are underlined as are their paired distractor words.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Sentence</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Expected</bold></td>
<td align="left" valign="top">The highlight of Jack&#8217;s trip to India was when he got to ride <underline>an elephant</underline> in the parade.<break/>x-x-x subjected wish Nuclei tons cent Ratio boys file miss skin mean inch <underline>lie extends</underline> pm knew trends.<break/>You never forget how to ride <underline>a bicycle</underline> once you&#8217;ve learned.<break/>x-x-x hours animal door fund onto <underline>lack deposits</underline> glad author eastern.</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Unexpected</bold></td>
<td align="left" valign="top">The highlight of Jack&#8217;s trip to India was when he got to ride <underline>a bicycle</underline> in the parade.<break/>x-x-x subjected wish Nuclei tons cent Ratio boys file miss skin mean inch <underline>lie extends</underline> pm knew trends.<break/>You never forget how to ride <underline>an elephant</underline> once you&#8217;ve learned.<break/>x-x-x hours animal door fund onto <underline>lack deposits</underline> glad author eastern.</td>
</tr>
<tr>
<td colspan="2"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<p><italic>Procedure</italic>. Sentences were presented using the IbexFarm web-based platform (<ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://ibex.spellout.net/">https://ibex.spellout.net/</ext-link>) with Boyce, Futrell, and Levy&#8217;s (<xref ref-type="bibr" rid="B3">2020</xref>) Maze module controller in &#8216;redo&#8217; mode. Participants used &#8216;e&#8217; and &#8216;i&#8217; keys to select the left or right alternative continuation, respectively. Selecting the correct continuation word advanced the sentence to the next word pair. Selecting the distractor word elicited an error message, &#8220;Incorrect! Please try again&#8221;, prompting the participant to select the correct continuation. &#8216;e&#8217; and &#8216;i&#8217; keys were also used to answer yes/no comprehension questions, presented in full on the screen to participants.</p>
<p><italic>Data Analysis</italic>. Item 29 was removed due to a coding error. Regression models for dependent variables (Error Rates, Response Times) were constructed using either the categorical factor (Expectation, sum coded 0.5 [unexpected] and &#8211;0.5 [expected]) or graded by-item noun cloze probabilities (Noun Cloze, centered prior to model fit). Error rates were analyzed using Firth&#8217;s penalized likelihood method (<xref ref-type="bibr" rid="B6">Firth, 1993</xref>), using <italic>logistf</italic> (<xref ref-type="bibr" rid="B10">Heinze, Ploner, &amp; Jiricka, 2020</xref>). This analysis was considered more appropriate than mixed-effects logistic regression given the very low error rates.</p>
<p>Words with error responses (including post-error &#8216;correct&#8217; responses) were removed and the remaining response times for all correct-on-first-attempt words were analyzed by fitting mixed-effects models with maximal random effects using <italic>lme4</italic> (<xref ref-type="bibr" rid="B2">Barr, et al., 2013</xref>) and <italic>p</italic>-values determined by <italic>lmerTest</italic> (<xref ref-type="bibr" rid="B14">Kuznetsova, Brockhoff, &amp; Christensen, 2017</xref>) using the Satterthwaite approximation. Conditional means were derived from the models using <italic>emmeans</italic> (<xref ref-type="bibr" rid="B15">Lenth, 2021</xref>) and difference-adjusted 95% (percentile) mixed-effect-model-based intervals were calculated to account for crossed within-subjects and within-items random effects (<xref ref-type="bibr" rid="B23">Politzer-Ahles, 2017</xref>). Analyses are reported using untransformed RT, though log(RT) revealed similar patterns. Raw data and analysis scripts are available at <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://osf.io/frdtm/">https://osf.io/frdtm/</ext-link>. Additional analyses are reported in the appendix.</p>
<sec>
<title>Results</title>
<p><italic>Comprehension accuracy</italic>. Overall accuracy was very high (90%). One participant whose accuracy was 2 standard deviations below the mean (52%) was removed from further analysis. All other participants had average accuracies above 70% and were retained for analysis, with 91% overall accuracy average.</p>
<p><italic>Reading measures</italic>. The following analyses are restricted to the two critical regions (target article and noun) and the three words preceding and following the two critical words.</p>
<p><italic>Error rates</italic>. <xref ref-type="table" rid="T2">Table 2</xref> presents the average error rates for each word by condition. The error rate over all eight regions was low (3.8%). On the target article and noun, error rates were 4.2% and 3.0%, respectively. Two participants whose error rates were two standard deviations above the group average (25.7% and 18.3%) were removed from further analysis. All other participants had average error rates below 10%, with an overall error rate average of 2.8% (article: 3.4%; noun: 2.1%).</p>
<table-wrap id="T2">
<label>Table 2</label>
<caption>
<p>Average error rates across Expectation by word. Standard errors by subject are given in paratheses.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="9"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>CW-3</bold></td>
<td align="left" valign="top"><bold>CW-2</bold></td>
<td align="left" valign="top"><bold>CW-1</bold></td>
<td align="left" valign="top"><bold>art</bold></td>
<td align="left" valign="top"><bold>n</bold></td>
<td align="left" valign="top"><bold>CW+1</bold></td>
<td align="left" valign="top"><bold>CW+2</bold></td>
<td align="left" valign="top"><bold>CW+3</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="9"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Expected</bold></td>
<td align="left" valign="top">2.6 (2.7)</td>
<td align="left" valign="top">3.1 (2.9)</td>
<td align="left" valign="top">3.2 (2.9)</td>
<td align="left" valign="top">4.0 (3.3)</td>
<td align="left" valign="top">1.6 (2.1)</td>
<td align="left" valign="top">3.0 (2.9)</td>
<td align="left" valign="top">2.9 (2.8)</td>
<td align="left" valign="top">2.3 (2.5)</td>
</tr>
<tr>
<td colspan="9"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Unexpected</bold></td>
<td align="left" valign="top">3.1 (2.9)</td>
<td align="left" valign="top">3.1 (2.9)</td>
<td align="left" valign="top">2.5 (2.6)</td>
<td align="left" valign="top">2.7 (2.7)</td>
<td align="left" valign="top">2.5 (2.6)</td>
<td align="left" valign="top">2.5 (2.6)</td>
<td align="left" valign="top">3.9 (3.2)</td>
<td align="left" valign="top">2.0 (2.3)</td>
</tr>
<tr>
<td colspan="9"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<p><italic>Response times</italic>. Error and post-error responses were removed. <xref ref-type="fig" rid="F1">Figure 1</xref> shows results by Expectation. RTs for the unexpected condition were significantly slower than the expected condition on not just the noun (Est. = 362.38, <italic>t</italic> = 8.76, <italic>p</italic> &lt; .001) but also on the preceding article (Est. = 45.51, <italic>t</italic> = 2.91, <italic>p</italic> = .005). Similar results were obtained using noun cloze (article: Est. = &#8211;22.92, <italic>t</italic> = &#8211;2.94, <italic>p</italic> = .005; noun: Est. = &#8211;178.21, <italic>t</italic> = &#8211;9.15, <italic>p</italic> &lt; .001). No significant differences were found on regions prior to the article.</p>
<fig id="F1">
<label>Figure 1</label>
<caption>
<p>Response times by region. Error bars indicate difference-adjusted 95% mixed-effect-model-based intervals (<xref ref-type="bibr" rid="B23">Politzer-Ahles, 2017</xref>) which can generally be interpreted as indicating that two conditions are likely (but not guaranteed) to be significantly different in a mixed effect model when one condition&#8217;s interval does not include the other&#8217;s mean.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g1.png"/>
</fig>
<p>An examination of reading times by participant on the article and noun, shown in <xref ref-type="fig" rid="F2">Figure 2</xref>, suggested that the Expectation effect was greater for slower responders. To investigate this, each participant&#8217;s average response time was calculated based on the average RTs of the three words prior to the article (CW-3, CW-2, and CW-1) over all trials. This predictor was centered (average Participant Average RT: 748 msec) and added to the models above. Significant interactions between Participant Average RT and Expectation were found on both the article (<italic>t</italic> = 2.96, <italic>p</italic> = .004) and the noun (<italic>t</italic> = 4.18, <italic>p</italic> &lt; .001), summarized in <xref ref-type="table" rid="T3">Table 3</xref> and <xref ref-type="fig" rid="F3">Figure 3</xref>. Similar significant interactions were found with noun cloze (article: <italic>t</italic> = &#8211;2.87, <italic>p</italic> = .006; noun: <italic>t</italic> = &#8211;3.00, <italic>p</italic> = .007).</p>
<fig id="F2">
<label>Figure 2</label>
<caption>
<p>Response times on the article (A) and the noun (B) by expectation condition. Individual participant average reading times are shown in addition to the model&#8217;s conditional mean RTs and difference-adjusted 95% mixed-effect-model-based intervals.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g2.png"/>
</fig>
<table-wrap id="T3">
<label>Table 3</label>
<caption>
<p>Summary of four linear mixed effects models for article and noun reading times given Expectation or Noun Cloze crossed with Participant Average RT. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="9"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold><italic>t</italic></bold></td>
<td align="left" valign="top"><bold><italic>p</italic></bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="9"><hr/></td>
</tr>
<tr>
<td align="left" valign="top" rowspan="15"><bold>Article</bold></td>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">696.59</td>
<td align="left" valign="top">11.66</td>
<td align="left" valign="top">59.72</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">46.74</td>
<td align="left" valign="top">13.13</td>
<td align="left" valign="top">3.56</td>
<td align="left" valign="top">.001</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Participant Average RT</td>
<td align="left" valign="top">1.20</td>
<td align="left" valign="top">0.12</td>
<td align="left" valign="top">10.28</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Participant Average RT</td>
<td align="left" valign="top">0.47</td>
<td align="left" valign="top">0.16</td>
<td align="left" valign="top">2.96</td>
<td align="left" valign="top">.004</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">697.92</td>
<td align="left" valign="top">14.80</td>
<td align="left" valign="top">47.15</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Noun Cloze</td>
<td align="left" valign="top">&#8211;21.07</td>
<td align="left" valign="top">6.77</td>
<td align="left" valign="top">&#8211;3.11</td>
<td align="left" valign="top">.003</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Participant Average RT</td>
<td align="left" valign="top">1.23</td>
<td align="left" valign="top">0.15</td>
<td align="left" valign="top">8.14</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Noun Cloze:Participant Average RT</td>
<td align="left" valign="top">&#8211;0.23</td>
<td align="left" valign="top">0.08</td>
<td align="left" valign="top">&#8211;2.87</td>
<td align="left" valign="top">.006</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="9"><hr/></td>
</tr>
<tr>
<td align="left" valign="top" rowspan="15"><bold>Noun</bold></td>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">885.11</td>
<td align="left" valign="top">17.71</td>
<td align="left" valign="top">49.98</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">362.30</td>
<td align="left" valign="top">48.56</td>
<td align="left" valign="top">7.46</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Participant Average RT</td>
<td align="left" valign="top">1.26</td>
<td align="left" valign="top">0.16</td>
<td align="left" valign="top">8.10</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Participant Average RT</td>
<td align="left" valign="top">0.86</td>
<td align="left" valign="top">0.20</td>
<td align="left" valign="top">4.18</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">884.03</td>
<td align="left" valign="top">14.78</td>
<td align="left" valign="top">59.82</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Noun Cloze</td>
<td align="left" valign="top">&#8211;179.46</td>
<td align="left" valign="top">17.38</td>
<td align="left" valign="top">&#8211;10.32</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Participant Average RT</td>
<td align="left" valign="top">1.26</td>
<td align="left" valign="top">0.11</td>
<td align="left" valign="top">12.03</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="8"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Noun Cloze:Participant Average RT</td>
<td align="left" valign="top">&#8211;0.43</td>
<td align="left" valign="top">0.14</td>
<td align="left" valign="top">&#8211;3.00</td>
<td align="left" valign="top">.007</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="9"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="F3">
<label>Figure 3</label>
<caption>
<p>Response times on the article (A) and the noun (B) given participant average response time. Individual participant&#8217;s expected and unexpected averages are plotted and connected by a line to ease identification.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g3.png"/>
</fig>
<p><xref ref-type="fig" rid="F2">Figure 2</xref> also suggests that five participants responded very slowly to articles compared to other participants, with an average article RT over 900 msec (&gt;1.38 sd), while also showing large Expectation effects. To investigate whether these slowest responders are the main drivers of expectation and/or its interaction with Participant Average RT on article RTs, an additional model was fit to the data with these five participants removed, leaving 31 participants. Results continue to find a significant effect of Expectation (Est. = 19.28, t = 2.09, p = .040) and Participant Average RT (Est. = 0.67, t = 7.05, p &lt; .001), but their interaction is no longer significant (Est. = 0.11, t = 0.99, p = .323). Additionally, <xref ref-type="fig" rid="F3">Figure 3</xref> shows that three participants were responding much slower overall, with Participant Average RTs greater than 900 msec (&gt;1.42 sd), and appear to have an outsized effect on Expectation. To further investigate whether Expectation effect are primarily being driven by these slowest participants, another model was fit to the data excluding these three participants, leaving 33 participants. Again, results find a significant effect of Expectation (Est. = 28.81, t = 2.59, p = .012) and Participant Average RT (Est. = 0.87, t = 6.64, p &lt; .001), but their interaction is no longer significant (Est. = 0.24, t = 1.96, p = .055). Together, these additional analyses suggest that, although an effect of Expectation persists when removing these slow responders, the Expectation effects are magnified by them.</p>
</sec>
</sec>
</sec>
<sec>
<title>Discussion</title>
<p>By providing a focal reading time measure, the maze task was able to reveal effects of expectation both on target nouns and the article <italic>a/an</italic> contrast preceding the nouns. Unexpected nouns and their preceding articles, which mismatched the expected noun&#8217;s required article form, were responded to more slowly than expected nouns and their preceding articles. Response times on articles and nouns were also found to be inversely related to noun cloze probabilities, with response times decreasing as cloze probabilities increased. This suggests that pre-activation of word form is a more graded effect (<xref ref-type="bibr" rid="B5">DeLong, Urbach, &amp; Kutas, 2005</xref>).</p>
<p>Interesting, early predictive effects of article form were magnified for slower responders and smaller with faster responders. This suggests that probabilistic pre-activation of the expected word to the level of phonological form that is required to compute expectations for preceding article form may take time to emerge, consistent with prediction-as-production theories (<xref ref-type="bibr" rid="B22">Pickering &amp; Gambi, 2018</xref>). The maze task may be sensitive to these effects because its response times are generally longer than self-paced reading&#8217;s reading times, eyetracking&#8217;s fixation durations, or ERP&#8217;s typical SOAs. This additional time may have aided form prediction. Ito, et al., (<xref ref-type="bibr" rid="B11">2016</xref>), for example, found that N400-reduction to form-related words emerged at 700 msec SOA but not 500 msec SOA. A similar effect may have emerged in a more natural and graded fashion here through the variation of individual&#8217;s average response times. Slower responders may have given themselves more time to reach a form prediction for the upcoming noun and compute its consequences for the preceding article&#8217;s form, while faster responders were less likely to make these form predictions and consequent computations.</p>
<p>These results demonstrate that the maze task can be sensitive to the predictive use of phonotactic constraints between an expected word and its preceding word, and may be a useful alternative methodology for investigating predictive comprehension mechanisms. A-maze eases the burden of distractor generation and is effective with online crowdsourced participants (<xref ref-type="bibr" rid="B3">Boyce, Futrell, &amp; Levy, 2020</xref>). It is hoped that further investigation into predictive mechanisms will be spurred on with this demonstration of the maze task&#8217;s effectiveness.</p>
</sec>
</body>
<back>
<sec>
<title>Appendix</title>
<p>The following reports seven supplemental analyses: 1) RTs including both accurate and inaccurate responses, 2) RTs to nouns given prior article RTs by expectation, 3) expectation given article word form <italic>a/an</italic>, 4) expectation given word sentence position, 5) expectation given article&#8217;s alternative word, 6) expectation given article&#8217;s alternative word length, and 7) expectation given participant age.</p>
<sec>
<title>A1. Analysis including both accurate and inaccurate responses</title>
<p>All response time analyses reported in the main paper exclude trials where participants initially chose the distractor word. To investigate whether excluding these trials significantly affected response times, a supplemental analysis was conducted including all data, revealing very similar effects to those reported in the main analysis.</p>
<table-wrap id="TA1">
<label>Table A1</label>
<caption>
<p>Summary of linear mixed effects models for article, noun, and CW+1 response times including both correct and incorrect responses. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold>t</bold></td>
<td align="left" valign="top"><bold>p</bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Article</td>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">694.25</td>
<td align="left" valign="top">25.00</td>
<td align="left" valign="top">27.77</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">44.19</td>
<td align="left" valign="top">15.25</td>
<td align="left" valign="top">2.90</td>
<td align="left" valign="top">.005</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Noun</td>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">884.69</td>
<td align="left" valign="top">29.49</td>
<td align="left" valign="top">30.00</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">360.98</td>
<td align="left" valign="top">42.42</td>
<td align="left" valign="top">8.51</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">CW+1</td>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">818.24</td>
<td align="left" valign="top">33.49</td>
<td align="left" valign="top">24.43</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">83.36</td>
<td align="left" valign="top">45.11</td>
<td align="left" valign="top">1.85</td>
<td align="left" valign="top">.069</td>
<td align="left" valign="top">.</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA1">
<label>Figure A1</label>
<caption>
<p>Response times including both correct and incorrect responses by region. Error bars indicate difference-adjusted 95% mixed-effect-model-based intervals (<xref ref-type="bibr" rid="B23">Politzer-Ahles, 2017</xref>) which can generally be interpreted as indicating that two conditions are likely (but not guaranteed) to be significantly different in a mixed effect model when one condition&#8217;s interval does not include the other&#8217;s mean.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g4.png"/>
</fig>
</sec>
<sec>
<title>A2. Response times to expected and unexpected nouns given prior article RT</title>
<p>The slowdown in response times by participants on the article may reflect not only an early signal to prediction failure, but also reflect recovery processes. Under this idea, increased response times on unexpected articles should decrease the response time to an unexpected noun. To investigate this possibility, we fit a model to the RTs on the Noun given the RTs on the Article and whether the noun was expected or unexpected. Article RTs were centered prior to model fit. A significant interaction between Article RT and Expectation was discovered, such that expected nouns were read slower the slower comprehenders read their prior article (0.26 msec/Article msec [0.17, 0.35]). RTs on Unexpected nouns, however, showed much less slowdown given the RT on their prior article (0.07 msec/Article msec [0.01, 0.13]), suggesting that the additional time spent on the unexpected article may have lessened the amount of time needed on the unexpected noun.</p>
<table-wrap id="TA2">
<label>Table A2</label>
<caption>
<p>Summary of linear mixed effects model for noun response times given their prior article response time. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold><italic>t</italic></bold></td>
<td align="left" valign="top"><bold><italic>p</italic></bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">884.13</td>
<td align="left" valign="top">26.11</td>
<td align="left" valign="top">33.86</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Article RT</td>
<td align="left" valign="top">355.96</td>
<td align="left" valign="top">41.85</td>
<td align="left" valign="top">8.51</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">0.16</td>
<td align="left" valign="top">0.03</td>
<td align="left" valign="top">5.95</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Article RT:Expectation</td>
<td align="left" valign="top">&#8211;0.19</td>
<td align="left" valign="top">0.05</td>
<td align="left" valign="top">&#8211;3.62</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA2">
<label>Figure A2</label>
<caption>
<p>Response times to nouns given response times to their prior article. Individual participant&#8217;s expected (light unfilled) and unexpected (dark filled) averages are also shown.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g5.png"/>
</fig>
</sec>
<sec>
<title>A3. Expectation by Word Form (<italic>a/an</italic>)</title>
<p>Because the English indefinite article forms differ in length and frequency, we might expect differences in their effect on expectation. This was investigated in a model including article form. Article Form and Expectation affected RTs, with a marginal interaction. Examining Expectation within Article Form on article RTs found a significant effect of Expectation on <italic>an</italic> forms (Est. = 64.9, <italic>t</italic> = 3.29, <italic>p</italic> = .002) but not <italic>a</italic> forms (Est. = 22.1, <italic>t</italic> = 1.04, <italic>p</italic> = .301).</p>
<table-wrap id="TA3">
<label>Table A3</label>
<caption>
<p>Summary of linear mixed effects model for article response times given article form. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold><italic>t</italic></bold></td>
<td align="left" valign="top"><bold><italic>p</italic></bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">692.46</td>
<td align="left" valign="top">25.02</td>
<td align="left" valign="top">27.67</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">43.50</td>
<td align="left" valign="top">15.44</td>
<td align="left" valign="top">2.82</td>
<td align="left" valign="top">.006</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Article Form</td>
<td align="left" valign="top">70.13</td>
<td align="left" valign="top">29.30</td>
<td align="left" valign="top">2.39</td>
<td align="left" valign="top">.018</td>
<td align="left" valign="top">*</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Article Form</td>
<td align="left" valign="top">42.87</td>
<td align="left" valign="top">26.34</td>
<td align="left" valign="top">1.628</td>
<td align="left" valign="top">.107</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA3">
<label>Figure A3</label>
<caption>
<p>Average response times to expected and unexpected articles given their article form, <italic>a</italic> or <italic>an</italic>.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g6.png"/>
</fig>
<p>Article Form was also found to marginally affect noun RTs (Est. = 89.11, <italic>t</italic> = 1.72, <italic>p</italic> = .089), though the interaction between Expectation and Article Form was not significant (Est. = 61.91, <italic>t</italic> = 0.84, <italic>p</italic> = .405).</p>
</sec>
<sec>
<title>A4. Expectation by Word Position</title>
<p>It is well known that comprehenders tend to make faster responses as they read. To examine whether the position of the article in the sentence affected expectation on article RTs, article position (centered) was included in a model. Article Position, however, did not show a significant effect on article RTs nor was there a significant interaction.</p>
<table-wrap id="TA4">
<label>Table A4</label>
<caption>
<p>Summary of linear mixed effects model for article response times given their linear position in the sentence. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold>t</bold></td>
<td align="left" valign="top"><bold>p</bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">695.51</td>
<td align="left" valign="top">24.81</td>
<td align="left" valign="top">28.04</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">41.98</td>
<td align="left" valign="top">15.74</td>
<td align="left" valign="top">2.67</td>
<td align="left" valign="top">.010</td>
<td align="left" valign="top">*</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Article Position</td>
<td align="left" valign="top">&#8211;0.54</td>
<td align="left" valign="top">1.27</td>
<td align="left" valign="top">&#8211;0.42</td>
<td align="left" valign="top">.674</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Article Position</td>
<td align="left" valign="top">&#8211;3.82</td>
<td align="left" valign="top">2.48</td>
<td align="left" valign="top">&#8211;1.54</td>
<td align="left" valign="top">.127</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA4">
<label>Figure A4</label>
<caption>
<p>Response times to articles by their sentence position. Average RTs given article sentence position for expected and unexpected articles are also shown.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g7.png"/>
</fig>
<p>A similar analysis with noun position on noun RTs found a significant effect of Expectation (Est. = 363.47, <italic>t</italic> = 8.78, <italic>p</italic> &lt; .001), but did not find a significant effect of position (Est. = 2.78, <italic>t</italic> = 0.84, <italic>p</italic> = .401) or a significant interaction (Est. = 6.53, <italic>t</italic> = 0.90, <italic>p</italic> = .373).</p>
</sec>
<sec>
<title>A5. Expectation by Alternative Word to Article</title>
<p>The maze task requires comprehenders to choose between two alternative words to continue reading and therefore properties of the alternative word form could affect response times. Because alternatives are matched as closely as possible in terms of word length and frequency, A-maze may have had difficulty selecting appropriate alternatives for indefinite articles. 45 different alternative words were used in this study, with some being repeated more often than others (minimum repetition: 2, maximum repetition: 14). The distribution of alternative repetitions is given in Table S5.</p>
<table-wrap id="TA5">
<label>Table A5</label>
<caption>
<p>Count of article alternative words given their repetition in the study.</p>
</caption>
<table>
<tbody>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Number of repetitions</td>
<td align="left" valign="top">2</td>
<td align="left" valign="top">4</td>
<td align="left" valign="top">6</td>
<td align="left" valign="top">8</td>
<td align="left" valign="top">10</td>
<td align="left" valign="top">14</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Number of alternative words</td>
<td align="left" valign="top">27</td>
<td align="left" valign="top">9</td>
<td align="left" valign="top">6</td>
<td align="left" valign="top">1</td>
<td align="left" valign="top">1</td>
<td align="left" valign="top">1</td>
</tr>
<tr>
<td colspan="7"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>A linear mixed effects model of article RTs including expectation and alternative form was fit. The model found a main effect of Expectation (F(1) = 6.97, p = .011) but no significant effect of Alterative (F(44) = 1.35, p = .141) and no significant interaction (F(44) = 0.81, p = .751).</p>
<fig id="FA5">
<label>Figure A5</label>
<caption>
<p>Estimated contrast of expected minus unexpected article RTs for the nine most repeated alternative forms to articles. Number of alternative word repetitions is given in parentheses.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g8.png"/>
</fig>
</sec>
<sec>
<title>A6. Expectation by Alternative Word to Article Length</title>
<p>Because there was a large number of different alternative forms, we also investigated whether a simple measure of alternative length could be shown to affect article RTs. Alternative Length was included in a model with Expectation. Neither Alternative Length nor an interaction was found to be significant.</p>
<table-wrap id="TA6">
<label>Table A6</label>
<caption>
<p>Summary of linear mixed effects model for article response times given the length of the alterative. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold>t</bold></td>
<td align="left" valign="top"><bold>p</bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">696.22</td>
<td align="left" valign="top">24.82</td>
<td align="left" valign="top">28.05</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">45.56</td>
<td align="left" valign="top">14.25</td>
<td align="left" valign="top">3.20</td>
<td align="left" valign="top">.003</td>
<td align="left" valign="top">**</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Alterative Length</td>
<td align="left" valign="top">&#8211;4.08</td>
<td align="left" valign="top">7.43</td>
<td align="left" valign="top">&#8211;0.55</td>
<td align="left" valign="top">.585</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Alternative Length</td>
<td align="left" valign="top">5.90</td>
<td align="left" valign="top">12.08</td>
<td align="left" valign="top">0.49</td>
<td align="left" valign="top">.625</td>
<td align="left" valign="top"></td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA6">
<label>Figure A6</label>
<caption>
<p>Response times to articles by their alternative word&#8217;s length. Average RTs given alternative word length for expected and unexpected articles are also plotted.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g9.png"/>
</fig>
</sec>
<sec>
<title>A7. Expectation by Participant Age</title>
<p>Because older participants tend to have slower response times, we might expect differences in participant age to show an effect on expectation. This was investigated in a model including each participant&#8217;s age. Age was centered prior to analysis. Both Expectation and Age affected article RTs and there was a significant interaction, with older participants showing a larger difference between expected and unexpected articles compared to younger participants. Table A7b below provides additional detail, including both participant age and their average response times and is ordered by the average RT different between unexpected and expected articles for each participant.</p>
<table-wrap id="TA7">
<label>Table A7a</label>
<caption>
<p>Summary of linear mixed effects model for article response times given a participant&#8217;s age. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold>t</bold></td>
<td align="left" valign="top"><bold>p</bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">696.64</td>
<td align="left" valign="top">19.10</td>
<td align="left" valign="top">36.47</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">45.63</td>
<td align="left" valign="top">13.64</td>
<td align="left" valign="top">3.35</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Age</td>
<td align="left" valign="top">7.07</td>
<td align="left" valign="top">1.40</td>
<td align="left" valign="top">5.06</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Age</td>
<td align="left" valign="top">3.44</td>
<td align="left" valign="top">0.89</td>
<td align="left" valign="top">3.88</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA7">
<label>Figure A7a</label>
<caption>
<p>Response times to articles by participant age. Average RTs given participant age for expected and unexpected articles are also shown.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g10.png"/>
</fig>
<table-wrap id="TA8">
<label>Table A7b</label>
<caption>
<p>Participant age, average response time, expected article average RTs, unexpected article average RTs, and the difference between unexpected and expected article RTs. The table is ordered by difference, from highest to lowest.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold>Participant</bold></td>
<td align="left" valign="top"><bold>Age</bold></td>
<td align="left" valign="top"><bold>Part.Avg RT</bold></td>
<td align="left" valign="top"><bold>Expected</bold></td>
<td align="left" valign="top"><bold>Unexpected</bold></td>
<td align="left" valign="top"><bold>Difference</bold></td>
<td align="left" valign="top"><bold>Participant</bold></td>
<td align="left" valign="top"><bold>Age</bold></td>
<td align="left" valign="top"><bold>Part.Avg RT</bold></td>
<td align="left" valign="top"><bold>Expected</bold></td>
<td align="left" valign="top"><bold>Unexpected</bold></td>
<td align="left" valign="top"><bold>Difference</bold></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>1</italic></bold></td>
<td align="left" valign="top">52</td>
<td align="left" valign="top">1002</td>
<td align="left" valign="top">919</td>
<td align="left" valign="top">1201</td>
<td align="left" valign="top">281</td>
<td align="left" valign="top"><bold><italic>19</italic></bold></td>
<td align="left" valign="top">25</td>
<td align="left" valign="top">604</td>
<td align="left" valign="top">500</td>
<td align="left" valign="top">529</td>
<td align="left" valign="top">29</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>2</italic></bold></td>
<td align="left" valign="top">52</td>
<td align="left" valign="top">814</td>
<td align="left" valign="top">798</td>
<td align="left" valign="top">1024</td>
<td align="left" valign="top">227</td>
<td align="left" valign="top"><bold><italic>20</italic></bold></td>
<td align="left" valign="top">36</td>
<td align="left" valign="top">651</td>
<td align="left" valign="top">608</td>
<td align="left" valign="top">635</td>
<td align="left" valign="top">27</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>3</italic></bold></td>
<td align="left" valign="top">66</td>
<td align="left" valign="top">943</td>
<td align="left" valign="top">888</td>
<td align="left" valign="top">1109</td>
<td align="left" valign="top">221</td>
<td align="left" valign="top"><bold><italic>21</italic></bold></td>
<td align="left" valign="top">46</td>
<td align="left" valign="top">759</td>
<td align="left" valign="top">731</td>
<td align="left" valign="top">754</td>
<td align="left" valign="top">23</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>4</italic></bold></td>
<td align="left" valign="top">71</td>
<td align="left" valign="top">1011</td>
<td align="left" valign="top">1071</td>
<td align="left" valign="top">1282</td>
<td align="left" valign="top">211</td>
<td align="left" valign="top"><bold><italic>22</italic></bold></td>
<td align="left" valign="top">20</td>
<td align="left" valign="top">885</td>
<td align="left" valign="top">651</td>
<td align="left" valign="top">672</td>
<td align="left" valign="top">21</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>5</italic></bold></td>
<td align="left" valign="top">35</td>
<td align="left" valign="top">852</td>
<td align="left" valign="top">851</td>
<td align="left" valign="top">981</td>
<td align="left" valign="top">130</td>
<td align="left" valign="top"><bold><italic>23</italic></bold></td>
<td align="left" valign="top">19</td>
<td align="left" valign="top">782</td>
<td align="left" valign="top">756</td>
<td align="left" valign="top">773</td>
<td align="left" valign="top">17</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>6</italic></bold></td>
<td align="left" valign="top">32</td>
<td align="left" valign="top">722</td>
<td align="left" valign="top">616</td>
<td align="left" valign="top">730</td>
<td align="left" valign="top">113</td>
<td align="left" valign="top"><bold><italic>24</italic></bold></td>
<td align="left" valign="top">24</td>
<td align="left" valign="top">665</td>
<td align="left" valign="top">580</td>
<td align="left" valign="top">596</td>
<td align="left" valign="top">16</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>7</italic></bold></td>
<td align="left" valign="top">48</td>
<td align="left" valign="top">833</td>
<td align="left" valign="top">663</td>
<td align="left" valign="top">758</td>
<td align="left" valign="top">96</td>
<td align="left" valign="top"><bold><italic>25</italic></bold></td>
<td align="left" valign="top">30</td>
<td align="left" valign="top">714</td>
<td align="left" valign="top">607</td>
<td align="left" valign="top">622</td>
<td align="left" valign="top">15</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>8</italic></bold></td>
<td align="left" valign="top">19</td>
<td align="left" valign="top">758</td>
<td align="left" valign="top">673</td>
<td align="left" valign="top">763</td>
<td align="left" valign="top">91</td>
<td align="left" valign="top"><bold><italic>26</italic></bold></td>
<td align="left" valign="top">22</td>
<td align="left" valign="top">817</td>
<td align="left" valign="top">645</td>
<td align="left" valign="top">647</td>
<td align="left" valign="top">1</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>9</italic></bold></td>
<td align="left" valign="top">26</td>
<td align="left" valign="top">688</td>
<td align="left" valign="top">629</td>
<td align="left" valign="top">682</td>
<td align="left" valign="top">53</td>
<td align="left" valign="top"><bold><italic>27</italic></bold></td>
<td align="left" valign="top">37</td>
<td align="left" valign="top">633</td>
<td align="left" valign="top">534</td>
<td align="left" valign="top">533</td>
<td align="left" valign="top">&#8211;1</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>10</italic></bold></td>
<td align="left" valign="top">40</td>
<td align="left" valign="top">768</td>
<td align="left" valign="top">662</td>
<td align="left" valign="top">707</td>
<td align="left" valign="top">45</td>
<td align="left" valign="top"><bold><italic>28</italic></bold></td>
<td align="left" valign="top">31</td>
<td align="left" valign="top">726</td>
<td align="left" valign="top">635</td>
<td align="left" valign="top">632</td>
<td align="left" valign="top">&#8211;3</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>11</italic></bold></td>
<td align="left" valign="top">35</td>
<td align="left" valign="top">727</td>
<td align="left" valign="top">597</td>
<td align="left" valign="top">639</td>
<td align="left" valign="top">43</td>
<td align="left" valign="top"><bold><italic>29</italic></bold></td>
<td align="left" valign="top">20</td>
<td align="left" valign="top">652</td>
<td align="left" valign="top">627</td>
<td align="left" valign="top">622</td>
<td align="left" valign="top">&#8211;5</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>12</italic></bold></td>
<td align="left" valign="top">32</td>
<td align="left" valign="top">783</td>
<td align="left" valign="top">671</td>
<td align="left" valign="top">711</td>
<td align="left" valign="top">40</td>
<td align="left" valign="top"><bold><italic>30</italic></bold></td>
<td align="left" valign="top">25</td>
<td align="left" valign="top">596</td>
<td align="left" valign="top">563</td>
<td align="left" valign="top">557</td>
<td align="left" valign="top">&#8211;6</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>13</italic></bold></td>
<td align="left" valign="top">30</td>
<td align="left" valign="top">669</td>
<td align="left" valign="top">628</td>
<td align="left" valign="top">668</td>
<td align="left" valign="top">40</td>
<td align="left" valign="top"><bold><italic>31</italic></bold></td>
<td align="left" valign="top">24</td>
<td align="left" valign="top">718</td>
<td align="left" valign="top">607</td>
<td align="left" valign="top">586</td>
<td align="left" valign="top">&#8211;21</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>14</italic></bold></td>
<td align="left" valign="top">24</td>
<td align="left" valign="top">661</td>
<td align="left" valign="top">523</td>
<td align="left" valign="top">560</td>
<td align="left" valign="top">37</td>
<td align="left" valign="top"><bold><italic>32</italic></bold></td>
<td align="left" valign="top">28</td>
<td align="left" valign="top">565</td>
<td align="left" valign="top">568</td>
<td align="left" valign="top">535</td>
<td align="left" valign="top">&#8211;33</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>15</italic></bold></td>
<td align="left" valign="top">29</td>
<td align="left" valign="top">815</td>
<td align="left" valign="top">706</td>
<td align="left" valign="top">742</td>
<td align="left" valign="top">37</td>
<td align="left" valign="top"><bold><italic>33</italic></bold></td>
<td align="left" valign="top">21</td>
<td align="left" valign="top">681</td>
<td align="left" valign="top">674</td>
<td align="left" valign="top">636</td>
<td align="left" valign="top">&#8211;38</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>16</italic></bold></td>
<td align="left" valign="top">32</td>
<td align="left" valign="top">605</td>
<td align="left" valign="top">560</td>
<td align="left" valign="top">597</td>
<td align="left" valign="top">37</td>
<td align="left" valign="top"><bold><italic>34</italic></bold></td>
<td align="left" valign="top">50</td>
<td align="left" valign="top">804</td>
<td align="left" valign="top">727</td>
<td align="left" valign="top">686</td>
<td align="left" valign="top">&#8211;41</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>17</italic></bold></td>
<td align="left" valign="top">41</td>
<td align="left" valign="top">765</td>
<td align="left" valign="top">689</td>
<td align="left" valign="top">723</td>
<td align="left" valign="top">34</td>
<td align="left" valign="top"><bold><italic>35</italic></bold></td>
<td align="left" valign="top">52</td>
<td align="left" valign="top">697</td>
<td align="left" valign="top">647</td>
<td align="left" valign="top">601</td>
<td align="left" valign="top">&#8211;46</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"><bold><italic>18</italic></bold></td>
<td align="left" valign="top">57</td>
<td align="left" valign="top">783</td>
<td align="left" valign="top">665</td>
<td align="left" valign="top">695</td>
<td align="left" valign="top">30</td>
<td align="left" valign="top"><bold><italic>36</italic></bold></td>
<td align="left" valign="top">21</td>
<td align="left" valign="top">789</td>
<td align="left" valign="top">773</td>
<td align="left" valign="top">703</td>
<td align="left" valign="top">&#8211;69</td>
</tr>
<tr>
<td colspan="12"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Age also showed a significant effect on noun RTs, along with Expectation and their interaction. Older participants again showed a larger difference between expected and unexpected articles compared to younger participants.</p>
<table-wrap id="TA9">
<label>Table A7c</label>
<caption>
<p>Summary of linear mixed effects model for noun response times given a participant&#8217;s age. P-values are estimated using the Satterthwaite approximation.</p>
</caption>
<table>
<thead>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top"></td>
<td align="left" valign="top"><bold>Est</bold></td>
<td align="left" valign="top"><bold>Std.Err</bold></td>
<td align="left" valign="top"><bold>t</bold></td>
<td align="left" valign="top"><bold>p</bold></td>
<td align="left" valign="top"></td>
</tr>
</thead>
<tbody>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Intercept</td>
<td align="left" valign="top">885.06</td>
<td align="left" valign="top">23.95</td>
<td align="left" valign="top">36.95</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation</td>
<td align="left" valign="top">362.62</td>
<td align="left" valign="top">38.60</td>
<td align="left" valign="top">9.40</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Age</td>
<td align="left" valign="top">7.07</td>
<td align="left" valign="top">1.47</td>
<td align="left" valign="top">4.81</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
<tr>
<td align="left" valign="top">Expectation:Age</td>
<td align="left" valign="top">6.80</td>
<td align="left" valign="top">1.76</td>
<td align="left" valign="top">3.85</td>
<td align="left" valign="top">&lt;.001</td>
<td align="left" valign="top">***</td>
</tr>
<tr>
<td colspan="6"><hr/></td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="FA8">
<label>Figure A7b</label>
<caption>
<p>Response times to nouns by participant age. Average RTs given participant age for expected and unexpected articles are also shown.</p>
</caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="glossapx-1-1-53-g11.png"/>
</fig>
</sec>
</sec>
<ack>
<title>Acknowledgements</title>
<p>This research was supported by the Fellow&#8217;s Research Fund at St. Hugh&#8217;s College.</p>
</ack>
<sec>
<title>Competing Interests</title>
<p>The author has no competing interests to declare.</p>
</sec>
<ref-list>
<ref id="B1"><label>1</label><mixed-citation publication-type="journal"><string-name><surname>Balota</surname>, <given-names>D. A.</given-names></string-name>, <string-name><surname>Pollatsek</surname>, <given-names>A.</given-names></string-name>, &amp; <string-name><surname>Rayner</surname>, <given-names>K.</given-names></string-name> (<year>1985</year>). <article-title>The interaction of contextual constraints and parafoveal visual information in reading</article-title>. <source>Cognitive psychology</source>, <volume>17</volume>(<issue>3</issue>), <fpage>364</fpage>&#8211;<lpage>390</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/0010-0285(85)90013-1</pub-id></mixed-citation></ref>
<ref id="B2"><label>2</label><mixed-citation publication-type="journal"><string-name><surname>Barr</surname>, <given-names>D. J.</given-names></string-name>, <string-name><surname>Levy</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Scheepers</surname>, <given-names>C.</given-names></string-name>, &amp; <string-name><surname>Tily</surname>, <given-names>H. J.</given-names></string-name> (<year>2013</year>). <article-title>Random effects structure for confirmatory hypothesis testing: Keep it maximal</article-title>. <source>Journal of Memory and Language</source>, <volume>68</volume>, <fpage>255</fpage>&#8211;<lpage>278</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.jml.2012.11.001</pub-id></mixed-citation></ref>
<ref id="B3"><label>3</label><mixed-citation publication-type="journal"><string-name><surname>Boyce</surname>, <given-names>V.</given-names></string-name>, <string-name><surname>Futrell</surname>, <given-names>R.</given-names></string-name>, &amp; <string-name><surname>Levy</surname>, <given-names>R. P.</given-names></string-name> (<year>2020</year>). <article-title>Maze Made Easy: Better and easier measurement of incremental processing difficulty</article-title>. <source>Journal of Memory and Language</source>, <volume>111</volume>, <fpage>104082</fpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.jml.2019.104082</pub-id></mixed-citation></ref>
<ref id="B4"><label>4</label><mixed-citation publication-type="journal"><string-name><surname>Cutter</surname>, <given-names>M. G.</given-names></string-name>, <string-name><surname>Martin</surname>, <given-names>A. E.</given-names></string-name>, &amp; <string-name><surname>Sturt</surname>, <given-names>P.</given-names></string-name> (<year>2020</year>). <article-title>Readers detect an low-level phonological violation between two parafoveal words</article-title>. <source>Cognition</source>, <volume>204</volume>: <fpage>104395</fpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.cognition.2020.104395</pub-id></mixed-citation></ref>
<ref id="B5"><label>5</label><mixed-citation publication-type="journal"><string-name><surname>DeLong</surname>, <given-names>K. A.</given-names></string-name>, <string-name><surname>Urbach</surname>, <given-names>T. P.</given-names></string-name>, &amp; <string-name><surname>Kutas</surname>, <given-names>M.</given-names></string-name> (<year>2005</year>). <article-title>Probabilistic word pre-activation during language comprehension inferred from electrical brain activity</article-title>. <source>Nature neuroscience</source>, <volume>8</volume>(<issue>8</issue>), <fpage>1117</fpage>&#8211;<lpage>1121</lpage>. DOI: <pub-id pub-id-type="doi">10.1038/nn1504</pub-id></mixed-citation></ref>
<ref id="B6"><label>6</label><mixed-citation publication-type="journal"><string-name><surname>Firth</surname>, <given-names>D.</given-names></string-name> (<year>1993</year>). <article-title>Bias Reduction of Maximum Likelihood Estimates</article-title>. <source>Biometrika</source>, <volume>80</volume>(<issue>1</issue>), <fpage>27</fpage>&#8211;<lpage>38</lpage>. DOI: <pub-id pub-id-type="doi">10.1093/biomet/80.1.27</pub-id></mixed-citation></ref>
<ref id="B7"><label>7</label><mixed-citation publication-type="journal"><string-name><surname>Forster</surname>, <given-names>K. I.</given-names></string-name>, <string-name><surname>Guerrera</surname>, <given-names>C.</given-names></string-name>, &amp; <string-name><surname>Elliot</surname>, <given-names>L.</given-names></string-name> (<year>2009</year>). <article-title>The maze task: Measuring forced incremental sentence processing time</article-title>. <source>Behavior Research Methods</source>, <volume>41</volume>(<issue>1</issue>), <fpage>163</fpage>&#8211;<lpage>171</lpage>. DOI: <pub-id pub-id-type="doi">10.3758/BRM.41.1.163</pub-id></mixed-citation></ref>
<ref id="B8"><label>8</label><mixed-citation publication-type="journal"><string-name><surname>Foucart</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Martin</surname>, <given-names>C. D.</given-names></string-name>, <string-name><surname>Moreno</surname>, <given-names>E. M.</given-names></string-name>, &amp; <string-name><surname>Costa</surname>, <given-names>A.</given-names></string-name> (<year>2014</year>). <article-title>Can bilinguals see it coming? Word anticipation in L2 sentence reading</article-title>. <source>Journal of Experimental Psychology: Learning, Memory and Cognition</source>, <volume>40</volume>(<issue>5</issue>), <fpage>1461</fpage>&#8211;<lpage>1469</lpage>. DOI: <pub-id pub-id-type="doi">10.1037/a0036756</pub-id></mixed-citation></ref>
<ref id="B9"><label>9</label><mixed-citation publication-type="journal"><string-name><surname>Gulordava</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Bojanowski</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Grave</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Linzen</surname>, <given-names>T.</given-names></string-name>, &amp; <string-name><surname>Baroni</surname>, <given-names>M.</given-names></string-name> (<year>2018</year>). <article-title>Colorless green recurrent networks dream hierarchically</article-title>. <source>Proceedings of NAACL</source>. DOI: <pub-id pub-id-type="doi">10.18653/v1/N18-1108</pub-id></mixed-citation></ref>
<ref id="B10"><label>10</label><mixed-citation publication-type="webpage"><string-name><surname>Heinze</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Ploner</surname>, <given-names>M.</given-names></string-name>, &amp; <string-name><surname>Jiricka</surname>, <given-names>L.</given-names></string-name> (<year>2020</year>). <chapter-title>logistf: Firth&#8217;s Bias-Reduced Logistic Regression</chapter-title>. R package version 1.24. <uri>https://CRAN.R-project.org/package=logistf</uri></mixed-citation></ref>
<ref id="B11"><label>11</label><mixed-citation publication-type="journal"><string-name><surname>Ito</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Corley</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Pickering</surname>, <given-names>M. J.</given-names></string-name>, <string-name><surname>Martin</surname>, <given-names>A. E.</given-names></string-name>, &amp; <string-name><surname>Nieuwland</surname>, <given-names>M. S.</given-names></string-name> (<year>2016</year>). <article-title>Predicting form and meaning: Evidence from brain potentials</article-title>. <source>Journal of Memory and Language</source>, <volume>86</volume>, <fpage>157</fpage>&#8211;<lpage>171</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.jml.2015.10.007</pub-id></mixed-citation></ref>
<ref id="B12"><label>12</label><mixed-citation publication-type="journal"><string-name><surname>Ito</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Gambi</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Pickering</surname>, <given-names>M. J.</given-names></string-name>, <string-name><surname>Fuellenbach</surname>, <given-names>K.</given-names></string-name>, &amp; <string-name><surname>Husband</surname>, <given-names>E. M.</given-names></string-name> (<year>2020</year>). <article-title>Prediction of phonological and gender information: An event-related potential study in Italian</article-title>. <source>Neuropsychologia, 136</source>. <fpage>107291</fpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.neuropsychologia.2019.107291</pub-id></mixed-citation></ref>
<ref id="B13"><label>13</label><mixed-citation publication-type="journal"><string-name><surname>Ito</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Martin</surname>, <given-names>A. E.</given-names></string-name>, &amp; <string-name><surname>Nieuwland</surname>, <given-names>M. S.</given-names></string-name> (<year>2017</year>). <article-title>Why the A/AN prediction effect may be hard to replicate: a rebuttal to Delong, Urbach, and Kutas (2017)</article-title>. <source>Language, Cognition and Neuroscience</source>, <volume>32</volume>(<issue>8</issue>), <fpage>974</fpage>&#8211;<lpage>983</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/23273798.2017.1323112</pub-id></mixed-citation></ref>
<ref id="B14"><label>14</label><mixed-citation publication-type="journal"><string-name><surname>Kuznetsova</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Brockhoff</surname>, <given-names>P. B.</given-names></string-name>, &amp; <string-name><surname>Christensen</surname> <given-names>R. H. B.</given-names></string-name> (<year>2017</year>). <article-title>lmerTest Package: Tests in Linear Mixed Effects Models</article-title>. <source>Journal of Statistical Software</source>, <volume>82</volume>(<issue>13</issue>), <fpage>1</fpage>&#8211;<lpage>26</lpage>. DOI: <pub-id pub-id-type="doi">10.18637/jss.v082.i13</pub-id></mixed-citation></ref>
<ref id="B15"><label>15</label><mixed-citation publication-type="webpage"><string-name><surname>Lenth</surname>, <given-names>Russell V.</given-names></string-name> (<year>2021</year>). <article-title>emmeans: Estimated Marginal Means, aka Least-Squares Means</article-title>. R package version 1.6.2-1. <uri>https://CRAN.R-project.org/package=emmeans</uri></mixed-citation></ref>
<ref id="B16"><label>16</label><mixed-citation publication-type="journal"><string-name><surname>Martin</surname>, <given-names>C. D.</given-names></string-name>, <string-name><surname>Branzi</surname>, <given-names>F.M.</given-names></string-name>, &amp; <string-name><surname>Bar</surname>, <given-names>M.</given-names></string-name> (<year>2018</year>). <article-title>Prediction is Production: the missing link between language production and comprehension</article-title>. <source>Scientific Reports</source> <volume>8</volume>(<issue>1</issue>), <fpage>1079</fpage>. DOI: <pub-id pub-id-type="doi">10.1038/s41598-018-19499-4</pub-id></mixed-citation></ref>
<ref id="B17"><label>17</label><mixed-citation publication-type="book"><string-name><surname>Mitchell</surname>, <given-names>D. C.</given-names></string-name> (<year>1984</year>). <chapter-title>An evaluation of subject-paced reading tasks and other methods for investigating immediate processes in reading</chapter-title>. In <string-name><given-names>D.</given-names> <surname>Kieras</surname></string-name>, &amp; <string-name><given-names>M. A.</given-names> <surname>Just</surname></string-name> (Eds.). <source>New methods in reading comprehension</source>. <publisher-loc>Hillsdale, NJ</publisher-loc>: <publisher-name>Earlbaum</publisher-name>.</mixed-citation></ref>
<ref id="B18"><label>18</label><mixed-citation publication-type="journal"><string-name><surname>Nieuwland</surname>, <given-names>M. S.</given-names></string-name>, <string-name><surname>Arkhipova</surname>, <given-names>Y.</given-names></string-name>, &amp; <string-name><surname>Rodr&#237;guez-G&#243;mez</surname>, <given-names>P.</given-names></string-name> (<year>2020</year>). <article-title>Anticipating words during spoken discourse comprehension: A large-scale, pre-registered replication study using brain potentials</article-title>. <source>Cortex</source>, <volume>133</volume>, <fpage>1</fpage>&#8211;<lpage>36</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.cortex.2020.09.007</pub-id></mixed-citation></ref>
<ref id="B19"><label>19</label><mixed-citation publication-type="journal"><string-name><surname>Nieuwland</surname>, <given-names>M. S.</given-names></string-name>, <string-name><surname>Politzer-Ahles</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Heyselaar</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Segaert</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Darley</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Kazanina</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Von Grebmer Zu Wolfsthurn</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Bartolozzi</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>Kogan</surname>, <given-names>V.</given-names></string-name>, <string-name><surname>Ito</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Meziere</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Barr</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Rousselet</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Ferguson</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Busch-Moreno</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Fu</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Kulakova</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Tuomainen</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Husband</surname>, <given-names>E. M.</given-names></string-name>, <string-name><surname>Donaldson</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Kohu&#769;t</surname>, <given-names>Z.</given-names></string-name>, <string-name><surname>Rueschemeyer</surname>, <given-names>S.-A.</given-names></string-name>, &amp; <string-name><surname>Huettig</surname>, <given-names>F.</given-names></string-name> (<year>2018</year>). <article-title>Large-scale replication study reveals a limit on probabilistic prediction in language comprehension</article-title>. <source>ELife</source>, <volume>7</volume>, <elocation-id>e33468</elocation-id>. DOI: <pub-id pub-id-type="doi">10.7554/eLife.33468.024</pub-id></mixed-citation></ref>
<ref id="B20"><label>20</label><mixed-citation publication-type="journal"><string-name><surname>Otten</surname>, <given-names>M.</given-names></string-name> &amp; <string-name><surname>Van Berkum</surname>, <given-names>J. J. A.</given-names></string-name> (<year>2009</year>). <article-title>Does working memory capacity affect the ability to predict upcoming words in discourse?</article-title> <source>Brain Research</source>, <volume>1291</volume>, <fpage>92</fpage>&#8211;<lpage>101</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.brainres.2009.07.042</pub-id></mixed-citation></ref>
<ref id="B21"><label>21</label><mixed-citation publication-type="journal"><string-name><surname>Peer</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Brandimarte</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Samat</surname>, <given-names>S.</given-names></string-name>, &amp; <string-name><surname>Acquisti</surname>, <given-names>A.</given-names></string-name> (<year>2017</year>). <article-title>Beyond the turk: Alternative platforms for crowdsourcing behavioral research</article-title>. <source>Journal of Experimental Social Psychology</source>, <volume>70</volume>, <fpage>153</fpage>&#8211;<lpage>163</lpage>. DOI: <pub-id pub-id-type="doi">10.1016/j.jesp.2017.01.006</pub-id></mixed-citation></ref>
<ref id="B22"><label>22</label><mixed-citation publication-type="journal"><string-name><surname>Pickering</surname>, <given-names>M. J.</given-names></string-name> &amp; <string-name><surname>Gambi</surname>, <given-names>C.</given-names></string-name> (<year>2018</year>). <article-title>Predicting while comprehending language: A theory and review</article-title>. <source>Psychological Bulletin</source>, <volume>144</volume>(<issue>10</issue>), <fpage>1002</fpage>. DOI: <pub-id pub-id-type="doi">10.1037/bul0000158</pub-id></mixed-citation></ref>
<ref id="B23"><label>23</label><mixed-citation publication-type="journal"><string-name><surname>Politzer-Ahles</surname>, <given-names>S.</given-names></string-name> (<year>2017</year>). <article-title>An extension of within-subject confidence intervals to models with crossed random effects</article-title>. <source>The Quantitative Methods for Psychology</source>, <volume>13</volume>(<issue>1</issue>), <fpage>75</fpage>&#8211;<lpage>94</lpage>. DOI: <pub-id pub-id-type="doi">10.20982/tqmp.13.1.p075</pub-id></mixed-citation></ref>
<ref id="B24"><label>24</label><mixed-citation publication-type="journal"><string-name><surname>Van Berkum</surname>, <given-names>J. J.</given-names></string-name>, <string-name><surname>Brown</surname>, <given-names>C. M.</given-names></string-name>, <string-name><surname>Zwitserlood</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Kooijman</surname>, <given-names>V.</given-names></string-name>, &amp; <string-name><surname>Hagoort</surname>, <given-names>P.</given-names></string-name> (<year>2005</year>). <article-title>Anticipating upcoming words in discourse: evidence from ERPs and reading times</article-title>. <source>Journal of Experimental Psychology: Learning, Memory, and Cognition</source>, <volume>31</volume>(<issue>3</issue>), <fpage>443</fpage>. DOI: <pub-id pub-id-type="doi">10.1037/0278-7393.31.3.443</pub-id></mixed-citation></ref>
<ref id="B25"><label>25</label><mixed-citation publication-type="journal"><string-name><surname>Wicha</surname>, <given-names>N. Y. Y.</given-names></string-name>, <string-name><surname>Moreno</surname>, <given-names>E. M.</given-names></string-name>, &amp; <string-name><surname>Kutas</surname>, <given-names>M.</given-names></string-name> (<year>2004</year>). <article-title>Anticipating words and their gender: an event-related brain potential study of semantic integration, gender expectancy, and gender agreement in Spanish sentence reading</article-title>. <source>Journal of Cognitive Neuroscience</source>, <volume>16</volume>(<issue>7</issue>), <fpage>1272</fpage>&#8211;<lpage>1288</lpage>. DOI: <pub-id pub-id-type="doi">10.1162/0898929041920487</pub-id></mixed-citation></ref>
<ref id="B26"><label>26</label><mixed-citation publication-type="journal"><string-name><surname>Witzel</surname>, <given-names>J.</given-names></string-name> &amp; <string-name><surname>Forster</surname>, <given-names>K.</given-names></string-name> (<year>2014</year>). <article-title>Lexical co-occurrence and ambiguity resolution</article-title>. <source>Language, Cognition and Neuroscience</source>, <volume>29</volume>(<issue>2</issue>), <fpage>158</fpage>&#8211;<lpage>185</lpage>. DOI: <pub-id pub-id-type="doi">10.1080/01690965.2012.748925</pub-id></mixed-citation></ref>
<ref id="B27"><label>27</label><mixed-citation publication-type="journal"><string-name><surname>Witzel</surname>, <given-names>N.</given-names></string-name>, <string-name><surname>Witzel</surname>, <given-names>J.</given-names></string-name>, &amp; <string-name><surname>Forster</surname>, <given-names>K.</given-names></string-name> (<year>2012</year>). <article-title>Comparisons of online reading paradigms: Eye tracking, moving-window, and maze</article-title>. <source>Journal of Psycholinguistic Research</source>, <volume>41</volume>(<issue>2</issue>), <fpage>105</fpage>&#8211;<lpage>128</lpage>. DOI: <pub-id pub-id-type="doi">10.1007/s10936-011-9179-x</pub-id></mixed-citation></ref>
</ref-list>
</back>
</article>