<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<TEI xmlns="http://www.tei-c.org/ns/1.0">
  <teiHeader>
    <fileDesc>
      <titleStmt>
        <title type="main" level="a">The joint estimation of accuracy and speed: An application to the INVALSI data</title>
        <author>
          <persName n="1">
            <forename>Luca</forename>
            <surname>Bungaro</surname>
            <placeName type="affiliation">University of Bologna, Italy</placeName>
          </persName>
          <persName n="2" ref="https://orcid.org/0000-0002-3407-0002" type="ORCID">
            <forename>Marta</forename>
            <surname>Desimoni</surname>
            <placeName type="affiliation">INVALSI, Italy</placeName>
          </persName>
          <persName n="3" ref="https://orcid.org/0000-0003-3404-6325" type="ORCID">
            <forename>Mariagiulia</forename>
            <surname>Matteucci</surname>
            <placeName type="affiliation">University of Bologna, Italy</placeName>
          </persName>
          <persName n="4" ref="https://orcid.org/0000-0003-4746-1130" type="ORCID">
            <forename>Stefania</forename>
            <surname>Mignani</surname>
            <placeName type="affiliation">University of Bologna, Italy</placeName>
          </persName>
        </author>
        <respStmt>
          <resp>This is a section of <title>ASA 2022 Data-Driven Decision Making</title>(DOI: <idno type="DOI">10.36253/979-12-215-0106-3</idno>) by </resp>
          <name>Enrico di Bella, Luigi Fabbris, Corrado Lagazio</name>
        </respStmt>
      </titleStmt>
      <publicationStmt>
        <publisher>Firenze University Press</publisher>
        <pubPlace>Firenze</pubPlace>
        <date when="2023">2023</date>
        <idno type="DOI">https://doi.org/10.36253/979-12-215-0106-3.39</idno>
        <availability>
          <p>Available for academic research purposes</p>
          <p>Open Access</p>
          <p>Copyright Author(s)</p>
          <licence source="text" target="https://creativecommons.org/licenses/by/4.0/legalcode">
            <p>Content licence CC BY 4.0</p>
          </licence>
          <licence source="metadata" target="https://creativecommons.org/publicdomain/zero/1.0/legalcode">
            <p>Metadata licence CC0 1.0</p>
          </licence>
        </availability>
      </publicationStmt>
      <sourceDesc>
        <p>This is original content, published for academic research purposes</p>
      </sourceDesc>
    </fileDesc>
    <encodingDesc>
      <appInfo>
        <application version="2.2" ident="Booksflow">
          <desc>Digital edition XML powered by Booksflow</desc>
        </application>
      </appInfo>
    </encodingDesc>
    <profileDesc>
      <abstract xml:lang="en">
        <p>In Italy, the National Institute for the Evaluation of the Education and Training System (INVALSI) every year administers standardized tests via computer-based testing (CBT) to students attending grades 8, 10, and 13. The CBT mode allows to collect data not only on the students’ response accuracy (RA) based on item responses, but also on their response times (RT). By using these data, it is now possible to estimate the speed ability of examinees, besides the usual ability (e.g. Italian language, mathematics or English ability). In this study, we use the 2018 mathematics data for grade 10 to estimate the ability and speed of students following the fully Bayesian approach of Fox et al. (2021), who implemented in the R package LNIRT the models of van der Linden (2007) and Klein Entik et al. (2009). In a second step, we use the estimated mathematics ability and speed in a bivariate multilevel model, where the first-level units are represented by students and the second-level units are represented by classes. Covariates such as gender, school type, immigrant status, economic, social, and cultural status, prior achievement, grade retention, student anxiety, class compositional variables, and geographical area are included in the model. The main results show that the ability and speed are inversely proportional, e.g. as ability increases, speed decreases. Also, differences in the students performance by gender and school type are significant for both ability and speed.</p>
      </abstract>
      <textClass>
        <keywords>
          <list>
            <item>educational assessment</item>
            <item>large standardized test</item>
            <item>mathematics achievement</item>
            <item>IRT models for response times</item>
            <item>multilevel models</item>
          </list>
        </keywords>
      </textClass>
    </profileDesc>
  </teiHeader>
  <text>
    <body>
      <p>It is available online at https://doi.org/10.36253/979-12-215-0106-3.39<ref target="https://doi.org/10.36253/979-12-215-0106-3.39" /></p>
      <div>
        <listBibl>
          <head>References</head>
          <bibl n="112123">Charlton, C., Rasbash, J., Browne, W.J., Healy, M., Cameron, B. (2020). MLwiN Version 3.05. Centre for Multilevel Modelling, University of Bristol.</bibl>
          <bibl n="112124">Fox, J. P., Klotzke, K., &amp;amp; Simsek, A. S. (2021). LNIRT: An R Package for Joint Modeling of Response Accuracy and Times. arXiv preprint arXiv:2106.10144.</bibl>
          <bibl n="112125">Klein Entink, R. H., Fox, J.-P., van der Linden, W. J. (2009). A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers. Psychometrika, 74(1), pp. 21-48.</bibl>
          <bibl n="112126">Rasbash, J., Steele, F., Browne, W.J., Goldstein, H. (2017). A User&amp;#39;s Guide to MLwiN, v3.00. Centre for Multilevel Modelling, University of Bristol.</bibl>
          <bibl n="112127">van der Linden, W. J. (2007). A Hierarchical Framework for Modeling Speed and Accuracy on Test Items. Psychometrika, 72(3), 287.</bibl>
        </listBibl>
      </div>
    </body>
  </text>
</TEI>