Comparison of test equating methods based on item response. The r package equateirt implements item response theory irt methods for equating different forms composed of dichotomous items. Metrics provides a large set of tools for data analysis in one place. A multilevel, multidimensional, and multiple group item response theory irt software package for item analysis and test scoring. Irteq can equate test scores on the scale of a test to another test using irt true score equating. Foundational aspects the term score linking is used to describe the transformation from a score on one test to a score on another test. Item response theory psychology oxford bibliographies. An r package for irt test equating the r package equateirt implements item response theory irt methods for equating different forms composed of dichotomous items. Irteq windows application that implements irt scaling. In many testing programs, security reasons require that test forms are composed of different items, making test scores not comparable across. This talk focuses on item response theory irt methods for dichotomous items. Forms can be equated when they present common items direct equating or when they. Value for the default method, and when verbose false, a vector of.
In nonequivalent groups with anchor test design, irt observed score equating shows lowest systematic and random errors among equating methods. I highly recommend xcalibre since it is easy to use and automatically creates reports in word for you. Abstract item response theory irt observedscore kernel equating is introduced for the nonequivalent groups with anchor test equating design using either chain equating or poststratification equating. Test scoring can be performed by true score equating and observed score equating methods. Rasch, oneparameter logistic, twoparameter logistic and threeparameter logistic models are included. Because irt item parameter scaling and linking is required for many operational. Equating test scores between different achievement test versions is important to assure comparability between test takers scores. How test length and sample size have an impact on the standard errors for irt true score equating. Linkage plans can be rather complex, including many forms, several links, and the connection of forms through different paths. The third approach is a combination of the two above. Provides a simple common interface to the estimation of item parameters in irt models for binary responses with three different programs icl, bilogmg, and ltm, and a variety of functions useful with irt models. Windows application that implements irt scaling and equating. Pdf the r package equate irt implements item response theory irt methods for.
Model selection for irt equating of testletbased tests. Despite the volume of research, it has been difficult to draw conclusions and make generalizations because different studies have used different types of tests, different types of samples, and different methods for assessing the accuracy of. Composite linking and equating create a single linking or equating function as a weighted combination of two or more other linking or equating functions. Item response theory irt truescore equating for the bifactor model is often conducted by first numerically integrating out specific factors from the item response function and then applying the. The 3 best approaches for irt equating assess computerized. A comparison of irt observed score kernel equating and. Equating is basically the process of determining the relationship between raw or scaled scores on two or more test. The application of item response theory irt methodology to test equating has been a research topic of considerable interest in the past 2 decades. Garron gianopulos senior psychometrician nwea linkedin.
Buchanan missouri state university summer 2016 this video covers ltm, tpm, and mirt on how to perform a 2pl3pl on dichotomous da. The flexmirt irt software package fits a variety of unidimensional and multidimensional item response theory models also known as item factor analysis models to singlelevel and multilevel data in any number of groups. The irt models included are the threeparameter logistic model, the twoparameter logistic model, the oneparameter logistic model and the rasch model. Assessment development, classical test theory, item response theory, structural equation modeling, test equating, score reporting, irt software packages irtpro, flexmirt, r. Irt equating methods include meanmean, meansigma, haebara, and stockinglord procedures. Two relatively simple mirt models that can be used to fit data from mixed. Simple interface to the estimation and plotting of irt models. Different subjects might receive entirely different items during the test. To perform irt equating, one can use the equateirt package in r battauz, 2015, which. Computer programs college of education university of iowa. Description usage arguments details value authors references see also examples. Instead, the equateirtpackageprovidesanalyticalstandarderrorsfordirect,chainandaverageequating coe. Reference list of noncommercial software for irt analyses. For example, available software cannot handle all the popular irt.
Approximating bifactor irt truescore equating with a. In order to equate two different test forms, we need to set the. Dif detection can be performed using a waldtype test. Irteq can rescale a test form to another using various irt scaling methods. Irt equating home assess computerized adaptive testing. Other useful packages include ltm rizopoulos, j stat softw 175. Those errors decrease as a shorter test and a larger sample are used in equating. As many items are modelled with item response theory irt, it. Imagine that test a the more definitive test, if there is one has been given to one sample of persons, and test. Asymptotic standard errors of irt equating coefficients using moments. Irt test equating in complex linkage plans springerlink.
Irt test equating with the r package equateirt user. Lord, 1980 a common tool for test constructors when creating and analyzing tests, it makes sense to use irt equating methods when equating test scores. Since the turn of the century, much has been written on score equating and linking. The equating function is treated in a multivariate setting and the asymptotic covariance matrices of irt observedscore kernel equating functions are derived. Irtlrdif is software that computes likelihood ratio tests of dif for the 3pl and graded irt models. Test scoring can be performed by true score equating and observed score. Irtclass is a pc console version of a fortran computer program that computes classification consistency and accuracy indices for raw and scale scores. In many testing programs, security reasons require that test forms are. The test form to which we are equating the new form.
In a computerized adaptive test, items are optimally selected for each subject. Genova suite programs equating recipes opensource code and monograph. List of software packages for assessing test dimensionality. The equating process aims to provide comparable test scores. An exploratory study of the applicability of item response theory methods to the graduate management admissions test rr8534. The chapter also discusses some newly developed equating methods with multidimensional irt mirt frameworks. Model selection for irt equating of testletbased tests in. Irt equating methods this package computes direct, chain and average bisector equating coefficients with standard errors using irt methods for dichotomous items. Its applications also extend to the measurement of a variety of latent constructs in a variety of disciplines.
Test score equating is used to compare different test scores from different test forms. The use of testlets in a test can cause multidimensionality and local item dependence lid, which can result in inaccurate estimation of item parameters, and in turn compromise the quality of item response theory irt true and observed score equating of testletbased tests. Standard errors of item response theory equating linking by response function. If you want to do irt equating, you need irt calibration software. Equating determines for each score on the new form the corresponding score on the reference form. Irt models included are the threeparameter logistic model, the twoparameter logistic model. Metrics includes an engine for irt test scoring, six different test equating models, powerful, interactive visual displays, errorinvariable regression models including linear, mixed linear, and direct estimation regression using marginal maximum likelihood. Irteq windows application that implements irt scaling and. The irt models included are the threeparameter logistic model, the twoparameter logistic model, the. Mstgen is a simulated data generator for multistage testing. In particular, the irt models included are the threeparameter logistic model, the twoparameter logistic model, the oneparameter logistic model and the rasch model. This article studies item response theory equating methods for complex linkage plans when the commonitem nonequivalent group design is used.
Irteq provides an intuitive, userfriendly interface and. Item location effects and their implications for irt equating and adaptive testing. In order to ensure that one or more examinees will not encounter test questions they may have previously seen, most testing programs develop many forms or. One of the most important concerns facing any largescale testing program is the equating of test scores from different forms of a test. The smaller the sees, the more the equating accuracy. Item response theory observedscore kernel equating. Several methods have been developed to conduct equating. Both unidimensional and multidimensional irt models have been developed to control local item dependence caused by. The most common application of irt is in education, where psychometricians use it for developing and designing exams, maintaining banks of items for exams, and equating the difficulties of items for successive versions of exams for example, to allow comparisons between results over time.
Irtclass is intended to be used for tests that are scaled using dichotomous, polytomous, or mixtures of different irt models. The more thought is put into test construction and data collection, the easier the equating will be. Irt provides a foundation for statistical methods that are utilized in contexts such as test development, item analysis, equating, item banking, and computerized adaptive testing. Calibrating and linking item parameters to a base scale. If you want to learn more about the topic of equating, the classic reference is. If you are delivering high stakes tests in linear forms or piloting a bank. The irt calibration software will automatically equate the two forms. The irt calibration software will automatically equate the two forms and you can use the resultant scores. And, the few computer programs for test scaling and equating that have.
Macros and manual equatinglinking programs irt scale transformation programs. In irt models, the probability of a correct response depends on the latent trait under investigation and on the item parameters. Irt plays an essential role in selecting the most appropriate items for each subject and equating scores for subjects. An efficient way to average equating coefficients that link the same two forms through different paths will be.
448 804 898 158 705 1101 303 452 1028 1297 1407 994 211 1329 63 416 459 1431 1149 1292 933 182 1367 208 345 469 1172 1129 1358 356 1232 722 640 640 141 831 644 1362 20 231 138 1160 72 698 1119 288