Robert J. Mislevy - Böcker

In the United States, the nomenclature of adult education includes adult literacy, adult secondary education, and English for speakers of other languages (ESOL) services provided to undereducated and limited English proficient adults. Those receiving adult education services have diverse reasons for seeking additional education. With the passage of the WIA, the assessment of adult education students became mandatory-regardless of their reasons for seeking services. The law does allow the states and local programs flexibility in selecting the most appropriate assessment for the student. The purpose of the NRC's workshop was to explore issues related to efforts to measure learning gains in adult basic education programs, with a focus on performance-based assessments.

A Single Cohesive Framework of Tools and Procedures for Psychometrics and AssessmentBayesian Psychometric Modeling presents a unified Bayesian approach across traditionally separate families of psychometric models. It shows that Bayesian techniques, as alternatives to conventional approaches, offer distinct and profound advantages in achieving many goals of psychometrics.Adopting a Bayesian approach can aid in unifying seemingly disparate—and sometimes conflicting—ideas and activities in psychometrics. This book explains both how to perform psychometrics using Bayesian methods and why many of the activities in psychometrics align with Bayesian thinking.The first part of the book introduces foundational principles and statistical models, including conceptual issues, normal distribution models, Markov chain Monte Carlo estimation, and regression. Focusing more directly on psychometrics, the second part covers popular psychometric models, including classical test theory, factor analysis, item response theory, latent class analysis, and Bayesian networks. Throughout the book, procedures are illustrated using examples primarily from educational assessments. A supplementary website provides the datasets, WinBUGS code, R code, and Netica files used in the examples.

Several key developments challenge the field of educational measurement today: demands for tests at larger scales with higher stakes, an improved understanding of how people develop capabilities, and new technologies for interactive digital assessments. Sociocognitive Foundations of Educational Measurement integrates new developments in educational measurement and educational psychology in order to provide researchers, testing professionals, and students with an innovative sociocognitive perspective on assessment. This comprehensive volume begins with a broad explanation of the sociocognitive perspective and the foundations of assessment, then provides a series of focused applications to major topics such as assessment arguments, validity, fairness, interactive assessment, and a conception of "measurement" in educational assessment. Classical test theory, item response theory, categorical models, mixture models, cognitive diagnosis models, and Bayesian networks are explored from the resulting perspective. Ideal for specialists in these areas, graduate students, developers, and scholars in both educational measurement and fields that contribute to a sociocognitive perspective, this book consolidates nearly a decade of research into a fresh perspective on educational measurement.

Several key developments challenge the field of educational measurement today: demands for tests at larger scales with higher stakes, an improved understanding of how people develop capabilities, and new technologies for interactive digital assessments. Sociocognitive Foundations of Educational Measurement integrates new developments in educational measurement and educational psychology in order to provide researchers, testing professionals, and students with an innovative sociocognitive perspective on assessment. This comprehensive volume begins with a broad explanation of the sociocognitive perspective and the foundations of assessment, then provides a series of focused applications to major topics such as assessment arguments, validity, fairness, interactive assessment, and a conception of "measurement" in educational assessment. Classical test theory, item response theory, categorical models, mixture models, cognitive diagnosis models, and Bayesian networks are explored from the resulting perspective. Ideal for specialists in these areas, graduate students, developers, and scholars in both educational measurement and fields that contribute to a sociocognitive perspective, this book consolidates nearly a decade of research into a fresh perspective on educational measurement.

The editors of this volume suggest that there are missing elements in the conceptualization upon which standard test theory is based. Those elements are models for just how people know what they know and do what they can do, and the ways in which they increase these capacities. Different models are useful for different purposes; therefore, broader or alternative student models may be appropriate. The chapters in this volume consider a variety of directions in which standard test theory might be extended. Topics covered include: the role of test theory in light of recent work in cognitive and educational psychology, test design, student modeling, test analysis, and the integration of assessment and instruction.

Since it was developed in the 1960s, Computerized Adaptive Testing (CAT) has since become a standard in vocational testing. Looking at CAT in education, this book covers topics such as item response theory, item calibration, proficiency estimation and more.

The use of computers and the Internet in the testing community has expanded the opportunity for innovative testing. Until now, there was no one source that reviewed the latest methods of automated scoring for complex assessments. This is the first volume to provide that coverage, along with examples of "best practices" in the design, implementation, and evaluation of automated complex assessment. The contributing authors, all noted leaders in the field, introduce each method in the context of actual applications in real assessments so as to provide a realistic view of current industry practices. Evidence Centered Design, an innovative approach to assessment design, is used as the book's conceptual framework. The chapters review both well known methods for automated scoring such as rule-based logic, regression-based, and IRT systems, as well as more recent procedures such as Bayesian and neural networks. The concluding chapters compare and contrast the various methods and provide a vision for the future. Each chapter features a discussion of the philosophical and practical approaches of the method, the associated implications for validity, reliability, and implementation, and the calculations and processes of each technique. Intended for researchers, practitioners, and advanced students in educational testing and measurement, psychometrics, cognitive science, technical training and assessment, diagnostic, licensing, and certification exams, and expert systems, the book also serves as a resource in advanced courses in educational measurement or psychometrics.

The use of computers and the Internet in the testing community has expanded the opportunity for innovative testing. Until now, there was no one source that reviewed the latest methods of automated scoring for complex assessments. This is the first volume to provide that coverage, along with examples of "best practices" in the design, implementation, and evaluation of automated complex assessment. The contributing authors, all noted leaders in the field, introduce each method in the context of actual applications in real assessments so as to provide a realistic view of current industry practices. Evidence Centered Design, an innovative approach to assessment design, is used as the book's conceptual framework. The chapters review both well known methods for automated scoring such as rule-based logic, regression-based, and IRT systems, as well as more recent procedures such as Bayesian and neural networks. The concluding chapters compare and contrast the various methods and provide a vision for the future. Each chapter features a discussion of the philosophical and practical approaches of the method, the associated implications for validity, reliability, and implementation, and the calculations and processes of each technique. Intended for researchers, practitioners, and advanced students in educational testing and measurement, psychometrics, cognitive science, technical training and assessment, diagnostic, licensing, and certification exams, and expert systems, the book also serves as a resource in advanced courses in educational measurement or psychometrics.

The editors of this volume suggest that there are missing elements in the conceptualization upon which standard test theory is based. Those elements are models for just how people know what they know and do what they can do, and the ways in which they increase these capacities. Different models are useful for different purposes; therefore, broader or alternative student models may be appropriate. The chapters in this volume consider a variety of directions in which standard test theory might be extended. Topics covered include: the role of test theory in light of recent work in cognitive and educational psychology, test design, student modeling, test analysis, and the integration of assessment and instruction.

This celebrated primer presents an introduction to all of the key ingredients in understanding computerized adaptive testing technology, test development, statistics, and mental test theory. Based on years of research, this accessible book educates the novice and serves as a compendium of state-of-the-art information for professionals interested in computerized testing in the areas of education, psychology, and other related social sciences. A hypothetical test taken as a prelude to employment is used as a common example throughout to highlight this book's most important features and problems.Changes in the new edition include:*a completely rewritten chapter 2 on the system considerations needed for modern computerized adaptive testing;*a revised chapter 4 to include the latest in methodology surrounding online calibration and in the modeling of testlets; and*a new chapter 10 with helpful information on how test items are really selected, usage patterns, how usage patterns influence the number of new items required, and tools for managing item pools.

A Single Cohesive Framework of Tools and Procedures for Psychometrics and AssessmentBayesian Psychometric Modeling presents a unified Bayesian approach across traditionally separate families of psychometric models. It shows that Bayesian techniques, as alternatives to conventional approaches, offer distinct and profound advantages in achieving many goals of psychometrics.Adopting a Bayesian approach can aid in unifying seemingly disparate—and sometimes conflicting—ideas and activities in psychometrics. This book explains both how to perform psychometrics using Bayesian methods and why many of the activities in psychometrics align with Bayesian thinking.The first part of the book introduces foundational principles and statistical models, including conceptual issues, normal distribution models, Markov chain Monte Carlo estimation, and regression. Focusing more directly on psychometrics, the second part covers popular psychometric models, including classical test theory, factor analysis, item response theory, latent class analysis, and Bayesian networks. Throughout the book, procedures are illustrated using examples primarily from educational assessments. A supplementary website provides the datasets, WinBUGS code, R code, and Netica files used in the examples.

Bayesian Networks in Educational Assessment

Bayesian inference networks, a synthesis of statistics and expert systems, have advanced reasoning under uncertainty in medicine, business, and social sciences. This innovative volume is the first comprehensive treatment exploring how they can be applied to design and analyze innovative educational assessments.Part I develops Bayes nets’ foundations in assessment, statistics, and graph theory, and works through the real-time updating algorithm. Part II addresses parametric forms for use with assessment, model-checking techniques, and estimation with the EM algorithm and Markov chain Monte Carlo (MCMC). A unique feature is the volume’s grounding in Evidence-Centered Design (ECD) framework for assessment design. This “design forward” approach enables designers to take full advantage of Bayes nets’ modularity and ability to model complex evidentiary relationships that arise from performance in interactive, technology-rich assessments such as simulations. Part III describes ECD,situates Bayes nets as an integral component of a principled design process, and illustrates the ideas with an in-depth look at the BioMass project: An interactive, standards-based, web-delivered demonstration assessment of science inquiry in genetics.This book is both a resource for professionals interested in assessment and advanced students.  Its clear exposition, worked-through numerical examples, and demonstrations from real and didactic applications provide invaluable illustrations of how to use Bayes nets in educational assessment. Exercises follow each chapter, and the online companion site provides a glossary, data sets and problem setups, and links to computational resources.

This book defines and describes a new discipline, named “computational psychometrics,” from the perspective of new methodologies for handling complex data from digital learning and assessment.

This book defines and describes a new discipline, named “computational psychometrics,” from the perspective of new methodologies for handling complex data from digital learning and assessment.