Innovations in Language Learning and Assessment at ETS – serie

This book introduces a new framework for analyzing second language (L2) learners’ written texts. The authors conducted a major study on changes and differences in English L2 learners’ writing performance to advance understanding of the nature of L2 writing development over time, in relation to L2 instruction and testing, and to offer a model that professionals and researchers can use in their own longitudinal and cross-sectional studies of L2 writing development. Grounded in research, data, theory, and technology, this will be a welcome how-to for language test developers, scholars, and graduate students of (L2) writing and assessment.

This book introduces a new framework for analyzing second language (L2) learners’ written texts. The authors conducted a major study on changes and differences in English L2 learners’ writing performance to advance understanding of the nature of L2 writing development over time, in relation to L2 instruction and testing, and to offer a model that professionals and researchers can use in their own longitudinal and cross-sectional studies of L2 writing development. Grounded in research, data, theory, and technology, this will be a welcome how-to for language test developers, scholars, and graduate students of (L2) writing and assessment.

Second Language Educational Experiences for Adult Learners provides an up-to-date review of the theory and practice of adult second language education. The primary objective is to introduce core ideas that should inform the design, development, and delivery of language learning experiences that take the typical forms of materials, courses, teaching, and assessment. Divided into three sections, the book first addresses what we know about adult second language acquisition and how individuals may acquire languages differently from each other. In the second section, key educational design elements—from pedagogical methods to curriculum to assessment—are then introduced from the perspective of research-based understandings about effective practices. Rounding out the volume is an overview of critical issues for language educational innovation, including supporting teachers, localizing materials and instruction, evaluating and improving education, and working with technology. Each chapter concludes with a set of recommended “design principles” that should guide readers toward high-quality, valuable, and empirically supported language educational experiences. This volume will be of interest to researchers and students investigating instructed language learning, designers creating useful language learning materials, and language teaching innovators seeking to improve outcomes in diverse instructional settings around the world.

Second Language Educational Experiences for Adult Learners provides an up-to-date review of the theory and practice of adult second language education. The primary objective is to introduce core ideas that should inform the design, development, and delivery of language learning experiences that take the typical forms of materials, courses, teaching, and assessment. Divided into three sections, the book first addresses what we know about adult second language acquisition and how individuals may acquire languages differently from each other. In the second section, key educational design elements—from pedagogical methods to curriculum to assessment—are then introduced from the perspective of research-based understandings about effective practices. Rounding out the volume is an overview of critical issues for language educational innovation, including supporting teachers, localizing materials and instruction, evaluating and improving education, and working with technology. Each chapter concludes with a set of recommended “design principles” that should guide readers toward high-quality, valuable, and empirically supported language educational experiences. This volume will be of interest to researchers and students investigating instructed language learning, designers creating useful language learning materials, and language teaching innovators seeking to improve outcomes in diverse instructional settings around the world.

Assessing Academic English for Higher Education Admissions is a state-of-the-art overview of advances in theories and practices relevant to the assessment of academic English skills for higher education admissions purposes. The volume includes a brief introduction followed by four main chapters focusing on critical developments in theories and practices for assessing reading, listening, writing, and speaking, of which the latter two also address the assessment of integrated skills such as reading-writing, listening-speaking, and reading-listening-speaking. Each chapter reviews new task types, scoring approaches, and scoring technologies and their implications in light of the increasing use of technology in academic communication and the growing use of English as a lingua franca worldwide. The volume concludes with recommendations about critical areas of research and development that will help move the field forward. Assessing Academic English for Higher Education Admissions is an ideal resource for researchers and graduate students in language testing and assessment worldwide.

Assessing Academic English for Higher Education Admissions is a state-of-the-art overview of advances in theories and practices relevant to the assessment of academic English skills for higher education admissions purposes. The volume includes a brief introduction followed by four main chapters focusing on critical developments in theories and practices for assessing reading, listening, writing, and speaking, of which the latter two also address the assessment of integrated skills such as reading-writing, listening-speaking, and reading-listening-speaking. Each chapter reviews new task types, scoring approaches, and scoring technologies and their implications in light of the increasing use of technology in academic communication and the growing use of English as a lingua franca worldwide. The volume concludes with recommendations about critical areas of research and development that will help move the field forward. Assessing Academic English for Higher Education Admissions is an ideal resource for researchers and graduate students in language testing and assessment worldwide.

Automated Speaking Assessment: Using Language Technologies to Score Spontaneous Speech provides a thorough overview of state-of-the-art automated speech scoring technology as it is currently used at Educational Testing Service (ETS). Its main focus is related to the automated scoring of spontaneous speech elicited by TOEFL iBT Speaking section items, but other applications of speech scoring, such as for more predictable spoken responses or responses provided in a dialogic setting, are also discussed. The book begins with an in-depth overview of the nascent field of automated speech scoring—its history, applications, and challenges—followed by a discussion of psychometric considerations for automated speech scoring. The second and third parts discuss the integral main components of an automated speech scoring system as well as the different types of automatically generated measures extracted by the system features related to evaluate the speaking construct of communicative competence as measured defined by the TOEFL iBT Speaking assessment. Finally, the last part of the book touches on more recent developments, such as providing more detailed feedback on test takers’ spoken responses using speech features and scoring of dialogic speech. It concludes with a discussion, summary, and outlook on future developments in this area. Written with minimal technical details for the benefit of non-experts, this book is an ideal resource for graduate students in courses on Language Testing and Assessment as well as teachers and researchers in applied linguistics.

Automated Speaking Assessment: Using Language Technologies to Score Spontaneous Speech provides a thorough overview of state-of-the-art automated speech scoring technology as it is currently used at Educational Testing Service (ETS). Its main focus is related to the automated scoring of spontaneous speech elicited by TOEFL iBT Speaking section items, but other applications of speech scoring, such as for more predictable spoken responses or responses provided in a dialogic setting, are also discussed. The book begins with an in-depth overview of the nascent field of automated speech scoring—its history, applications, and challenges—followed by a discussion of psychometric considerations for automated speech scoring. The second and third parts discuss the integral main components of an automated speech scoring system as well as the different types of automatically generated measures extracted by the system features related to evaluate the speaking construct of communicative competence as measured defined by the TOEFL iBT Speaking assessment. Finally, the last part of the book touches on more recent developments, such as providing more detailed feedback on test takers’ spoken responses using speech features and scoring of dialogic speech. It concludes with a discussion, summary, and outlook on future developments in this area. Written with minimal technical details for the benefit of non-experts, this book is an ideal resource for graduate students in courses on Language Testing and Assessment as well as teachers and researchers in applied linguistics.

Assessing English Language Proficiency in U.S. K–12 Schools offers comprehensive background information about the generation of standards-based, English language proficiency (ELP) assessments used in U.S. K–12 school settings. The chapters in this book address a variety of key issues involved in the development and use of those assessments: defining an ELP construct driven by new academic content and ELP standards, using technology for K–12 ELP assessments, addressing the needs of various English learner (EL) students taking the assessments, connecting assessment with teaching and learning, and substantiating validity claims. Each chapter also contains suggestions for future research that will contribute to the next generation of K–12 ELP assessments and improve policies and practices in the use of the assessments. This book is intended to be a useful resource for researchers, graduate students, test developers, practitioners, and policymakers who are interested in learning more about large-scale, standards-based ELP assessments for K–12 EL students.

Assessing English Language Proficiency in U.S. K–12 Schools offers comprehensive background information about the generation of standards-based, English language proficiency (ELP) assessments used in U.S. K–12 school settings. The chapters in this book address a variety of key issues involved in the development and use of those assessments: defining an ELP construct driven by new academic content and ELP standards, using technology for K–12 ELP assessments, addressing the needs of various English learner (EL) students taking the assessments, connecting assessment with teaching and learning, and substantiating validity claims. Each chapter also contains suggestions for future research that will contribute to the next generation of K–12 ELP assessments and improve policies and practices in the use of the assessments. This book is intended to be a useful resource for researchers, graduate students, test developers, practitioners, and policymakers who are interested in learning more about large-scale, standards-based ELP assessments for K–12 EL students.

The assessment of second language speaking ability has played a central role in the evolution of language testing theory and practice. Educational Testing Service (ETS) has been a primary innovator in all dimensions of speaking assessment since the 1970s, addressing critical challenges through the advent of new test designs, scoring practices, and measurement technologies to make especially large-scale, standardized testing of speaking ability a reality.This volume presents a sample of key ETS research and development efforts related to speaking assessment over the years. The contributors highlight diverse contributions to conceptualizing the speaking construct, designing speaking test tasks, scoring speech samples, marshalling technologies for test delivery and automated scoring, and developing end-to-end speaking assessment procedures. The first part emphasizes how some of the earliest large-scale speaking assessments were designed and put into practice. The second part features research and development related to speaking assessments in the TOEIC and TOEFL testing suites, emphasizing their validity and scoring. The third part introduces research-based innovations in testing new and more nuanced speaking constructs, and in using automated scoring of speech to address diverse assessment needs.The volume will appeal to language testing professionals and test score users in illuminating how ETS has influenced the development of speaking assessment as well as pointing to multiple directions for future research and practice.

The assessment of second language speaking ability has played a central role in the evolution of language testing theory and practice. Educational Testing Service (ETS) has been a primary innovator in all dimensions of speaking assessment since the 1970s, addressing critical challenges through the advent of new test designs, scoring practices, and measurement technologies to make especially large-scale, standardized testing of speaking ability a reality.This volume presents a sample of key ETS research and development efforts related to speaking assessment over the years. The contributors highlight diverse contributions to conceptualizing the speaking construct, designing speaking test tasks, scoring speech samples, marshalling technologies for test delivery and automated scoring, and developing end-to-end speaking assessment procedures. The first part emphasizes how some of the earliest large-scale speaking assessments were designed and put into practice. The second part features research and development related to speaking assessments in the TOEIC and TOEFL testing suites, emphasizing their validity and scoring. The third part introduces research-based innovations in testing new and more nuanced speaking constructs, and in using automated scoring of speech to address diverse assessment needs.The volume will appeal to language testing professionals and test score users in illuminating how ETS has influenced the development of speaking assessment as well as pointing to multiple directions for future research and practice.

English Language Proficiency Assessments for Young Learners provides both theoretical and empirical information about assessing the English language proficiency of young learners. Using large-scale standardized English language proficiency assessments developed for international or U.S. contexts as concrete examples, this volume illustrates rigorous processes of developing and validating assessments with considerations of young learners’ unique characteristics. In this volume, young learners are defined as school-age children from approximately 5 to 13 years old, learning English as a foreign language (EFL) or a second language (ESL). This volume also discusses innovative ways to assess young learners’ English language abilities based on empirical studies, with each chapter offering stimulating ideas for future research and development work to improve English language assessment practices with young learners. English Language Proficiency Assessments for Young Learners is a useful resource for students, test developers, educators, and researchers in the area of language testing and assessment.