- - - - - - - - - - - - - - - - - - - - - -
 Divisions
  Overview
  Academic Policy & Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     2012 HSA and Mod-HSA Technical Report
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Science Technical Reports
     MSA Technical Reports
     Staff and Student Publications
     State Test Administration and Security Committee Fact Sheet
  Career and College Readiness
  Communications, Partnerships, and Grants
  Curriculum, Assessment & Accountability
  Educator Effectiveness
  Early Childhood Development
  Finance
  Information Technology
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions
Divisions > Accountability, Assessment, and Data Systems
2009 MSA Science Technical Report

Maryland School Assessment (MSA)
Science
Grades 5 and 8

Technical Report: 2009 Administration



TABLE OF CONTENTS

Test Overview and Design

Introduction

Purpose

Test Overview

Purpose and Use

Test Content, Specifications and Design

MSA Science Item Types

MSA Science Operational Test Blueprints
Table 1. Grade 5 MSA Science Blueprint
Table 2. Grade 8 MSA Science Blueprint

MSA Science 2009 Operational Test Construction

MSA Science 2009 Field Test Design
Table 3. 2009 MSA Science Test Form Design

Item Development and Review

Operational Item Analysis and Equating


Testing Population
Table 4. Demographic Characteristics of Grade 5 and Grade 8 Sample for Overall, Online, and Paper


Distribution of Students Across Forms
Table 5. Distribution of Forms by Grade

Key Check Analysis of Operational Test Data

Analysis

Classical Item Analysis

IRT Calibration

Equating
Table 6. Operational Transformation Constants

Test Analysis, Operational Scaling and Scoring

Test Analysis

Defining Scale Ranges
Table 7. Target LOSS, HOSS, and Scaling Constants for Grades 5 and 8

ISE Pattern Scoring

Conditional Standard Errors for LOSS and HOSS

Test Score Reliability
Table 8. Reliability Estimate by Grade, Form, Gender and Ethnicity

Student Performance

Score Interpretation

Scale Scores

Performance Levels and Descriptions
Table 9. Scale Score Cut Scores for Grades 5 and 8 MSA Science
Table 10. Grades 5 Performance Level Percentages and Summary Statistics

Table 11. Grades 8 Performance Level Percentages and Summary Statistics

Field Test Item Analysis and Calibration

Key Check Analysis of Field Test Data

Classical Item Analysis

Field Test Calibration
Table 12. Field Test Transformation Constants

Differential Item Functioning (DIF) Analysis
Table 13. DIF Flag Summaries from all MSA Science Field Test Items

Data Review of the Field Test Items

Results of Data Review

Validity

Content-Related Validity


Construct-Related Validity

Item-Total Correlation
Table 14. Summary of Adjusted Point-Biserial Correlations

Inter-Correlations Among Standards
Table 15. Correlation Among MSA Science Content Standards

Confirmatory Factor Analysis
Table 16. Fit Indicators for Confirmatory Factor Analysis on MSA Science

Validity Evidence for Scores From Accommodated Testing
Table 17. Fit Indicators for Accommodations/Non-Accommodations Based CFA

Validity Evidence for Different Populations

References

Appendices

Appendix A Classical Item Statistics: Operational Forms
Appendix B Classical Item Statistics: Field Test Items

A complete copy of the 2009 MSA Science Technical Report is also available.

Contact Information
Carolyn Wood, Assistant State Superintendent
Division of Accountability, Assessment, and Data Systems
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE