- - - - - - - - - - - - - - - - - - - - - -
 Divisions
  Overview
  Academic Policy & Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     2012 HSA and Mod-HSA Technical Report
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Science Technical Reports
     MSA Technical Reports
     Staff and Student Publications
     State Test Administration and Security Committee Fact Sheet
  Career and College Readiness
  Communications, Partnerships, and Grants
  Curriculum, Assessment & Accountability
  Educator Effectiveness
  Early Childhood Development
  Finance
  Information Technology
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions
Divisions > Accountability, Assessment, and Data Systems
2008 MSA Science Technical Report

Maryland School Assessment (MSA)
Science
Grades 5 and 8

Technical Report: 2008 Administration


TABLE OF CONTENTS

Test Overview and Design

Introduction

Purpose

Test Overview

Purpose and Use

Test Content, Specifications and Design
Table 1. Grade 5 MSA Science Standards Assessed
Table 2. Grade 8 MSA Science Standards Assessed

MSA Science 2008 Field Test Design

Item Development and Review

Item Development

Calibration and Equating


MSA Science Linking, Calibration and Equating


Analysis of Operational Test Data


Testing Population
Table 3. Demographic Characteristics of Grade 5 and Grade 8 Sample for Overall, Online, and Paper
Distribution of Students Across Forms

Table 4. Distribution of Forms by Grade

Analysis

Classical Item Analysis

Differential Item Functioning (DIF) Analyses
Table 5. DIF Flag Incidence Across All MSA Science Field-Test Items

Test Score Reliability
Table 6. Reliability Estimate by Form

IRT Analysis

Iteam Calibration and Equating
Table 7. Equating Constants for Operational and Field Test

Data Review of the Field Test Items

Results of Data Review

Test Analysis, Operational Scaling and Scoring

Test Analysis

Defining Scale Ranges
Table 8. Target LOSS, HOSS, and Scaling Constants for Grades 5 and 8

ISE Pattern Scoring

Student Performance

Score Interpretation

Scale Scores

Performance Levels and Descriptions
Table 9. Scale Score Cut Scores for Grades 5 and 8 MSA Science
Table 10. Grade 5 Performance Level Percentages and Descriptive Statistics
Table 11. Grade 8 Performance Level Percentages and Simple Statistics

Validity

Content-Related Validity


Construct-Related Validity

Item-Total Correlation
Table 12. Summary of Adjusted Point-Biserial

Inter-Correlations Among Standards
Table 13. Correlation Among MSA Science Content Standards

Unidimensionality

Confirmatory Factor Analysis
Table 14. Fit Indicators for Confirmatory Factor Analysis on MSA Science

Validity Evidence for Scores from Accommodated Testing
Table 15. Fit Indicators for Accommodations/Non-Accommodations Based CFA

Validity Evidence for Different Populations

References

Appendices

Appendix A Item Statistics
Appendix B DIF Analysis

A complete copy of the 2008 MSA Science Technical Report is also available.

Contact Information
Carolyn Wood, Assistant State Suerintendent
Division of Accountability, Assessment, and Data Systems
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE