- - - - - - - - - - - - - - - - - - - - - -
 Divisions
  Overview
  Academic Policy & Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     2012 HSA and Mod-HSA Technical Report
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Science Technical Reports
     MSA Technical Reports
     Staff and Student Publications
     State Test Administration and Security Committee Fact Sheet
  Career and College Readiness
  Communications, Partnerships, and Grants
  Curriculum, Assessment & Accountability
  Educator Effectiveness
  Early Childhood Development
  Finance
  Information Technology
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions
Divisions > Accountability, Assessment, and Data Systems
2011 Modified MSA Mathematics Technical Report

Modified Maryland School Assessment
Mathematics
Grades 3 through 8

Technical Report: 2011 Administration



TABLE OF CONTENTS

TABLE OF CONTENTS

LIST OF TABLES

LIST OF FIGURES

ACKNOWLEDGEMENTS

OVERVIEW OF THIS MANUAL

1. Introduction


1.1
Background

1.2
Rationale for the 2011 Mod-MSA: Mathematics

1.3
Eligibility Criteria for the Mod-MSA: Mathematics

1.4
Test Administration of the 2011 Mod-MSA: Mathematics


Test Materials


Test Administration Schedule


Student Participation


Accommodations for Assessment


Test Format


Security of Test Materials

1.5
Quality Control Procedures

1.6
Item Bank Construction

2. Test Design and Development of the 2011 Mod-MSA: Mathematics


2.1
Test Design and Structure of the 2011 Mod-MSA: Mathematics

2.2
Development and Review of the 2011 Mod-MSA: Mathematics


National Psychometric Council


Content Review Committee


Bias Review Committee


Vision Review Committee

2.3
The 2011 Mod-MSA: Mathematics: Operational Form Test Structure and Item Types 

2.4
Item Analyses (Grades 3 to 5) Undertaken Prior to the Creation of the Operational Form


Classical Item Analyses


Differential Item Functioning Analyses


Item Response Theory (IRT) Analyses

2.5
Items Flagged for Inspection Prior to the Creation of the Operational Forms (Grades 3 to 5)

2.6
Items Selected for the 2011 Operational Tests

2.7
Scoring Procedures of the 2011 Mod-MSA: Mathematics

3. Central Tendency Measures and Other Classical Item Analyses of the 2011 Mod-MSA: Mathematics


3.1
Measures of Central Tendency


Standard Error of the Mean

3.2
Item Level Descriptive Statistics

4. Scale Creation, Equating and Raw Scores to Scale Scores Conversion via Item Response Theory (IRT) Procedures



The Rasch Model

4.1
Equating, Calibration and Scaling Procedures for the Mod-MSA: Mathematics

4.2
Specifics of Linking and Equating the 2011 Mod-MSA Grades 3-8: Mathematics

4.3
Reporting Scale Scores for the 2011 Mod-MSA: Mathematics


Raw Score to Scale Score Conversion Tables for the Total Score


Raw Score to Scale Score Conversion Tables for the Subscales

4.4
Score Interpretation


Scale Scores


Performance Level Descriptors

4.5
Final Performance Level Cut Points for the Mod-MSA: Mathematics

5. Comparative Classical and IRT Stats Across Years for the Common Items Used in Grades 3-8

6. IRT Item Level Statistics for the 2011 Mod-MSA: Mathematics


6.1
Rationale for the Use of the Rasch Model

6.2
Fit Statistics for the Rasch Model

6.3
Rasch Item Level Statistics

7. Test Reliability


7.1
Precision and Reliability (Classical Methods)


Standard Error of Measurement (SEM) of the Test


Cronbach’s Alpha (KR20)

7.2
IRT Method in Measuring Precision of the Test

7.3
Decision Accuracy and Consistency at the Cut Scores

8. Test Validity


8.1
Test Validity for the 2011 Mod-MSA: Mathematics


Content-Related Evidence


Evidence from Item Development Methods


Evidence from Internal Structure of the Tests

8.2
Unidimensionality Analysis for the 2011 Mod-MSA: Mathematics

9. Summary of Operational Test Results of the 2011 Mod-MSA: Mathematics


9.1
Classical Descriptive Test Statistics of the Operational Tests, Using Raw Scores

9.2
Scale Score Descriptive Statistics

9.3
Frequency of Students at Each Proficiency Level by Grade

9.4
Test Characteristic Curves, Test Information Functions, and Conditional Standard Errors of Measurement

10. References

APPENDICES

A. Operational Items Selected After Data Review
B. Item Distractor Analyses
C. The 2011 Mod-MSA, Differential Item Functioning Analysis (DIF)
D. Frequency Distribution Histograms of Scale Scores
E. Alignment of the 2011 Mod-MSA: Mathematics Items to the State Standards
F. Identifying Students for Participation in the Mod-MSA: Mathematics Program

A complete copy of the 2011 Mod-MSA Mathematics Technical Report is also available.

Contact Information
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE