- - - - - - - - - - - - - - - - - - - - - -
 Divisions
  Overview
  Academic Policy & Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     2012 HSA and Mod-HSA Technical Report
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Science Technical Reports
     MSA Technical Reports
     Staff and Student Publications
     State Test Administration and Security Committee Fact Sheet
  Career and College Readiness
  Communications, Partnerships, and Grants
  Curriculum, Assessment & Accountability
  Educator Effectiveness
  Early Childhood Development
  Finance
  Information Technology
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions
Divisions > Accountability, Assessment, and Data Systems
2009 HSA and Mod-HSA Technical Report

Technical Documentation for the
Maryland High School Assessment
and Modified High School Assessment

Algebra/Data Analysis, Biology, English, and Government End-of-Course Assessments



TABLE OF CONTENTS

CHAPTER I: HIGH SCHOOL ASSESSMENTS

Section 1 Introduction

Section 2 Test Construction and Administration

Test Development
Table 2.1 Number of Operational Items and Points by Item Type for Each MD HSA Content Area, October, January, and April Administrations
Table 2.2 Number of Operational Items and Points by Item Type for Each MD HSA Content Area After Removal of CRs, May and Summer Administrations

Test Specifications
Table 2.3 MD HSA Algebra Blueprint
Table 2.4 MD HSA Biology Blueprint
Table 2.5 MD HSA English Blueprint
Table 2.6 MD HSA Government Blueprint

Item Selection and Form Design
Table 2.7 Form Construction Specifications for the MD HSA October 2008 Administration
Table 2.8 Form Construction Specifications for the MD HSA January 2009 Administration
Table 2.9 Form Construction Specifications for the MD HSA April 2009 Administration
Table 2.10 Form Construction Specifications for the MD HSA May 2009 Administration
Table 2.11 Form Construction Specifications for the MD HSA Summer 2009 Administration
Table 2.12 Number of Operational (OP) and Field Test (FT) Items by MD HSA Administration and Content Area

Test Administration
Table 2.13 Test Timing Schedule in Minutes by Content Area for the MD HSA October 2008 and January and April 2009 Administrations
Table 2.14 Test Timing Schedule in Minutes by Content Area for the MD HSA Mayland January and Summer 2009 Administrations

Section 3 Validity

Evidence Based on Analyses of Test Content

Evidence Based on Analyses of Internal Test Structure
Table 3.1 MD HSA 2009 Confirmatory Factor Analyses Fit Statistics
Table 3.2 Number of MD HSA Operational Items Flagged for High Omit Rate

Section 4 Scoring Procedures

Scale Scores

Conditional Standard Errors of Measurement

Lowest and Highest Obtainable Test Scores

Cut-Scores
Table 4.1 MD HSA Cut-Scores by Content Area

Year-to-Year Scale Maintenance

Post-Test Calibration and Equating of the May 2009 Test Forms


Section 5 Test Characteristics

Reliability

Decision Accuracy and Consistency
Table 5.1 Decision Accuracy and Consistency: MD HSA Algebra October 2008 Form
Table 5.2 Decision Accuracy and Consistency: MD HSA Algebra January 2009 Forms
Table 5.3 Decision Accuracy and Consistency: MD HSA Algebra April 2009 Forms
Table 5.4 Decision Accuracy and Consistency: MD HSA Algebra May 2009 Forms
Table 5.5 Decision Accuracy and Consistency: MD HSA Algebra Summer 2009 Forms
Table 5.6 Decision Accuracy and Consistency: MD HSA Biology October 2008 Form
Table 5.7 Decision Accuracy and Consistency: MD HSA Biology January 2009 Forms
Table 5.8 Decision Accuracy and Consistency: MD HSA Biology April 2009 Forms
Table 5.9 Decision Accuracy and Consistency: MD HSA Biology May 2009 Forms
Table 5.10 Decision Accuracy and Consistency: MD HSA Biology Summer 2009 Forms
Table 5.11 Decision Accuracy and Consistency: MD HSA English October 2008 Form
Table 5.12 Decision Accuracy and Consistency: MD HSA English January 2009 Forms
Table 5.13 Decision Accuracy and Consistency: MD HSA English April 2009 Forms
Table 5.14 Decision Accuracy and Consistency: MD HSA English May 2009  Forms
Table 5.15 Decision Accuracy and Consistency: MD HSA English Summer2009 Forms
Table 5.16 Decision Accuracy and Consistency: MD HSA Government October 2008 Form
Table 5.17 Decision Accuracy and Consistency: MD HSA Government January 2009 Forms
Table 5.18 Decision Accuracy and Consistency: MD HSA Government April 2009 Forms
Table 5.19 Decision Accuracy and Consistency: MD HSA Government May 2009 Forms
Table 5.20 Decision Accuracy and Consistency: MD HSA Government Summer 2009 Forms

Section 6 Student Characteristics

Summary Statistics
Table 6.1 MD HSA Mean Scale Scores by Administration
Table 6.2 MD HSA Mean Scale Scores over Test Years
Table 6.3 MD HSA Percentage Passing Rates (Proficient + Advanced) over Test Years
Table 6.4 MD HSA Performance Classification Rates in 2009 for Algebra, Biology, and English
Table 6.5 Summary Statistics for MD HSA Algebra: October 2008 Form
Table 6.6 Summary Statistics for MD HSA Algebra: January 2009 Forms
Table 6.7 Summary Statistics for MD HSA Algebra: April 2009 Form
Table 6.8 Summary Statistics for MD HSA Algebra: May 2009 Forms
Table 6.9 Summary Statistics for MD HSA Algebra: Summer 2009 Forms
Table 6.10 Summary Statistics for MD HSA Biology: October 2008 Form
Table 6.11 Summary Statistics for MD HSA Biology: January 2009 Forms
Table 6.12 Summary Statistics for MD HSA Biology: April 2009 Form
Table 6.13 Summary Statistics for MD HSA Biology: May 2009 Forms
Table 6.14 Summary Statistics for MD HSA Biology: Summer 2009 Forms
Table 6.15 Summary Statistics for MD HSA English: October 2008 Form
Table 6.16 Summary Statistics for MD HSA English: January 2009 Forms
Table 6.17 Summary Statistics for MD HSA English: April 2009 Form
Table 6.18 Summary Statistics for MD HSA English: May 2009 Forms
Table 6.19 Summary Statistics for MD HSA English: Summer 2009 Forms
Table 6.20 Summary Statistics for MD HSA Government: October 2008 Form
Table 6.21 Summary Statistics for MD HSA Government: January 2009 Forms
Table 6.22 Summary Statistics for MD HSA Government: April 2009 Form
Table 6.23 Summary Statistics for MD HSA Government: May 2009 Forms
Table 6.24 Summary Statistics for MD HSA Government: Summer 2009 Forms

Demographic Characteristics
Table 6.25 Demographic Information for MD HSA Algebra
Table 6.26 Demographic Information for MD HSA Biology
Table 6.27 Demographic Information for MD HSA English
Table 6.28 Demographic Information for MD HSA Government

Section 7 Field Test Analyses

Classical Item Analyses
Table 7.1 Distribution of P-Values for the MD HSA January 2009 Field Test Items
Table 7.2 Distribution of Item-Total Correlations for the MD HSA January 2009 Field Test
Table 7.3 Distribution of P-Values for the MD HSA May 2009 Field Test Items
Table 7.4 Distribution of Item-Total Correlations for the MD HSA May 2009 Field Test Items
Table 7.5 MD HSA 2009 Field Test Items Excluded from Calibration
Table 7.6 MD HSA 2009 Field Test Items with Statistical Flags Retained in Calibration

Differential Item Functioning

IRT Calibration and Scaling

CHAPTER II: MODIFIED HIGH SCHOOL ASSESSMENTS

Section 8 Introduction

Section 9 Test Construction and Administration

Test Development

Test Specifications
Table 9.1 MD Mod-HSA Algebra Blueprint
Table 9.2 MD Mod-HSA Biology Blueprint
Table 9.3 MD Mod-HSA English Blueprint
Table 9.4 MD Mod-HSA Government Blueprint

Test Administration
Table 9.5 MD Mod-HSA Test Timing Schedule in Minutes by Content Area

Section 10 Validity

Evidence Based on Analyses of Test Content

Evidence Based on Analyses of Internal Test Structure
Table 10.1 Factor Analysis Results for MD Mod-HSA Algebra, May 2008 Linking Sample
Table 10.2 Factor Analysis Results for MD Mod-HSA Algebra, May 2008 Target Population
Table 10.3 Factor Analysis Results for MD Mod-HSA Biology, May 2008 Linking Sample
Table 10.4 Factor Analysis Results for MD Mod-HSA Biology, May 2008 Target Population
Table 10.5 Factor Analysis Results for MD Mod-HSA English, May 2008 Linking Sample
Table 10.6 Factor Analysis Results for MD Mod-HSA English, May 2008 Target Population
Table 10.7 Factor Analysis Results for MD Mod-HSA Government, May 2008 Linking Sample
Table 10.8 Factor Analysis Results for MD Mod-HSA Government, May 2008 Target Population
Table 10.9 Distributions of P-Values: MD Mod-HSA May 2008 Operational Items—Linking Sample
Table 10.10 Distributions of P-Values: MD Mod-HSA May 2008 Operational Items—Target Population
Table 10.11 Distributions of Point-Biserial Correlations: MD Mod-HSA May 2008 Operational Items—Linking Sample
Table 10.12 Distributions of Point-Biserial Correlations: MD Mod-HSA May 2008 Operational Items—Target Population
Table 10.13 Summary Statistics of Tetrachoric Correlations: MD Mod-HSA May 2008 by Sample, Content, and Form

Section 11 Scoring Procedures

Scale Scores

Lowest and Highest Obtainable Test Scores

Cut-Scores
Table 11.1 MD Mod-HSA Cut-Scores by Content Area

Section 12 Test Characteristics

Reliability

Decision Accuracy and Consistency
Table 12.1 Decision Accuracy and Consistency: MD Mod-HSA Algebra October 2008 Form
Table 12.2 Decision Accuracy and Consistency: MD Mod-HSA Algebra January 2009 Forms
Table 12.3 Decision Accuracy and Consistency: MD Mod-HSA Algebra April 2009 Forms
Table 12.4 Decision Accuracy and Consistency: MD Mod-HSA Algebra May 2009 Forms
Table 12.5 Decision Accuracy and Consistency: MD Mod-HSA Algebra Summer 2009 Forms
Table 12.6 Decision Accuracy and Consistency: MD Mod-HSA Biology October 2008 Form
Table 12.7 Decision Accuracy and Consistency: MD Mod-HSA Biology January 2009 Forms
Table 12.8 Decision Accuracy and Consistency: MD Mod-HSA Biology April 2009 Forms
Table 12.9 Decision Accuracy and Consistency: MD Mod-HSA Biology May 2009 Forms
Table 12.10 Decision Accuracy and Consistency: MD Mod-HSA Biology Summer 2009 Forms
Table 12.11 Decision Accuracy and Consistency: MD Mod-HSA English October 2008 Form
Table 12.12 Decision Accuracy and Consistency: MD Mod-HSA English January 2009 Forms
Table 12.13 Decision Accuracy and Consistency: MD Mod-HSA English April 2009 Forms
Table 12.14 Decision Accuracy and Consistency: MD Mod-HSA English May 2009  Forms
Table 12.15 Decision Accuracy and Consistency: MD Mod-HSA English Summer2009 Forms
Table 12.16 Decision Accuracy and Consistency: MD Mod-HSA Government October 2008 Form
Table 12.17 Decision Accuracy and Consistency: MD Mod-HSA Government January 2009 Forms
Table 12.18 Decision Accuracy and Consistency: MD Mod-HSA Government April 2009 Forms
Table 12.19 Decision Accuracy and Consistency: MD Mod-HSA Government May 2009 Forms
Table 12.20 Decision Accuracy and Consistency: MD Mod-HSA Government Summer 2009 Forms

Section 13 Student Characteristics

Summary Statistics
Table 13.1 MD Mod-HSA Mean Scale Scores by Content Area and Administration
Table 13.2 MD Mod-HSA Mean Scale Scores by Content Area and Test Year
Table 13.3 MD Mod-HSA Percentage Passing Rates (Proficient + Advanced) by Content Area and Test Year
Table 13.4 MD Mod-HSA Percentage of Students in Each Performance Category by Content Area
Table 13.5 Summary Statistics for Algebra: MD Mod-HSA October 2008 Form
Table 13.6 Summary Statistics for Algebra: MD Mod-HSA January 2009 Form
Table 13.7 Summary Statistics for Algebra: MD Mod-HSA April 2009 Form
Table 13.8 Summary Statistics for Algebra: MD Mod-HSA May 2009 Forms
Table 13.9 Summary Statistics for Algebra: MD Mod-HSA Summer 2009 Forms
Table 13.10 Summary Statistics for Biology: MD Mod-HSA October 2008 Forms
Table 13.11 Summary Statistics for Biology: MD Mod-HSA January 2009 Form
Table 13.12 Summary Statistics for Biology: MD Mod-HSA April 2009 Form
Table 13.13 Summary Statistics for Biology: MD Mod-HSA May 2009 Forms
Table 13.14 Summary Statistics for Biology: MD Mod-HSA Summer 2009 Forms
Table 13.15 Summary Statistics for English: MD Mod-HSA October 2008 Forms
Table 13.16 Summary Statistics for English: MD Mod-HSA January 2009 Form
Table 13.17 Summary Statistics for English: MD Mod-HSA April 2009 Form
Table 13.18 Summary Statistics for English: MD Mod-HSA May 2009 Forms
Table 13.19 Summary Statistics for English: MD Mod-HSA Summer 2009 Forms
Table 13.20 Summary Statistics for Government: MD Mod-HSA October 2008 Forms
Table 13.21 Summary Statistics for Government: MD Mod-HSA January 2009 Form
Table 13.22 Summary Statistics for Government: MD Mod-HSA April 2009 Form
Table 13.23 Summary Statistics for Government: MD Mod-HSA May 2009 Forms
Table 13.24 Summary Statistics for Government: MD Mod-HSA Summer 2009 Forms

Demographic Characteristics
Table 13.25 Demographic Information for MD Mod-HSA Algebra
Table 13.26 Demographic Information for MD Mod-HSA Biology
Table 13.27 Demographic Information for MD Mod-HSA English
Table 13.28 Demographic Information for MD Mod-HSA Government

Appendices
Appendix 1A MD HSA Classical Item Statistics: Operational Forms
Appendix 1B MD HSA Classical Item Statistics: Field Test Items
Appendix 1C Study of the Comparability of Online and Paper Forms of the May 2009 Maryland High School Assessments
Appendix 2A MD Mod-HSA Classical Item Statistics: Operational Forms
References

A complete copy of the 2009 HSA Technical Report is also available.

Contact Information
Leslie Wilson, Assistant State Superintendent
Division of Accountability and Assessment
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE