| TABLE OF CONTENTS |
|
| Introduction |
|
| Section 1 |
Test Construction and Administration |
|
|
Test Development |
|
Table 1.1 |
Number of Operational Items and Points by Item Type for Each MDHSA Content Area
|
|
Test Specifications |
|
Table 1.2 |
Algebra Blueprint |
|
Table 1.3 |
Biology Blueprint |
|
Table 1.4 |
English Blueprint |
|
Table 1.5 |
Government Blueprint
|
|
Item Selection and Form Design |
|
Table 1.6 |
Form Construction Specifications for the October 2007 Administration |
|
Table 1.7 |
Form Construction Specifications for the January 2008 Administration |
|
Table 1.8 |
Form Construction Specifications for the May 2008 Administration |
|
Table 1.9 |
Form Construction Specifications for the Summer 2008 Administration |
|
Table 1.10 |
Number of Operational (OP) and Field Test (FT) Items by Administration and Content Area |
|
|
Test Administration |
|
Table 1.11 |
Testing Timing Schedule in Minutes by Content |
|
Table 1.12 |
Number of Operational Items Flagged for High Omit Rate |
|
| Section 2 |
Validity |
|
|
Evidence Based on Analyses of Test Content |
|
|
Evidence Based on Analyses of Internal Test Structure |
|
Table 2.1 |
Confirmatory Factor Analyses Fit Statistics |
|
| Section 3 |
Scoring Procedures and Score Types |
|
|
Scale Scores
|
|
Conditional Standard Errors of Measurement
|
|
Lowest and Highest Obtainable Test Scores
|
|
Cut-Scores |
|
Table 3.1 |
MDHSA Cut-Scores by Content Area |
|
|
Year-to-Year Scale Maintenance
|
|
Special Scoring of Algebra Primary Week Forms
|
| Section 4 |
Test-Level Analyses |
|
|
Demographic Distributions |
|
Table 4.1 |
Demographic Information for Algebra |
|
Table 4.2 |
Demographic Information for Biology |
|
Table 4.3 |
Demographic Information for English |
|
Table 4.4 |
Demographic Information for Government
|
|
Reliability |
|
|
Summary Statistics |
|
Table 4.5 |
Mean Scale Scores by Administration |
|
Table 4.6 |
Comparison of Mean Scores |
|
Table 4.7 |
Comparison of Percentage Passing Rates (Proficient + Advanced) |
|
Table 4.8 |
Performance Classification Rates in 2008 for Algebra, Biology and English |
|
Table 4.9 |
Summary Statistics for Algebra: October Form |
|
Table 4.10 |
Summary Statistics for Algebra: January Forms |
|
Table 4.11 |
Summary Statistics for Algebra: May Forms |
|
Table 4.12 |
Summary Statistics for Algebra: Summer Forms |
|
Table 4.13 |
Summary Statistics for Biology: October Form |
|
Table 4.14 |
Summary Statistics for Biology: January Forms |
|
Table 4.15 |
Summary Statistics for Biology: May Forms |
|
Table 4.16 |
Summary Statistics for Biology: Summer Forms |
|
Table 4.17 |
Summary Statistics for English: October Form |
|
Table 4.18 |
Summary Statistics for English: January Forms |
|
Table 4.19 |
Summary Statistics for English: May Forms |
|
Table 4.20 |
Summary Statistics for English: Summer Forms |
|
Table 4.21 |
Summary Statistics for Government: October Form |
|
Table 4.22 |
Summary Statistics for Government: Januray Forms |
|
Table 4.23 |
Summary Statistics for Government: May Forms |
|
Table 4.24 |
Summary Statistics for Government: Summer Forms |
|
|
Decision Accuracy and Consistency |
|
Table 4.25 |
Decision Accuracy and Consistency: Algebra October Form |
|
Table 4.26 |
Decision Accuracy and Consistency: Algebra January Forms |
|
Table 4.27 |
Decision Accuracy and Consistency: Algebra May Forms |
|
Table 4.28 |
Decision Accuracy and Consistency: Algebra Summer Forms |
|
Table 4.29 |
Decision Accuracy and Consistency: Biology October Form |
|
Table 4.30 |
Decision Accuracy and Consistency: Biology January Forms |
|
Table 4.31 |
Decision Accuracy and Consistency: Biology May Forms |
|
Table 4.32 |
Decision Accuracy and Consistency: Biology Summer Forms |
|
Table 4.33 |
Decision Accuracy and Consistency: English October Form |
|
Table 4.34 |
Decision Accuracy and Consistency: English January Forms |
|
Table 4.35 |
Decision Accuracy and Consistency: English May Forms |
|
Table 4.36 |
Decision Accuracy and Consistency: English Summer Forms |
|
Table 4.37 |
Decision Accuracy and Consistency: Government October Form |
|
Table 4.38 |
Decision Accuracy and Consistency: Government January Forms |
|
Table 4.39 |
Decision Accuracy and Consistency: Government May Forms |
|
Table 4.40 |
Decision Accuracy and Consistency: Government Summer Forms |
|
| Section 5 |
Field Test Analyses |
|
|
Classical Item Analyses
|
|
Differential Item Functioning
|
|
IRT Calibration and Scaling
|
|
Statistical Summary Tables |
|
Table 5.1 |
Distribution of P-Values for the January Field Test Items |
|
Table 5.2 |
Distribution of Item-Total Correlations for the January Field Test Items |
|
Table 5.3 |
Distribution of P-Values for the May Field Test Items |
|
Table 5.4 |
Distribution of Item-Total Correlations for the May Field Test Items |
|
Table 5.5 |
Field Test Items Excluded from Calibration |
|
Table 5.6 |
Field Test Items with Statistical Flags Retained in Calibration |
|
| Appendices |
|
Appendix A |
Classical Item Statistics: Operational Forms |
|
Appendix B |
Classical Item Statistics: Field Test Items
|