| TABLE OF CONTENTS |
|
| Introduction |
|
|
Development of Mod-HSA Test Forms
|
|
Description of Target Groups and Linking Samples
|
|
Equating Designs
|
|
Organization of the Technical Report |
|
| Section 1 |
Test Construction and Administration |
|
|
Test Development |
|
Planning |
|
Test Specifications and Design |
|
Item Type |
|
Item Modification, Development, Review, and Revision
|
|
Table 1.1 |
Demographics of Content Review Committees by Content Area
|
|
Test Specifications |
|
Table 1.2 |
Algebra Blueprint |
|
Table 1.3 |
Biology Blueprint |
|
Table 1.4 |
English Blueprint |
|
Table 1.5 |
Government Blueprint
|
|
Item Selection and Form Design |
|
| Section 2 |
Validity |
|
| Section 3 |
Item-Level Analyses: May Administration |
|
|
Classical Item Analyses |
|
Table 3.1 |
Distributions of P-Values: May All Mod-HSA Items - Linking |
|
Table 3.2 |
Distributions of P-Values: May All Mod-HSA Items - Target |
|
Table 3.3 |
Distributions of Point-Biserial Correlations: May, All Mod-HSA Items - Linking |
|
Table 3.4 |
Distributions of Point-Biserial Correlations: May, All Mod-HSA Items - Target |
|
Table 3.5 |
May Mod-HSA Items Excluded from Calibration |
|
Table 3.6 |
May Mod-HSA Items with Statistical Flags Retained in Calibration |
|
|
Differential Item Functioning |
|
| Section 4 |
Item Calibration and Test Equating |
|
|
Item Calibration
|
|
Test Equating |
|
Linking using the Common Items Design |
|
Linking using the Common Persons Design |
|
Comparison of Results from the Two Equating Methods |
|
Comparison of TCCs and CSEMs |
|
| Section 5 |
Scoring Procedures |
|
|
Scale Scores
|
|
Lowest and Highest Obtainable Test Scores
|
|
Cut-Scores |
|
Table 5.1 |
Mod-HSA 2008 Cut-Scores by Content Area |
|
| Section 6 |
Test Characteristics |
|
|
Reliability
|
|
Decision Accuracy and Decision Consistency |
|
Table 6.1 |
Decision Accuracy and Consistency: May, Algebra Linking |
|
Table 6.2 |
Decision Accuracy and Consistency: May, Algebra Target |
|
Table 6.3 |
Decision Accuracy and Consistency: Summer, Algebra Target |
|
Table 6.4 |
Decision Accuracy and Consistency: May, Biology Linking |
|
Table 6.5 |
Decision Accuracy and Consistency: May, Biology Target |
|
Table 6.6 |
Decision Accuracy and Consistency: Summer, Biology Target |
|
Table 6.7 |
Decision Accuracy and Consistency: May, English Linking |
|
Table 6.8 |
Decision Accuracy and Consistency: May, English Target |
|
Table 6.9 |
Decision Accuracy and Consistency: Summer, English Target |
|
Table 6.10 |
Decision Accuracy and Consistency: May, Government Linking |
|
Table 6.11 |
Decision Accuracy and Consistency: May, Government Target |
|
Table 6.12 |
Decision Accuracy and Consistency: Summer, Government Target |
|
|
Exploratory Factor Analysis |
|
Table 6.13 |
Factor Analysis Results for Algebra, May, Linking |
|
Table 6.14 |
Factor Analysis Results for Algebra, May, Target |
|
Table 6.15 |
Factor Analysis Results for Biology, May Linking |
|
Table 6.16 |
Factor Analysis Results for Biology, May Target |
|
Table 6.17 |
Factor Analysis Results for English, May Linking |
|
Table 6.18 |
Factor Analysis Results for English, May Target |
|
Table 6.19 |
Factor Analysis Results for Government, May Linking |
|
Table 6.20 |
Factor Analysis Results for Government, May Target |
|
Table 6.21 |
Distributions of P-Values: May Operational Items - Linking |
|
Table 6.22 |
Distributions of P-Values: May Operational Items - Target |
|
Table 6.23 |
Distributions of Point-Biserial Correlations: May Operational Items - Linking |
|
Table 6.24 |
Distributions of Point-Biserial Correlations: May Operational Items - Target |
|
Table 6.25 |
Summary Statistics of Tetrachoric Correlations by Sample, Content, and Form |
|
| Section 7 |
Student Characteristics |
|
|
Demographic Distributions |
|
Table 7.1 |
Demographic Information for Algebra: May |
|
Table 7.2 |
Demographic Information for Algebra: Summer |
|
Table 7.3 |
Demographic Information for Biology: May |
|
Table 7.4 |
Demographic Information for Biology: Summer |
|
Table 7.5 |
Demographic Information for English: May |
|
Table 7.6 |
Demographic Information for English: Summer |
|
Table 7.7 |
Demographic Information for Government: May |
|
Table 7.8 |
Demographic Information for Government: Summer
|
|
Summary Statistics |
|
Table 7.9 |
Mean Scale Scores by Content and Group |
|
Table 7.10 |
Passing Percentages by Content and Group |
|
Table 7.11 |
Percentages of Students Classified as Basic, Proficient or Advanced, by Content and Group |
|
Table 7.12 |
Summary Statistics for Algebra: May, Target |
|
Table 7.13 |
Summary Statistics for Algebra: May, Linking |
|
Table 7.14 |
Summary Statistics for Algebra: Summer, Target |
|
Table 7.15 |
Summary Statistics for Biology: May, Target |
|
Table 7.16 |
Summary Statistics for Biology: May, Linking |
|
Table 7.17 |
Summary Statistics for Biology: Summer, Target |
|
Table 7.18 |
Summary Statistics for English: May, Target |
|
Table 7.19 |
Summary Statistics for English: May, Linking |
|
Table 7.20 |
Summary Statistics for English: Summer, Target |
|
Table 7.21 |
Summary Statistics for Govenment: May, Target |
|
Table 7.22 |
Summary Statistics for Government: May, Linking |
|
Table 7.23 |
Summary Statistics for Government: Summer, Target |
|
| References |
|
| Appendices |
|
Appendix A |
Classical Item Statistics: Operational Forms |
|
Appendix B |
Classical Item Statistics: Field Test Items |
|
Appendix C |
Comparison of Equating Methods |
|
Appendix D |
Histograms of Scale Score Distributions |
|