TABLE 3.1 Instructional Guidance D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- SUMMARY OF 2637 MEASURED (NON-EXTREME) PERSONS +-----------------------------------------------------------------------------+ | RAW MODEL INFIT OUTFIT | | SCORE COUNT MEASURE ERROR MNSQ ZSTD MNSQ ZSTD | |-----------------------------------------------------------------------------| | MEAN 10.7 3.9 1.06 1.31 1.32 .0 1.32 .0 | | S.D. 2.3 .5 2.71 .38 1.79 1.6 1.84 1.6 | | MAX. 15.0 4.0 6.96 3.66 9.90 9.3 9.90 9.3 | | MIN. 2.0 1.0 -6.38 .99 .00 -2.0 .00 -2.0 | |-----------------------------------------------------------------------------| | REAL RMSE 1.80 ADJ.SD 2.02 SEPARATION 1.12 PERSON RELIABILITY .56 | |MODEL RMSE 1.36 ADJ.SD 2.34 SEPARATION 1.72 PERSON RELIABILITY .75 | | S.E. OF PERSON MEAN = .05 | | WITH 138 EXTREME = 2775 PERSONS MEAN = 1.26, S.D. = 3.13 | | REAL RMSE 1.81 ADJ.SD 2.55 SEPARATION 1.41 PERSON RELIABILITY .67 | |MODEL RMSE 1.39 ADJ.SD 2.80 SEPARATION 2.01 PERSON RELIABILITY .80 | +-----------------------------------------------------------------------------+ MAXIMUM EXTREME SCORE: 111 PERSONS MINIMUM EXTREME SCORE: 27 PERSONS LACKING RESPONSES: 194 PERSONS VALID RESPONSES: 96.9% SUMMARY OF 4 MEASURED ITEMS +-----------------------------------------------------------------------------+ | RAW MODEL INFIT OUTFIT | | SCORE COUNT MEASURE ERROR MNSQ ZSTD MNSQ ZSTD | |-----------------------------------------------------------------------------| | MEAN 7024.3 2555.5 .00 .05 1.34 2.6 1.37 2.4 | | S.D. 438.6 18.0 .37 .00 .59 7.3 .65 6.4 | | MAX. 7297.0 2573.0 .48 .05 2.31 9.9 2.44 9.9 | | MIN. 6265.0 2529.0 -.49 .05 .85 -5.5 .82 -4.8 | |-----------------------------------------------------------------------------| | REAL RMSE .06 ADJ.SD .37 SEPARATION 6.65 ITEM RELIABILITY .98 | |MODEL RMSE .05 ADJ.SD .37 SEPARATION 7.89 ITEM RELIABILITY .98 | | S.E. OF ITEM MEAN = .21 | +-----------------------------------------------------------------------------+ DELETED: 84 ITEMS UMEAN=.000 USCALE=1.000 TABLE 3.2 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- SUMMARY OF MEASURED STEPS +------------------------------------------------------------------ |CATEGORY OBSERVED|OBSVD SAMPLE|INFIT OUTFIT|| STEP |CATEGORY| |LABEL SCORE COUNT %|AVRGE EXPECT| MNSQ MNSQ||CALIBRATN| MEASURE| |-------------------+------------+------------++---------+--------+ | 1 1 321 3| -3.21 -3.02| 1.70 1.84|| NONE |( -6.35)| | 2 2 3043 29| -.93 -1.19| 1.25 1.23|| -5.24A| -2.92 | | 3 3 5742 54| 1.63 1.91| .99 .99|| -.59A| 2.62 | | 4 4 1116 11| 4.96 4.13| 1.46 1.32|| 5.83A|( 6.93)| |-------------------+------------+------------++---------+--------+ |MISSING 355 3| .38 | || | | +------------------------------------------------------------------ AVERAGE MEASURE is mean of measures in category. +-----------------------------------------------------------------------------+ |CATEGORY STEP STEP | SCORE-TO-MEASURE |THURSTONE| COHERENCE| OBS-EXP | | LABEL CALIBRATN S.E. | AT CAT. ----ZONE----|THRESHOLD| M->C C->M|RESIDUAL | |------------------------+---------------------+---------+----------+---------| | 1 NONE |( -6.35) -INF -5.27| | 67% 24%| 40.4% | | 2 -5.24A .08 | -2.92 -5.27 -.57| -5.25 | 67% 58%| 3.1% | | 3 -.59A .03 | 2.62 -.57 5.83| -.58 | 72% 86%| -7.4% | | 4 5.83A .05 |( 6.93) 5.83 +INF | 5.83 | 71% 39%| 33.0% | +-----------------------------------------------------------------------------+ M->C = Does Measure imply Category? C->M = Does Category imply Measure? CATEGORY PROBABILITIES: MODES - Step measures at intersections P ++-------+-------+-------+-------+-------+-------+-------++ R 1.0 + + O | | B | 3333333333 | A |1 222 3 3 | B .8 + 11 22 222 33 33 + I | 1 2 2 3 3 4| L | 1 2 2 3 3 4 | I | 1 2 2 3 3 4 | T .6 + 1 2 2 3 3 4 + Y | 1 2 23 3 4 | .5 + * * * + O | 2 1 32 4 3 | F .4 + 2 1 3 2 4 3 + | 2 1 3 2 4 3 | R | 2 1 3 2 4 3 | E | 2 1 3 2 4 3| S .2 + 22 11 3 2 4 + P |2 1 3 22 44 | O | 1*33 22 44 | N | 333 1111 2****4 | S .0 +*************44444444****************1111****************+ E ++-------+-------+-------+-------+-------+-------+-------++ -7 -5 -3 -1 1 3 5 7 PERSON [MINUS] ITEM MEASURE TABLE 12.2 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS | 7 .### + | . T| | 6 + .### | | . | 5 . + .### | | | 4 + S| | | 3 . + . | .############ | . | 2 + | | | 1 M+ |T .############ | tq2_48g Provided . |S tq2_48c Steps cl 0 . +M . |S tq2_48b Plan sta .####### | tq2_48f Exposed . |T -1 . + . | .#### | S| -2 + | . | . | -3 .### + | | | -4 + . T| . | . | -5 + . | | . | -6 . + | . | | -7 . + | EACH '#' IS 50. TABLE 12.5 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS - Expected score zones | 7 .### + | . T| | tq2_48g Provided.4 6 + tq2_48c Steps cl.4 .### | tq2_48b Plan sta.4 | . | tq2_48f Exposed .4 5 . + .### | | | 4 + S| | | 3 . + . | .############ | . | 2 + | | | 1 M+ |T .############ | . |S 0 . +M tq2_48g Provided.3 . |S tq2_48c Steps cl.3 .####### | . |T tq2_48b Plan sta.3 -1 . + tq2_48f Exposed .3 . | .#### | S| -2 + | . | . | -3 .### + | | | -4 + . T| . | . | tq2_48g Provided.2 -5 + tq2_48c Steps cl.2 . | | tq2_48b Plan sta.2 . | tq2_48f Exposed .2 -6 . + | . | | -7 . + | EACH '#' IS 50. TABLE 12.6 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS - Thurstone thresholds | 7 .### + | . T| | tq2_48g Provided.4 6 + tq2_48c Steps cl.4 .### | tq2_48b Plan sta.4 | . | tq2_48f Exposed .4 5 . + .### | | | 4 + S| | | 3 . + . | .############ | . | 2 + | | | 1 M+ |T .############ | . |S 0 . +M tq2_48g Provided.3 . |S tq2_48c Steps cl.3 .####### | . |T tq2_48b Plan sta.3 -1 . + tq2_48f Exposed .3 . | .#### | S| -2 + | . | . | -3 .### + | | | -4 + . T| . | . | tq2_48g Provided.2 -5 + tq2_48c Steps cl.2 . | | tq2_48b Plan sta.2 . | tq2_48f Exposed .2 -6 . + | . | | -7 . + | EACH '#' IS 50. TABLE 12.12 Improvement D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS || 7 .### ++ || . T|| || 6 ++ .### || || . || 5 . ++ .### || || || 4 ++ S|| || || 3 . ++ . || .############ || . || 2 ++ || || || 1 M++ ||T .############ || tq2_48f Exposed . ||S tq2_48b Plan sta 0 . ++M . ||S tq2_48c Steps cl .####### || tq2_48g Provided . ||T -1 . ++ . || .#### || S|| -2 ++ || . || . || -3 .### ++ || || || -4 ++ . T|| . || . || -5 ++ . || || . || -6 . ++ || . || || -7 . ++ || EACH '#' IS 50. TABLE 13.1 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- ITEMS STATISTICS: MEASURE ORDER +--------------------------------------------------------------------------------------------------------------------+ |ENTRY RAW | INFIT | OUTFIT |SCORE| | | |NUMBER SCORE COUNT MEASURE ERROR|MNSQ ZSTD|MNSQ ZSTD|CORR.|DISPLACE| ITEMS | |------------------------------------+----------+----------+-----+--------+------------------------------------------| | 34 6265 2549 .48A .05|2.31 9.9|2.44 9.9| .47| 1.07| tq2_48g Provided with ideas/resources | | 30 7253 2573 .21A .05| .90 -4.0| .88 -3.2| .80| -.59| tq2_48c Steps clearly outlined | | 29 7282 2571 -.20A .05| .85 -5.5| .82 -4.8| .80| -.27| tq2_48b Plan staged and sequenced | | 33 7297 2529 -.49A .05|1.31 9.8|1.34 7.6| .68| -.26| tq2_48f Exposed to good instr | |------------------------------------+----------+----------+-----+--------+------------------------------------------| | MEAN 7024. 2555. .00 .05|1.34 2.6|1.37 2.4| | | | | S.D. 439. 18. .37 .00| .59 7.3| .65 6.4| | | | +--------------------------------------------------------------------------------------------------------------------+ TABLE 20.1 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- TABLE OF MEASURES ON COMPLETE TEST +--------------------------------------------------------------------------+ | SCORE MEASURE S.E. | SCORE MEASURE S.E. | SCORE MEASURE S.E. | |------------------------+------------------------+------------------------| | 4 -7.81E 1.91 | 9 -1.59 1.06 | 14 5.84 1.01 | | 5 -6.38 1.16 | 10 -.56 .99 | 15 6.96 1.17 | | 6 -5.27 1.00 | 11 .52 1.14 | 16 8.40E 1.91 | | 7 -4.24 1.06 | 12 2.62 1.78 | | | 8 -2.92 1.22 | 13 4.72 1.15 | | +--------------------------------------------------------------------------+ TO SET MEASURE RANGE AS 0-100, UMEAN=48.186 USCALE=6.168 TO SET MEASURE RANGE TO MATCH RAW SCORE RANGE, UMEAN=9.782 USCALE=.740 RAW SCORE-MEASURE OGIVE FOR COMPLETE TEST ++-----+-----+-----+-----+-----+-----+-----+-----+-----++ E 16 + E + X 15 + * + P 14 + * + E 13 + * + C 12 + * + T 11 + * + E 10 + * + D 9 + * + 8 + * + S 7 + * + C 6 + * + O 5 + * + R 4 + E + E ++-----+-----+-----+-----+-----+-----+-----+-----+-----++ -8 -6 -4 -2 0 2 4 6 8 10 MEASURE 1 2 3 6 6 1 1 1 2 1 2 3 91 4 5 14 11 8 6 6 0 PERSON 025 7111 12 526 22883847 6992 123153 8 533 T S M S T ITEMS 2 2 TSMST TABLE 20.2 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- TABLE OF SAMPLE NORMS (500/100) AND FREQUENCIES CORRESPONDING TO COMPLETE TEST +---------------------------------------------------------------------------+ | SCORE MEASURE S.E.|NORMED S.E. FREQUENCY % CUM.FREQ. % PERCENTILE| |------------------------+--------------------------------------------------| | 4 -7.81E 1.91| 210 61 22 .8 22 .8 1 | | 5 -6.38 1.16| 256 37 23 .8 45 1.6 1 | | 6 -5.27 1.00| 291 32 23 .8 68 2.5 2 | | 7 -4.24 1.06| 324 34 32 1.2 100 3.6 3 | | 8 -2.92 1.22| 366 39 213 7.7 313 11.3 7 | | 9 -1.59 1.06| 409 34 247 8.9 560 20.2 16 | | 10 -.56 .99| 442 32 369 13.3 929 33.5 27 | | 11 .52 1.14| 476 36 666 24.0 1595 57.5 45 | | 12 2.62 1.78| 543 57 646 23.3 2241 80.8 69 | | 13 4.72 1.15| 611 37 185 6.7 2426 87.4 84 | | 14 5.84 1.01| 646 32 170 6.1 2596 93.5 90 | | 15 6.96 1.17| 682 37 73 2.6 2669 96.2 95 | | 16 8.40E 1.91| 728 61 106 3.8 2775 100.0 98 | +---------------------------------------------------------------------------+ ****************************************************************************** * * * * * * * W I N S T E P S * * * * * * --------------------------------- * * * * - RASCH ANALYSIS FOR ALL TWO-FACET MODELS - * * * * PERSON MEASUREMENT, ITEM & STEP CALIBRATION, PERSON & ITEM FIT ANALYSIS * * * * INQUIRE: MESA PRESS * * 5835 S. KIMBARK AVE, CHICAGO ILLINOIS 60637-1609 * * Tel. (773) 702-1596 FAX (773) 834-0326 * * info@winsteps.com www.winsteps.com * * * * COPYRIGHT (C) JOHN MICHAEL LINACRE, 1991-2000 * * WRITTEN BY J. M. LINACRE & B. D. WRIGHT SEPTEMBER 5, 2000 VERSION 3.07 * ****************************************************************************** TABLE 0.1 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 -------------------------------------------------------------------------------- TITLE= Improvement Plan Series - Teachers feelings about Improvemen CONTROL FILE: Instructional Guidance (IAF and SAF) year 2.txt OUTPUT FILE: D:\SII Innovative Web Report\FP VirtualRed\Winsteps Files\In DATE: Mar 24 12:58 2009 CONTROL VARIABLES: Input Data Format STBIAS = N IAFILE = D:\SIIData\TQ\Y1 DATA = D:\SIIData\TQ\Y1 --------------- IANCHQ = N NAME1 = 1 Misfit Selection ILFILE = NAMLEN = 25 FITI = 2.000 --------------- ITEM1 = 26 FITP = 2.000 Person Delete/Anchor ITLEN = 300 OUTFIT = N PDFILE = NI = 88 LOCAL = N PDELQU = N XWIDE = 3 NORMAL = N PSEL = * DELIMIT= PTBIS = N PAFILE = INUMB = N --------------- PANCHQ = N --------------- Special Table Control --------------- Data Scoring FRANGE = .000 Cat/Step Delete/Anchor CODES = " 1 2 3 4 5 LINLEN = 80 CFILE = MISSNG = 255 MRANGE = .000 PIVOT = RESCOR = NAMLMP = 16 SDFILE = NEWSCR = CATREF = 0 SDELQU = N IVALUE = T1I# = 0 SAFILE = D:\SIIData\TQ\Y1 IREFER = T1P# = 0 SANCHQ = N KEY1 = ISORT = 1 --------------- KEYSCR = OSORT = Export Files CUTHI = .000 PSORT = 1 CSV = N CUTLO = .000 CHART = N HLINES = Y --------------- CURVES = 110 DISFILE= Output Tables DISTRT = N GRFILE = TITLE = Improvement Plan MNSQ = Y IFILE = TABLES = 0010000000011000 PRCOMP = S ISFILE = TFILE = STEPT3 = Y PFILE = D:\SIIData\TQ\Y2 FORMFD = ^ --------------- RFILE = MAXPAG = 0 Convergence Control SFILE = ITEM = ITEM MPROX = 10 SCFILE = PERSON = PERSON MUCON = 100 SIFILE = ASCII = Y LCONV = .010 ICORFIL= --------------- RCONV = .500 PCORFIL= User Scaling TARGET = N XFILE = UIMEAN = .000 BATCH = N GUFILE = USCALE = 1.000 --------------- G0ZONE = 50.000 UDECIM = 2 Scale Structure G1ZONE = 50.000 UANCH = Y GROUPS = --------------- --------------- MODELS = R Data Reformat Adjustment STKEEP = N FORMAT = EXTRSC = .300 --------------- GRPFRM = N HIADJ = .250 Item Delete/Anchor/Label KEYFRM = 0 LOWADJ = .250 IDFILE = D:\SII Innovativ MODFRM = N PAIRED = N IDELQU = N RESFRM = N REALSE = N ISEL = * SPFILE = ITEM DELETIONS: 1-28 31-32 35-88 2969 PERSON Records Input. TABLE 0.2 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS WINSTEPS v3.07 -------------------------------------------------------------------------------- CONVERGENCE TABLE +----------------------------------------------------------------------------+ | PROX ACTIVE COUNT EXTREME 5 RANGE MAX LOGIT CHANGE | | ITERATION PERSONS ITEMS CATS PERSONS ITEMS MEASURES STEPS | |----------------------------------------------------------------------------| | 1 2969 88 8 2.25 .00 -1.9794 | | 2 2775 4 4 4.92 .00 2.3130 | | 3 2637 4 4 4.92 .00 .0000 | | 4 2637 4 4 4.92 .00 .0000 | |----------------------------------------------------------------------------| | UCON MAX SCORE MAX LOGIT LEAST CONVERGED CATEGORY STEP | | ITERATION RESIDUAL* CHANGE PERSON ITEM CAT RESIDUAL CHANGE | |----------------------------------------------------------------------------| | 1 3.49 -.9999 13* 0 | | 2 3.04 -.9994 13* 0 | | 3 2.36 .9984 13* 0 | | 4 1.54 .9814 95* 0 | | 5 .66 .9974 173* 0 | | 6 .16 .3745 173* 0 | | 7 -.04 .0793 65* 0 | | 8 -.01 .0222 65* 0 | | 9 .00 .0066 65* 0 | +----------------------------------------------------------------------------+ Standardized Residuals N(0,1) Mean: .00 S.D.: 1.17 TABLE 0.3 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:58 2009 INPUT: 2969 PERSONS, 88 ITEMS ANALYZED: 2637 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- ; This file is Instructional Guidance - Instruction series TITLE=Improvement Plan Series - Teachers feelings about Improvement Plan (tq2_48b,c,f,g) DATA='D:\SIIData\TQ\Y1 to Y3 scaling\scaling tq items\item scaling - calibrating Y1 & Y2 measures\it NI=88 Item1=26 DISTRT=N XWIDE=3 CODES= " 1 2 3 4 5 6 7" TABLES=0010000000011000000100 MUCON=100 OUTFIT=NO NAMLMP=16 ; REALSE=Y (S.E. of misfit - rarely used) ; XFILE=filename.xf (analyzed response file - rarely used) idfile=* ;pdfile=* ;ifile='D:\SIIData\TQ\Y1 to Y3 scaling\item files_y1\IF Instructional Guidance.dat ;sfile='D:\SIIData\TQ\Y1 to Y3 scaling\step files_y1\SF Instructional Guidance.dat iafile='D:\SIIData\TQ\Y1 to Y3 scaling\item files_y1\IF Instructional Guidance.dat safile='D:\SIIData\TQ\Y1 to Y3 scaling\step files_y1\SF InStructional Guidance.dat pfile='D:\SIIData\TQ\Y2 scaling\person\instguide.dat &END