TABLE 3.1 INstructional Guidance D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- SUMMARY OF 1682 MEASURED (NON-EXTREME) PERSONS +-----------------------------------------------------------------------------+ | RAW MODEL INFIT OUTFIT | | SCORE COUNT MEASURE ERROR MNSQ ZSTD MNSQ ZSTD | |-----------------------------------------------------------------------------| | MEAN 10.7 3.9 1.23 1.36 .83 -.5 .83 -.5 | | S.D. 2.3 .4 2.91 .40 1.23 1.2 1.25 1.2 | | MAX. 15.0 4.0 6.95 3.66 9.20 5.9 9.42 5.9 | | MIN. 2.0 1.0 -6.37 .99 .00 -2.0 .00 -2.0 | |-----------------------------------------------------------------------------| | REAL RMSE 1.60 ADJ.SD 2.43 SEPARATION 1.52 PERSON RELIABILITY .70 | |MODEL RMSE 1.42 ADJ.SD 2.54 SEPARATION 1.79 PERSON RELIABILITY .76 | | S.E. OF PERSON MEAN = .07 | | WITH 190 EXTREME = 1872 PERSONS MEAN = 1.66, S.D. = 3.62 | | REAL RMSE 1.63 ADJ.SD 3.23 SEPARATION 1.98 PERSON RELIABILITY .80 | |MODEL RMSE 1.47 ADJ.SD 3.31 SEPARATION 2.24 PERSON RELIABILITY .83 | +-----------------------------------------------------------------------------+ MAXIMUM EXTREME SCORE: 156 PERSONS MINIMUM EXTREME SCORE: 34 PERSONS LACKING RESPONSES: 122 PERSONS VALID RESPONSES: 97.2% SUMMARY OF 4 MEASURED ITEMS +-----------------------------------------------------------------------------+ | RAW MODEL INFIT OUTFIT | | SCORE COUNT MEASURE ERROR MNSQ ZSTD MNSQ ZSTD | |-----------------------------------------------------------------------------| | MEAN 4509.2 1634.2 .00 .06 .98 -.7 .85 -3.0 | | S.D. 148.4 26.2 .37 .00 .15 4.1 .14 2.8 | | MAX. 4626.0 1660.0 .48 .06 1.21 5.1 1.06 1.0 | | MIN. 4263.0 1594.0 -.49 .06 .78 -6.3 .67 -6.8 | |-----------------------------------------------------------------------------| | REAL RMSE .06 ADJ.SD .37 SEPARATION 5.91 ITEM RELIABILITY .97 | |MODEL RMSE .06 ADJ.SD .37 SEPARATION 6.07 ITEM RELIABILITY .97 | | S.E. OF ITEM MEAN = .21 | +-----------------------------------------------------------------------------+ DELETED: 84 ITEMS UMEAN=.000 USCALE=1.000 TABLE 3.2 Instructional Guidance D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- SUMMARY OF MEASURED STEPS +------------------------------------------------------------------ |CATEGORY OBSERVED|OBSVD SAMPLE|INFIT OUTFIT|| STEP |CATEGORY| |LABEL SCORE COUNT %|AVRGE EXPECT| MNSQ MNSQ||CALIBRATN| MEASURE| |-------------------+------------+------------++---------+--------+ | 1 1 170 3| -3.94 -4.12| 1.16 1.08|| NONE |( -6.34)| | 2 2 1848 27| -1.63 -1.57| .93 .76|| -5.24 | -2.91 | | 3 3 3905 58| 2.15 2.12| .94 .92|| -.59 | 2.62 | | 4 4 614 9| 5.51 5.56| 1.05 .80|| 5.83 |( 6.93)| |-------------------+------------+------------++---------+--------+ |MISSING 204 3| 1.47 | || | | +------------------------------------------------------------------ AVERAGE MEASURE is mean of measures in category. +-------------------------------------------------------------------+ |CATEGORY STEP STEP | SCORE-TO-MEASURE |THURSTONE| COHERENCE| | LABEL CALIBRATN S.E. | AT CAT. ----ZONE----|THRESHOLD| M->C C->M| |------------------------+---------------------+---------+----------| | 1 NONE |( -6.34) -INF -5.26| | 62% 25%| | 2 -5.24 .09 | -2.91 -5.26 -.57| -5.24 | 72% 74%| | 3 -.59 .04 | 2.62 -.57 5.83| -.58 | 81% 85%| | 4 5.83 .06 |( 6.93) 5.83 +INF | 5.83 | 67% 51%| +-------------------------------------------------------------------+ M->C = Does Measure imply Category? C->M = Does Category imply Measure? CATEGORY PROBABILITIES: MODES - Step measures at intersections P ++-------+-------+-------+-------+-------+-------+-------++ R 1.0 + + O | | B | 3333333333 | A |1 222 33 3 | B .8 + 11 22 222 3 33 + I | 1 2 2 3 3 4| L | 1 2 2 3 3 4 | I | 1 2 2 3 3 4 | T .6 + 1 2 2 3 3 4 + Y | 1 2 23 3 4 | .5 + * 23 * + O | 2 1 32 4 3 | F .4 + 2 1 3 2 4 3 + | 2 1 3 2 4 3 | R | 2 1 3 2 4 3 | E | 2 1 3 2 4 3| S .2 + 22 11 3 2 4 + P |2 1 3 22 44 | O | 1*33 22 44 | N | 3333 1111 2****4 | S .0 +************444444444****************1111****************+ E ++-------+-------+-------+-------+-------+-------+-------++ -7 -5 -3 -1 1 3 5 7 PERSON [MINUS] ITEM MEASURE TABLE 12.2 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS | 7 .##### T+ . | | . | 6 + .## | | . | 5 . + .## | | S| 4 + | | | 3 + . | .############ | . | 2 + | | M| 1 + |T .#### | tq1_47g Provided . |S tq1_47c Steps cl 0 . +M . |S tq1_47b Plan sta .#### | tq1_47f Exposed |T -1 + . | .#### | S| -2 + | . | . | -3 .### + | | | -4 + . | . T| | -5 + . | | | -6 + . | | | -7 . + | EACH '#' IS 42. TABLE 12.5 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS - Expected score zones | 7 .##### T+ . | | . | tq1_47g Provided.4 6 + tq1_47c Steps cl.4 .## | tq1_47b Plan sta.4 | . | tq1_47f Exposed .4 5 . + .## | | S| 4 + | | | 3 + . | .############ | . | 2 + | | M| 1 + |T .#### | . |S 0 . +M tq1_47g Provided.3 . |S tq1_47c Steps cl.3 .#### | |T tq1_47b Plan sta.3 -1 + tq1_47f Exposed .3 . | .#### | S| -2 + | . | . | -3 .### + | | | -4 + . | . T| | tq1_47g Provided.2 -5 + tq1_47c Steps cl.2 . | | tq1_47b Plan sta.2 | tq1_47f Exposed .2 -6 + . | | | -7 . + | EACH '#' IS 42. TABLE 12.6 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS - Thurstone thresholds | 7 .##### T+ . | | . | tq1_47g Provided.4 6 + tq1_47c Steps cl.4 .## | tq1_47b Plan sta.4 | . | tq1_47f Exposed .4 5 . + .## | | S| 4 + | | | 3 + . | .############ | . | 2 + | | M| 1 + |T .#### | . |S 0 . +M tq1_47g Provided.3 . |S tq1_47c Steps cl.3 .#### | |T tq1_47b Plan sta.3 -1 + tq1_47f Exposed .3 . | .#### | S| -2 + | . | . | -3 .### + | | | -4 + . | . T| | tq1_47g Provided.2 -5 + tq1_47c Steps cl.2 . | | tq1_47b Plan sta.2 | tq1_47f Exposed .2 -6 + . | | | -7 . + | EACH '#' IS 42. TABLE 12.12 Improvement D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- PERSONS MAP OF ITEMS || 7 .##### T++ . || || . || 6 ++ .## || || . || 5 . ++ .## || || S|| 4 ++ || || || 3 ++ . || .############ || . || 2 ++ || || M|| 1 ++ ||T .#### || tq1_47f Exposed . ||S tq1_47b Plan sta 0 . ++M . ||S tq1_47c Steps cl .#### || tq1_47g Provided ||T -1 ++ . || .#### || S|| -2 ++ || . || . || -3 .### ++ || || || -4 ++ . || . T|| || -5 ++ . || || || -6 ++ . || || || -7 . ++ || EACH '#' IS 42. TABLE 13.1 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- ITEMS STATISTICS: MEASURE ORDER +-----------------------------------------------------------------------------------------------------------+ |ENTRY RAW | INFIT | OUTFIT |SCORE| | |NUMBER SCORE COUNT MEASURE ERROR|MNSQ ZSTD|MNSQ ZSTD|CORR.| ITEMS | |------------------------------------+----------+----------+-----+------------------------------------------| | 34 4263 1594 .48 .06|1.21 5.1|1.06 1.0| .74| tq1_47g Provided with ideas/resources | | 30 4522 1660 .21 .06| .78 -6.3| .67 -6.8| .81| tq1_47c Steps clearly outlined | | 29 4626 1655 -.20 .06| .95 -1.4| .83 -3.2| .80| tq1_47b Plan staged and sequenced | | 33 4626 1628 -.49 .06| .99 -.3| .84 -3.1| .74| tq1_47f Exposed to good instr | |------------------------------------+----------+----------+-----+------------------------------------------| | MEAN 4509. 1634. .00 .06| .98 -.7| .85 -3.0| | | | S.D. 148. 26. .37 .00| .15 4.1| .14 2.8| | | +-----------------------------------------------------------------------------------------------------------+ TABLE 20.1 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- TABLE OF MEASURES ON COMPLETE TEST +--------------------------------------------------------------------------+ | SCORE MEASURE S.E. | SCORE MEASURE S.E. | SCORE MEASURE S.E. | |------------------------+------------------------+------------------------| | 4 -7.81E 1.91 | 9 -1.59 1.06 | 14 5.83 1.01 | | 5 -6.38 1.16 | 10 -.57 .99 | 15 6.96 1.17 | | 6 -5.27 1.00 | 11 .52 1.14 | 16 8.40E 1.91 | | 7 -4.24 1.06 | 12 2.62 1.78 | | | 8 -2.91 1.21 | 13 4.72 1.15 | | +--------------------------------------------------------------------------+ TO SET MEASURE RANGE AS 0-100, UMEAN=48.180 USCALE=6.171 TO SET MEASURE RANGE TO MATCH RAW SCORE RANGE, UMEAN=9.782 USCALE=.740 RAW SCORE-MEASURE OGIVE FOR COMPLETE TEST ++-----+-----+-----+-----+-----+-----+-----+-----+-----++ E 16 + E + X 15 + * + P 14 + * + E 13 + * + C 12 + * + T 11 + * + E 10 + * + D 9 + * + 8 + * + S 7 + * + C 6 + * + O 5 + * + R 4 + E + E ++-----+-----+-----+-----+-----+-----+-----+-----+-----++ -8 -6 -4 -2 0 2 4 6 8 10 MEASURE 1 1 1 2 5 1 1 1 3 2 3 6 61 9 0 32 1 1 5 4 PERSON 4 7 1 1 362 42232748 444 7422 3191267 T S M S T ITEMS 2 2 TSMST TABLE 20.2 Improvement P D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- TABLE OF SAMPLE NORMS (500/100) AND FREQUENCIES CORRESPONDING TO COMPLETE TEST +---------------------------------------------------------------------------+ | SCORE MEASURE S.E.|NORMED S.E. FREQUENCY % CUM.FREQ. % PERCENTILE| |------------------------+--------------------------------------------------| | 4 -7.81E 1.91| 239 53 34 1.8 34 1.8 1 | | 5 -6.38 1.16| 278 32 7 .4 41 2.2 2 | | 6 -5.27 1.00| 309 28 21 1.1 62 3.3 3 | | 7 -4.24 1.06| 337 29 31 1.7 93 5.0 4 | | 8 -2.91 1.21| 374 34 171 9.1 264 14.1 10 | | 9 -1.59 1.06| 410 29 178 9.5 442 23.6 19 | | 10 -.57 .99| 439 27 199 10.6 641 34.2 29 | | 11 .52 1.14| 469 31 215 11.5 856 45.7 40 | | 12 2.62 1.78| 526 49 562 30.0 1418 75.7 61 | | 13 4.72 1.15| 584 32 121 6.5 1539 82.2 79 | | 14 5.83 1.01| 615 28 117 6.3 1656 88.5 85 | | 15 6.96 1.17| 646 32 63 3.4 1719 91.8 90 | | 16 8.40E 1.91| 686 53 153 8.2 1872 100.0 96 | +---------------------------------------------------------------------------+ ****************************************************************************** * * * * * * * W I N S T E P S * * * * * * --------------------------------- * * * * - RASCH ANALYSIS FOR ALL TWO-FACET MODELS - * * * * PERSON MEASUREMENT, ITEM & STEP CALIBRATION, PERSON & ITEM FIT ANALYSIS * * * * INQUIRE: MESA PRESS * * 5835 S. KIMBARK AVE, CHICAGO ILLINOIS 60637-1609 * * Tel. (773) 702-1596 FAX (773) 834-0326 * * info@winsteps.com www.winsteps.com * * * * COPYRIGHT (C) JOHN MICHAEL LINACRE, 1991-2000 * * WRITTEN BY J. M. LINACRE & B. D. WRIGHT SEPTEMBER 5, 2000 VERSION 3.07 * ****************************************************************************** TABLE 0.1 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 -------------------------------------------------------------------------------- TITLE= Improvement Plan Series - Teachers feelings about Improvemen CONTROL FILE: Instructional Guidance (IF and SF) year 1.txt OUTPUT FILE: D:\SII Innovative Web Report\FP VirtualRed\Winsteps Files\In DATE: Mar 24 12:57 2009 CONTROL VARIABLES: Input Data Format STBIAS = N IAFILE = DATA = D:\SIIData\TQ\Y1 --------------- IANCHQ = N NAME1 = 1 Misfit Selection ILFILE = NAMLEN = 25 FITI = 2.000 --------------- ITEM1 = 26 FITP = 2.000 Person Delete/Anchor ITLEN = 300 OUTFIT = N PDFILE = NI = 88 LOCAL = N PDELQU = N XWIDE = 3 NORMAL = N PSEL = * DELIMIT= PTBIS = N PAFILE = INUMB = N --------------- PANCHQ = N --------------- Special Table Control --------------- Data Scoring FRANGE = .000 Cat/Step Delete/Anchor CODES = " 1 2 3 4 5 LINLEN = 80 CFILE = MISSNG = 255 MRANGE = .000 PIVOT = RESCOR = NAMLMP = 16 SDFILE = NEWSCR = CATREF = 0 SDELQU = N IVALUE = T1I# = 0 SAFILE = IREFER = T1P# = 0 SANCHQ = N KEY1 = ISORT = 1 --------------- KEYSCR = OSORT = Export Files CUTHI = .000 PSORT = 1 CSV = N CUTLO = .000 CHART = N HLINES = Y --------------- CURVES = 110 DISFILE= Output Tables DISTRT = N GRFILE = TITLE = Improvement Plan MNSQ = Y IFILE = D:\SIIData\TQ\Y1 TABLES = 0010000000011000 PRCOMP = S ISFILE = TFILE = STEPT3 = Y PFILE = D:\SIIData\TQ\Y1 FORMFD = ^ --------------- RFILE = MAXPAG = 0 Convergence Control SFILE = D:\SIIData\TQ\Y1 ITEM = ITEM MPROX = 10 SCFILE = PERSON = PERSON MUCON = 100 SIFILE = ASCII = Y LCONV = .010 ICORFIL= --------------- RCONV = .500 PCORFIL= User Scaling TARGET = N XFILE = UIMEAN = .000 BATCH = N GUFILE = USCALE = 1.000 --------------- G0ZONE = 50.000 UDECIM = 2 Scale Structure G1ZONE = 50.000 UANCH = Y GROUPS = --------------- --------------- MODELS = R Data Reformat Adjustment STKEEP = N FORMAT = EXTRSC = .300 --------------- GRPFRM = N HIADJ = .250 Item Delete/Anchor/Label KEYFRM = 0 LOWADJ = .250 IDFILE = D:\SII Innovativ MODFRM = N PAIRED = N IDELQU = N RESFRM = N REALSE = N ISEL = * SPFILE = ITEM DELETIONS: 1-28 31-32 35-88 1994 PERSON Records Input. TABLE 0.2 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS WINSTEPS v3.07 -------------------------------------------------------------------------------- CONVERGENCE TABLE +----------------------------------------------------------------------------+ | PROX ACTIVE COUNT EXTREME 5 RANGE MAX LOGIT CHANGE | | ITERATION PERSONS ITEMS CATS PERSONS ITEMS MEASURES STEPS | |----------------------------------------------------------------------------| | 1 1994 88 8 2.08 .00 -1.7918 1.6222 | | 2 1872 4 4 4.80 .00 2.2553 -.3582 | | 3 1682 4 4 4.80 .00 -.0632 1.0254 | | 4 1682 4 4 4.80 .00 -.0178 -.0022 | |----------------------------------------------------------------------------| | UCON MAX SCORE MAX LOGIT LEAST CONVERGED CATEGORY STEP | | ITERATION RESIDUAL* CHANGE PERSON ITEM CAT RESIDUAL CHANGE | |----------------------------------------------------------------------------| | 1 184.96 .9947 200 33* 2 -289.93 .2067| | 2 36.41 .9891 310 33* 3 365.25 .1121| | 3 11.63 .3207 1 33* 3 381.92 .1681| | 4 -11.07 .1967 1 34* 3 295.05 .2301| | 5 15.29 .2213 19 33* 3 194.63 .2720| | 6 28.50 .2613 200 33* 3 137.20 -.3205| | 7 42.65 -.2973 200 33* 3 166.22 -.2358| | 8 36.28 -.2560 200 33* 3 164.40 -.1897| | 9 29.24 -.2124 200 33* 3 157.81 -.1589| | 10 23.51 -.1778 200 33* 3 143.12 -.1343| | 11 19.16 -.1501 200 33* 3 131.18 .1163| | 12 15.78 -.1282 200 33* 3 119.34 .1042| | 13 13.05 .1129 200 33* 3 108.11 .0960| | 14 10.38 .1030 19 33* 3 94.29 .0898| | 15 8.02 .0956 19 33* 3 78.85 .0844| | 16 6.15 .0895 19 33* 3 63.92 .0761| | 17 5.30 .0817 19 33* 3 56.15 .0685| | 18 4.97 .0739 19 33* 3 51.33 .0625| | 19 4.50 .0672 19 33* 3 46.74 .0569| | 20 4.10 .0612 19 33* 3 42.66 .0520| | 21 3.74 .0558 19 33* 3 39.02 .0476| | 22 3.39 .0511 19 33* 3 35.81 .0437| | 23 3.07 .0468 19 33* 3 32.87 .0401| | 24 2.75 .0430 19 33* 3 30.35 .0370| | 25 2.55 .0395 19 33* 3 27.83 .0340| | 26 2.29 .0364 19 33* 3 25.77 .0314| | 27 2.07 .0336 19 33* 3 23.83 .0290| | 28 1.87 .0310 19 33* 3 21.99 .0268| | 29 1.69 .0286 19 33* 3 20.50 .0249| | 30 1.54 .0265 19 33* 3 18.86 .0230| | 31 1.40 .0245 19 33* 3 17.61 .0214| | 32 1.31 .0228 19 33* 3 16.37 .0198| | 33 1.18 .0211 19 33* 3 15.19 .0184| | 34 1.08 .0196 19 33* 3 14.05 .0171| | 35 1.01 .0182 19 33* 3 13.12 .0159| | 36 .90 .0169 19 33* 3 12.24 .0148| | 37 .81 .0157 19 33* 3 11.40 .0138| | 38 .77 .0147 19 33* 3 10.72 .0129| | 39 .72 .0137 19 33* 3 9.90 .0120| | 40 .65 .0127 19 33* 3 9.23 .0112| | 41 .61 .0118 19 33* 3 8.54 .0104| | 42 .55 .0110 19 33* 3 8.04 .0097| | 43 .52 .0103 19 33* 3 7.59 .0091| | 44 .47 .0096 19 33* 3 7.03 .0085| +----------------------------------------------------------------------------+ Standardized Residuals N(0,1) Mean: .00 S.D.: .92 TABLE 0.3 Improvement Pl D:\SIIInnovativeWebReport\FPVirtualR Mar 24 12:57 2009 INPUT: 1994 PERSONS, 88 ITEMS ANALYZED: 1682 PERSONS, 4 ITEMS, 4 CATS v3.07 -------------------------------------------------------------------------------- ; This file is Instructional Guidance - Instruction series TITLE=Improvement Plan Series - Teachers feelings about Improvement Plan (tq1_47b,c,f,g) DATA='D:\SIIData\TQ\Y1 to Y3 scaling\scaling tq items\item scaling - calibrating Y1 & Y2 measures\it NI=88 Item1=26 DISTRT=N XWIDE=3 CODES= " 1 2 3 4 5 6 7" TABLES=0010000000011000000100 MUCON=100 OUTFIT=NO NAMLMP=16 ; REALSE=Y (S.E. of misfit - rarely used) ; XFILE=filename.xf (analyzed response file - rarely used) idfile=* ;pdfile=* ifile='D:\SIIData\TQ\Y1 to Y3 scaling\item files_y1\IF Instructional Guidance.dat sfile='D:\SIIData\TQ\Y1 to Y3 scaling\step files_y1\SF Instructional Guidance.dat ;iafile=filename.if (name of anchor file) ;safile=filename.sf (name of step file) pfile='D:\SIIData\TQ\Y1 scaling\person\instguide.dat &END