The Optical Mark Reader (OMR) run by Information Technology Services Help Desk in IACC 228 provides four main areas of service:
General Purpose, 5-choice or 10-choice NCS Answer Sheets may be purchased at the Varsity Mart. If you send your students to buy these sheets individually, it is important that you make sure you are explicit in specifying which sheet (blue or green) you are going to use. The two types of forms are NOT interchangeable. If you have any questions after reading this document, please contact the ITS Help Desk at 231-8685.
OMR scans will be accepted at the ITS Help Desk during regular Help Desk hours and will be ran after 4:00 p.m. daily. Users will be notified by phone when they are ready for pick up. ITS Help Desk hours are Monday-Friday 7:30 a.m. to 9:00 p.m., Saturday 1:00 p.m. to 5:00 p.m. and Sunday 2:00 p.m. to 10:00 p.m. If users wish to be present while scans are ran, they can come to the Help Desk after 4:00 p.m. on Monday-Friday.
If this option is chosen, it will be necessary for the instructor to fill out a WEIGHT sheet in addition to the KEY sheet. The instructor must mark the desired weight of each question: A = 1 point, B= 2 points, C = 3 points, D = 4 points, E = 5 points. If a question is not given a weighting factor, a value of 1 is assumed. Note that only integer weights from 1 to 5 are allowed under this option.
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------+
| REPORT # 1 |
| Original Order of Test Sheets |
| |
| Read Down Starting from Left |
+-------------------------------+
ID ID
---------- ----------
SWAN ALV 47130
61095 1226
67929 77086
2950 20492
2052466 GUSTAVSEN
29457 50296
911 17878
4212 29804
3361 1710
55555 7793
10317 1825
1088 824
91110 89232
1356 56556
20860 7673
30191 6132
8663 96970
Return to Table of Contents
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------+
| REPORT # 2 |
| Instructor Information |
+-------------------------------+
Department --> CDD
Course Number -->
Test Date --> / /
Grading Rule --> Conventional
Order of Summary Report --> by Alphabetic
Number of Copies --> 2
Number of Questions --> 50
Total Subjective Points --> 0
Ques Key Weight Ques Key Weight Ques Key Weight Ques Key Weight Ques Key Weight
---- --- ------ ---- --- ------ ---- --- ------ ---- --- ------ ---- --- ------
1 B 1 11 A 1 21 E 1 31 A 1 41 A 1
2 B 1 12 A 1 22 C 1 32 B 1 42 B 1
3 B 1 13 B 1 23 E 1 33 A 1 43 B 1
4 B 1 14 E 1 24 D 1 34 A 1 44 A 1
5 B 1 15 A 1 25 E 1 35 A 1 45 A 1
6 A 1 16 A 1 26 D 1 36 A 1 46 B 1
7 A 1 17 A 1 27 E 1 37 A 1 47 A 1
8 B 1 18 D 1 28 E 1 38 A 1 48 B 1
9 B 1 19 A 1 29 E 1 39 A 1 49 A 1
10 B 1 20 E 1 30 D 1 40 A 1 50 A 1
Return to Table of Contents
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------------+
| REPORT # 3 |
| Test Analysis & Distribution |
+-------------------------------------+
Number of Tests Subjective Total Standard Reliability
Questions Graded Points Points Mean Median Mode Deviation KR-20 KR-21
50 ( 50 Pts) 67 0 50 42.31 44.00 44.00 4.63 0.759 0.711
-- Percentage ----> 100% 84.63 88.00 88.00 9.26
---- Score ---- Per- Cum Histogram
Points Percent centile Percent Freq Freq Each * Stands for 1 Score
27 54.0 0 1.5% 1 1 *
29 58.0 2 1.5% 1 2 *
30 60.0 3 1.5% 1 3 *
31 62.0 5 1.5% 1 4 *
35 70.0 6 1.5% 1 5 *
36 72.0 8 1.5% 1 6 *
37 74.0 10 3.0% 2 8 **
38 76.0 13 3.0% 2 10 **
39 78.0 18 7.5% 5 15 *****
40 80.0 24 4.5% 3 18 ***
41 82.0 32 10.4% 7 25 *******
42 84.0 38 1.5% 1 26 *
43 86.0 44 10.4% 7 33 *******
44 88.0 55 13.4% 9 42 *********
45 90.0 69 13.4% 9 51 *********
46 92.0 81 10.4% 7 58 *******
47 94.0 90 7.5% 5 63 *****
48 96.0 95 3.0% 2 65 **
49 98.0 98 3.0% 2 67 **
Return to Table of Contents
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------+
| REPORT # 4 |
| Frequency Distributions |
+-------------------------------+
Ques A B C D E Omit Invalid
1 25 41 1
2 23 44
3 2 65
4 27 40
5 5 62
6 66 1
7 62 5
8 6 61
9 12 55
10 10 57
11 62 5
12 66 1
13 14 53
14 5 62
15 65 1 1
16 63 4
17 51 6 2 8
18 1 9 3 45 9
19 65 2
20 1 4 1 61
21 23 6 38
22 20 2 45
23 4 1 3 59
24 1 2 14 36 14
25 2 2 62 1
26 2 1 1 63
27 2 1 2 62
28 1 5 2 59
29 2 2 28 35
30 1 1 56 9
31 64 3
32 15 52
33 59 8
34 61 6
35 48 19
36 66 1
37 54 13
38 60 7
39 51 15 1
40 64 3
41 67
42 10 57
43 4 63
44 66 1
45 67
46 39 28
47 60 7
48 7 60
49 65 2
50 62 5
Return to Table of Contents
A well-written test item should have responses in all or nearly all of the possible choices. When no student in the class picks a choice then it is not a good distractor. The choice had the same effect as if not there. Also, you may want to check that many of the students in the upper third do not flock to any one wrong choice. This often indicates a poorly worded choice or one in which the distinction between the right and wrong answer is not totally clear - even your "good" students were confused on the point covered.
Items should discriminate between the students in the upper and lower thirds of the class. If all items cover the same general topic, then the amount of students in the upper third who correctly answer a question should be greater than or equal to those in the lower third who correctly answer the same question.
The item discrimination index shows this relationship using the following formula: (U - L)/ N where U is the number of students answering correctly in the upper third, L is the number of students answering correctly in the lower third and N is the number of students in a third. A negative score means students who did poorly on the test did better on this item that those who did well -- this item probably needs to be rewritten. A score below .20 suggests there is low discrimination power and the question may need examination. Ideally, you should have a variety of indices covering the .2 to .8 range.
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------+
| REPORT # 5 |
| Item Analysis |
+-------------------------------+
Item
Qus A B C D E Omit Invalid Discrimination
Index
1 Freq 25 41CR 1
Upper 3rd 18.1% 81.8%
Lower 3rd 72.7% 22.7% 4.5% 0.59
2 Freq 23 44CR
Upper 3rd 13.6% 86.3%
Lower 3rd 59.0% 40.9% 0.45
3 Freq 2 65CR
Upper 3rd 100%
Lower 3rd 9.0% 90.9% 0.09
4 Freq 27 40CR
Upper 3rd 13.6% 86.3%
Lower 3rd 77.2% 22.7% 0.64
5 Freq 5 62CR
Upper 3rd 100%
Lower 3rd 18.1% 81.8% 0.18
6 Freq 66CR 1
Upper 3rd 95.4% 4.5%
Lower 3rd 100% -.05
7 Freq 62CR 5
Upper 3rd 86.3% 13.6%
Lower 3rd 90.9% 9.0% -.05
8 Freq 6 61CR
Upper 3rd 100%
Lower 3rd 18.1% 81.8% 0.18
9 Freq 12 55CR
Upper 3rd 100%
Lower 3rd 50.0% 50.0% 0.50
10 Freq 10 57CR
Upper 3rd 13.6% 86.3%
Lower 3rd 31.8% 68.1% 0.18
11 Freq 62CR 5
Upper 3rd 95.4% 4.5%
Lower 3rd 81.8% 18.1% 0.14
12 Freq 66CR 1
Upper 3rd 100%
Lower 3rd 95.4% 4.5% 0.05
13 Freq 14 53CR
Upper 3rd 13.6% 86.3%
Lower 3rd 18.1% 81.8% 0.05
14 Freq 5 62CR
Upper 3rd 100%
Lower 3rd 22.7% 77.2% 0.23
15 Freq 65CR 1 1
Upper 3rd 100%
Lower 3rd 90.9% 4.5% 4.5% 0.09
16 Freq 63CR 4
Upper 3rd 100%
Lower 3rd 86.3% 13.6% 0.14
17 Freq 51CR 6 2 8
Upper 3rd 100%
Lower 3rd 40.9% 22.7% 9.0% 27.2% 0.59
18 Freq 1 9 3 45CR 9
Upper 3rd 13.6% 77.2% 9.0%
Lower 3rd 4.5% 9.0% 13.6% 54.5% 18.1% 0.23
19 Freq 65CR 2
Upper 3rd 100%
Lower 3rd 90.9% 9.0% 0.09
20 Freq 1 4 1 61CR
Upper 3rd 100%
Lower 3rd 4.5% 13.6% 4.5% 77.2% 0.23
** PORTION DELETED TO SAVE SPACE **
46 Freq 39 28CR
Upper 3rd 40.9% 59.0%
Lower 3rd 68.1% 31.8% 0.27
47 Freq 60CR 7
Upper 3rd 90.9% 9.0%
Lower 3rd 90.9% 9.0% 0.00
48 Freq 7 60CR
Upper 3rd 4.5% 95.4%
Lower 3rd 13.6% 86.3% 0.09
49 Freq 65CR 2
Upper 3rd 100%
Lower 3rd 95.4% 4.5% 0.05
50 Freq 62CR 5
Upper 3rd 100%
Lower 3rd 77.2% 22.7% 0.23
Return to Table of Contents
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------+
| REPORT # 6 |
| Individual Scoring |
+-------------------------------+
P W
_ _
S S
N C C O S
A O O M U Q Q Q Q Q Q Q Q Q Q Q Q Q Q
M I R R I B Q Q Q Q Q Q Q Q Q 1 1 1 1 1 1 1 1 1 1 2 2 2 2
E D E E T J 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3
BINKLEY MIKE 29804 82 41 0 0 A $ $ $ $ $ $ $ A $ $ $ $ $ $ $ $ $ $ $ A $ $
DALLAS STEVE 1020 80 40 0 0 A A $ A $ $ $ $ $ $ B $ $ $ $ $ D E $ $ $ $ $
JETSON ELROY 3361 78 39 0 0 $ $ $ A $ $ $ A $ $ $ $ $ $ $ $ $ B $ $ A A $
OPUS P 911 88 44 0 0 A A $ A $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $
QUEST JOHNNY 22305 92 46 0 0 A $ $ A $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $
RUBBLE BARNEY 6803 94 47 1 0 $ $ $ $ $ $ B $ $ $ $ $ $ $ $ $ $ $ $ $ A $ $
STIMPY 3368 76 38 0 0 A A $ A $ $ B A A $ $ $ $ $ $ $ $ $ $ $ A A $
N
A Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q Q
M I 2 2 2 2 2 2 3 3 3 3 3 3 3 3 3 3 4 4 4 4 4 4 4 4 4 4 5
E D 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0
BINKLEY MIKE 29804 $ $ $ $ $ $ $ $ A $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $
DALLAS STEVE 1020 C $ $ $ B D $ $ $ B $ B $ $ $ $ $ $ $ $ $ $ $ $ $ $ B
JETSON ELROY 3361 $ $ $ $ $ $ $ $ A $ $ $ $ $ $ $ $ $ $ $ $ $ A $ $ $ $
OPUS P 911 $ $ $ $ $ D $ $ $ $ $ B $ B $ $ $ $ A $ $ $ $ $ $ $ $
QUEST JOHNNY 22305 C $ $ $ $ D $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ A $ $ $ $
RUBBLE BARNEY 6803 E $ $ $ $ $ $ $ $ $ $ $ B $ $ $ $ $ $ $ $ A $ $ $ $
STIMPY 3368 B $ $ $ $ $ $ $ A B $ $ $ $ B $ $ $ $ $ $ $ A $ $ $ B
** PORTION DELETED TO SAVE SPACE **
Blank Denotes Omitted Answer
$ Denotes Correct Answer
* Denotes Invalid Answer
Return to Table of Contents
Summary Report for Claim Number 641
Data Scanned on 1-14-96, Report Generated on 02APR96
+-------------------------------+
| REPORT # 7 |
| Student Summary |
+-------------------------------+
Student Summary: CDD
Student Obj. Obj. Obj. Subj. ---- Score ----
ID-Number Right Wrong Omits Points Points Percent
Means>>===> 42.3 84.6
3361 39 11 39 78.0 JETSON ELROY
911 44 6 44 88.0 OPUS P
3368 38 12 38 76.0 STIMPY
6803 47 2 1 47 94.0 RUBBLE BARNEY
** PORTION DELETED TO SAVE SPACE **
1020 40 10 40 80.0 DALLAS STEVE
29804 41 9 41 82.0 BINKLEY MIKE
22305 46 4 46 92.0 QUEST JOHNNY
Return to Table of Contents
The Test Scoring System at NDSU consists of an Optical Mark Reader scanner, software enabling the OMR to write scanned data to a file, and custom-written SAS programs running on a UNIX host which read the raw data files from the scanner and scores them. There are four different kinds of sheets which comprise the stack of sheets representing a separate Test Scoring run. These include (in order from top to bottom of the stack) the INFO sheet, the WEIGHT sheet, the KEY sheet, and the STUDENT sheets. The INFO, KEY, and STUDENT sheets will be part of every run, whereas the WEIGHT sheet is optional. Completed stacks should be taken to the ITS Help Desk in IACC 228 for processing.
Example: INFO CHEMISTRY XYZQ
Claim Number: 8
Scores filename: XYZQ.008
Example: INFO AG ENG
Claim Number: 777
Scores filename: ENG.777
A B C D E F G H I J K L M N O
1234567890 RUBBLE BARNEY 81.0 17 21 17 4 0 0 CHEMISTRY 111 1 1 1 3
ftp ftp.nodak.edu
cd pub/omr/SCORES
Please note that the last subdirectory is listed in upper case letters. Case is important here so
be sure to enter the pathname correctly.
get CDD.456
5-Single 064 0003 08-26-96 FLINTSTONE FRED 1 07 05 31 96 0123456789 020310 2 5 3 2 1Return to Table of Contents
