EDFL 456: Test 2 – Flashcards
Unlock all answers in this set
Unlock answersquestion
What are the results going to be used for
answer
Which of the following is the first consideration in planning a test?
question
Formative
answer
Which of the following assessment types should be used to evaluate student progress learning?
question
Placement
answer
A type of pretest is?
question
Improve validity
answer
Table of specifications?
question
Summative
answer
To certify student accomplishment
question
Factual knowledge
answer
Failure to use proper specifications for tests and assessments will result in overemphasis in?
question
Importance of objectives
answer
Distribution of items and tasks ?
question
D
answer
If a class test measure
question
Decrease validity and increase reliability
answer
Constructing test items from single cell to two-way table
question
Test blueprint
answer
Table of specs
question
How much time spent on it in class
answer
Weight assigned to instructional objective in table?
question
Extended and restrictive
answer
Two major classes of essay?
question
Require only paper and pencil
answer
One advantage of supply items of performance based task?
question
Validity
answer
Which characteristic of test have to be increased following the principle of measuring learning outcome most directly
question
Short Answer
answer
Measure recall of important historical dates?
question
Extended-response performance tasks
answer
To measure integration and application of critical concepts?
question
True and False
answer
Which types of objectives test items is likely to be most appropriate for measuring the objective "distinguishes between fact and opinion?
question
Provide clues to misunderstandings
answer
One advantage of the multiple choice item over other selection type items?
question
Nature of the learning tasks
answer
For a criterion-referenced interpretation the difficulty should be determining by which of the following factors?
question
Include more higher level learning outcomes
answer
The most desirable way to increase the difficulty of classroom test is to?
question
Validity
answer
Removing clues to the answer from test items is most likely to improve the tests?
question
Sampling
answer
Using specifications when constructing test items and assessment tasks most likely improves?
question
Number of items on the test
answer
Substituting multiple choice items for extended performance tasks increases?
question
agreed upon by experts
answer
The answer to an item in a classroom test should be one that is?
question
The most direct measure of the intended learning outcome
answer
the most basic principle in selecting the type of test items and assessment tasks is to select the types that are?
question
Short answer
answer
Which of the following item types is classified as a supply-type item?
question
True false
answer
Which of the following item types would provide the highest score based on guessing alone?
question
True false
answer
Which of the following item types would be most effective for measuring the ability to distinguish between factual statements and opinions?
question
True false
answer
Which of the following item types is difficult to assess students higher order thinking skills?
question
Computational skills
answer
Sort answer test items are clearly superior to matching or true false meaning?
question
Scoring
answer
Short answer major shortcoming
question
The author of (book title) is?
answer
Most well written short answer?
question
A test that is reliable is not necessary _______ or useful
answer
Which of the following is the most well-written short answer item?
question
Lowers reliability
answer
In correcting a short answer test to measure students knowledge of specific principles a teacher deducted one point from the total score for each misspelled word. How would this procedure affect test results?
question
Grid-in
answer
In large scale math testing programs many of the advantages of supply type items can be maintained by using which item?
question
They are time consuming to score
answer
Which of the following is a limitation of short answering?
question
Misinformation could lead to the correct answer
answer
All whales are mammals because they are large...asking students to mark the previous statement...would be considered poor testing practice because?
question
A rising barometer forecasts fair weather
answer
Which of the following is the most well written true false?
question
a. Specific determiners
answer
42. Absolute terms like all or non that provide clues in true false statements are known as?
question
a. Increases the number of items
answer
A true false test can be made more reliable if a teacher does which of the following?
question
a. Alaska is never hot in the summer
answer
44. Which of the following true false items statements has a specific determiner?
question
a. Knowledge
answer
45. Matching items are most useful for measuring learning outcomes at which of the following levels?
question
a. Multiple choice
answer
46. The matching item is a modified form of the?
question
a. Relate
answer
47. One difficulty in constructing matching items is that it is difficult to find material tat requires students to?
question
a. Homogenous
answer
48. A difficulty in constructing matching items is finding material that is?
question
a. Using responses more than once
answer
49. Guessing on a matching item can be reduced by doing which of the following?
question
a. Rote learning
answer
50. Excessive use of matching items will most likely result in overemphasis on which of the following?
question
a. Matching
answer
51. Which of the following types of items has the greatest chance of measuring irrelevant material?
question
a. False
answer
52. One way to cut down on the assessment of irrelevant information in matching items is to write them first as true false questions
question
53. One problem with true false items is that when a false item is correct it does not measure whether the student actually knows the information that makes the item true? a. Agree
answer
53. One problem with true false items is that when a false item is correct it does not measure whether the student actually knows the information that makes the item true?
question
a. Short answer
answer
54. In which of the following types of questions would interrater reliability probably be an issue?
question
a. Reduce validity - testing for spelling not content
answer
55. Discuss why a teacher would likely not take off for spelling when scoring a short answer question
question
a. Higher order thinking
answer
57. The interpretive item is probably..
question
a. measurement of complex learning outcome
answer
58. Using interpretive exercises results in more effective
question
a. Should be in harmony with learning outcomes
answer
59. The introductory material used should include?
question
a. Interpretive measures more complex learning outcomes
answer
60. One advantage of interpretative exercise over the single multiple choice item?
question
a. Provides a more structured task
answer
61. One advantage of the interpretive exercise over performance based assessment tasks is that the interpretive
question
a. Reading
answer
62. Which of the following "enabling skills" would most likely to lower the validity of an interpretive exercise?
question
a. Validity
answer
63. Requiring students to recall an excessive amount of factual information in order to solve and interpretive exercise can result in lower
question
a. Including items that can be answered on the basis of general knowledge
answer
64. Which of the following is common error made by test designers in constructing interpretive?
question
a. Key type and multiple choice
answer
65. Which of the following types of test items are most commonly used with interpretive?
question
a. Irrelevant factual information
answer
66. The use of interpretive exercises to measure complex learning outcomes reduces the influence of what?
question
a. It is new to the students
answer
67. The introductory material in the interpretive exercise is most effective if?
question
a. To detect invalid inferences
answer
68. The interpretive exercise is especially useful for educators because it assists in measuring the ability?
question
a. They require more than the recall of information to answer
answer
69. The test items in an interpretive exercise are most effective if they include which of the following?
question
a. Visual
answer
70. When teaching very young students it is best to use material that is?
question
a. Higher interrater reliability
answer
71. When compared to essay questions, interpretative exercises possess?
question
a. Attempt to answer the questions without the introductory material
answer
72. A simply method for checking the adequacy of an interpretive exercise is to do which of the following?
question
a. Constructing them
answer
73. Which of the following factors makes it difficult use interpretive exercises on a test?
question
a. Produce a product
answer
74. The interpretive exercise is least useful for measuring the ability to?
question
a. Poorly constructed and invalid
answer
75. If the higher achieving student in class can answer the questions on an interpretive exercise without looking at the introductory material but the lower achieving students cant - the exercise is likely?
question
a. Choosing a passage that is relatively brief
answer
76. Which of the following would be considered sound principles for constructing an interpretive exercise based on a reading passage?
question
a. Short-term memory
answer
77. Keeping the introductory materials on an interpretive exercise relatively brief would assist students who may be experiences issues of?
question
a. Answering reading comprehension questions
answer
78. Which of the following would likely be a legitimate use of the interpretive exercise?
question
a. Lower and grade level
answer
79. Which of the following should probably be the relationship between introductory materials in a science curriculum interpretive exercise and reading level of students?
question
a. Validity
answer
82. The use of some essay questions in a classroom test will probably improve the assessments?
question
a. Synthesis
answer
83. For which of the following types of learning outcomes is the essay most useful?
question
a. Determining the scoring procedures in adavance
answer
84. Which of the following is useful for improving essay testing?
question
a. Bboth are useful in both formative and summative assessment
answer
85. Which of the following characteristics is shared by both objective tests and essay tests?
question
a. Difficult to score
answer
86. One major problem in using essay qestions to evaluate learning is?
question
a. Organizing and integrating ideas is important
answer
87. Essay questions should be used in achievement tests when?
question
a. Development of an argument
answer
88. Essay questions are more appropriate than multiple choice items when learning outcome calls for?
question
a. Integrate information
answer
89. Essay are more appropriate than objective when measuring?
question
a. Limited sampling
answer
90. Which is a serious limitation of an essay test?
question
a. Complex learning outcomes are being assessed
answer
91. An extended response essay is better than restricted if?
question
a. Specific information needs to be supplied by the student
answer
92. A restricted response essay question is better than extended response?
question
a. Identifying the meaning of concepts
answer
93. For which of the following learning outcomes would objective items be better than essay?
question
a. Using the rating method for extended response questions
answer
94. Which is a sound essay grading procedure?
question
a. Validity
answer
95. Deducting points for neatness on essay responses will have the greatest influence on which of the following?
question
a. Prepare a model answer in advance
answer
96. Which of the following is a desirable practice for using restricted response essay?
question
a. Clearly indicate the nature of the desired answer
answer
97. Which test construction procedures is most likely to result in valid responses to extended response essay questions?
question
a. Grade content and spelling separately
answer
98. Which of the following is desirable practice for grading essay?
question
a. Extended response
answer
99. In order to assess students ability to express themselves creatively in writing?
question
a. Basis of comparing students is undetermined
answer
100. Presenting students with several essays to respond to?
question
a. Having a second competent scorer grade the paper (interrater reliability)
answer
101. Which of the following would most likely improve the scoring of an essay answer on a test?
question
a. Ability to formulate problems
answer
104. Performance based are more effective than MC in
question
a. Both process and product
answer
105. Advantage of performance based assessment...
question
a. Lengthy administration time
answer
106. Problem of performance based assessment
question
a. When the problems are structured so the model performances can be constructed
answer
107. Restricted response performance based better than extended response?
question
a. Provide students with valuable learning opportunities
answer
108. Best justification for large amount of time required for performance
question
a. Reduces validity
answer
109. Dependecnce of task performance on skills that are irrelevant
question
a. Severity error
answer
110. A teacher who rates all performances lower
question
a. Rate performances on one task for all students before rating performance on another task
answer
113. Rating product of student performances it is best for educators
question
a. To provide diagnostic information to students
answer
114. Analytic scoring is better than hostic scoring when an educator is trying?
question
a. Purposeful
answer
116. Student portfolios are distinguished from file folders
question
a. The ease wthey are integrated with instruction
answer
117. Strength of portfolios
question
a. Lack standardization needed for comparability
answer
118. Potential weakness in porfolios
question
a. They are labor intensive
answer
119. Major obstacle for portfiolio
question
a. Haphazard collection of student work
answer
120. Misconception of portfolios
question
a. Specified in portfolio guidelines
answer
121. Types of work appropriate for portfolio
question
a. Formative eval
answer
122. Which eval criteria is most useful analytic scoring
question
a. Assessment of factual knowledge
answer
123. Least likely to be achieved using portfolios
question
a. Holistic evaluation criteria
answer
124. Argument of summative grades?
question
a. Primary purpose of instruction
answer
125. Collaborative assessment in portfoilios
question
a. disagree
answer
127. best to evaluate on appearance
question
a. Gives parents insight into what goes on in the classroom
answer
128. which is an advantage of communicating portfolio results with parents?
question
a. Will students receive individual or group grade
answer
129. Which of the following is a particular issue tat educators need to consider when portfolios in group
question
Essay questions are placed last
answer
When arranging items in a test, it is best to ensure which of the following?
question
correct for guessing
answer
If test directions instruct students to "answer every item," it is not recommended that educators
question
number of alternatives
answer
The effect of guessing on scores can best be reduced on a multiple-choice test by increasing which of the following?
question
more high-scoring students
answer
A test item has positive discriminating power when answered correctly by
question
50%
answer
On a test of 50 students, if 25 students answered an item correctly, the item difficulty is
question
70%
answer
If item analysis data shows that an item was answered correctly by 8 out of 10 students in the upper group and 6 out of 10 students in the lower group, the difficulty of the test item is
question
the small number of students
answer
Which of the following is a major limitation of using item analysis procedures with the typical classroom test?
question
50%, .60.
answer
If 8 out of 10 students in the upper group and 2 out of 10 students in the lower group answer an item correctly, then the difficulty and discriminating power of the item would be
question
obtained low scores
answer
A distracter in a multiple-choice item is judged good if it attracts more students who have
question
True
answer
It is probably a sound motivational procedure for the teacher to announce that an upcoming test is high stake for students. (True or False)
question
Agree
answer
One good method for discouraging cheating is to proctor an exam by moving around the room. (Agree or Disagree)
question
False
answer
If paper costs are a factor, educators can reduce the print size of test questions. (True or False)
question
Agree
answer
It is good practice to not break up a test item an continue it on the next page. (Agree or Disagree)
question
True
answer
It is good practice to have a colleague check test item for bias. (True or False)
question
improve student learning
answer
The main purpose of a marking and reporting system should be to accomplish which of the following?
question
include too many different elements
answer
A serious limitation of reporting progress with a single letter grade only is that letter grades
question
achievement
answer
When a letter grade (A, B, C, D, F) is used to report student progress, the grade should be based on which of the following?
question
instructional objectives
answer
A school's marking and reporting system should be based on which of the following?
question
adequate assessment of students
answer
An effective grading and reporting system is based on which of the following?
question
checklist of objectives
answer
Which of the following methods is most useful for overcoming learning difficulties?
question
multiple marking
answer
Assigning grades that represent a pure measure of achievement is most feasible with which of the following systems?
question
it doesn't assess gradation of learning
answer
Which of the following is a major disadvantage of using the pass-fail system?
question
encourages students to explore new areas of study
answer
One advantage of the pass-fail grading system in elective courses is that it
question
they lack common meaning from one teacher to another
answer
Which of the following is the most serious limitation of the traditional letter grade as a means of reporting student progress?
question
spread of scores on each test
answer
When weighting sets of test scores to obtain a composite score for assigning grades, the weighting should be based on which of the following?
question
level of performance
answer
Absolute grading would require information concerning a student's
question
beginning by discussing the student's weaknesses
answer
During parent-teacher conferences, which of the following actions should be avoided?
question
summarize and plan a course of action
answer
Near the end of a parent-teacher conference, it is most important for the teacher to
question
percentile rank
answer
Which of the following is the most useful score for reporting standardized test results to parents?
question
True
answer
Grades such as T-scores are based on variability. (True or False)
question
Agree
answer
Sending letters home to the parent or guardian as a report card assumes that the adult is able to understand the vocabulary on the report. (Agree or Disagree)
question
True
answer
It is appropriate to collapse achievement and effort into a single letter grade. (True or False)
question
Agree
answer
Record keeping of student grades may be streamlined by using computer spreadsheets. (Agree or Disagree)
question
the score is interpreted without more information
answer
A student in grade 6 earned a raw score of 50 on an achievement test. Which of the following interpretations is most justified?
question
His percentage-correct score is 91
answer
Brent earned a score of 91 on a 100-item achievement test. Which of the following interpretations is most justified?
question
describing the nature of the individual's performance
answer
Which of the following best illustrates a criterion-referenced interpretation?
question
there are enough items for each interpretation
answer
When making criterion-referenced interpretations of standardized tests, educators must be sure that
question
actual performance of representative groups
answer
Which of the following best describes test norms?
question
greater than 7.5
answer
At the end of grade 5, Erik has a grade-equivalent score of 6.5 in reading. When he is at the end of grade 6 his score will most likely be
question
comparing performance on two tests
answer
Grade equivalent scores are least useful for
question
half the norm group had lower scores
answer
A percentile score of 50 on an achievement test indicates that
question
They have unequal units
answer
Which of the following is a disadvantage of percentile ranks?
question
Standard age score
answer
The z-score serves as the basis of which of the following?
question
They are based on the z-score
answer
Which of the following is true about T scores?
question
include only positive scores
answer
One advantage of T-scores over z-scores is that they
question
90.
answer
If a student ranks 5th in a class of 50, the percentile rank would be
question
T-score of 40
answer
In a normal distribution, which of the following scores equals a percentile rank of 16?
question
30 and 35
answer
The smallest number of percentile ranks fall between which of the following ranges of T-scores?
question
7.
answer
In a normal distribution a percentile rank of 84 would be the equivalent to a stanine of
question
score reliability
answer
The "score bands" used on the test profiles indicate which of the following?
question
Normal-curve equivalent = 80
answer
Other things being equal, which of the following represents the highest level of achievement?
question
T-score = 40
answer
In a normal distribution, which of the following represents the lowest level of achievement?
question
Stanines are based on a nine point scale.
answer
Which of the following statements about stanine scores is most accurate?
question
Agree
answer
Percentages and percentiles are interchangeable statistics. (Agree or Disagree)
question
False
answer
Norm relevancy should be left up to the test publisher. (True or False)
question
Agree
answer
It is legitimate for the test consumer to ask questions about the recency of test norms. (Agree or Disagree)
question
True
answer
The normal curve has the particular property of being symmetrical. (True or False)
question
False
answer
Percentile scores have equal intervals from one percentile rank to the next. (True or False)
question
False
answer
Stanine scores express scores in nine equal steps ranging from 1 (the highest) to 9 (the lowest). (True or False)
question
True
answer
NCE (Normal Curve Equivalent) scores can be averaged. (True or False)
question
True
answer
An NPR score of 67 means that 33% of the students who took the test earned higher scores.
question
False
answer
A student with an NPR (National Percentile Rank) of 50 is considered to be performing at the below average level. (True or False)
question
False
answer
It is accepted practice to compare a student's NPR scores earned on ELA, Math, Science, and Social Studies tests . (True or False)
question
True
answer
The Raw Score represents the number of questions that a student answered correctly. (True or False)
question
True
answer
A student with an NCE score of 50 is considered to be performing at the average level. (True or False)
question
True
answer
NPR (National Percentile Rank) CAN NOT be averaged. (True or False)
question
True
answer
A student with a stanine score of 6 is considered to be performing at the slightly above average range.
question
performance task
answer
The best method to assess a student's problem solving ability is through a simulation or through an "authentic" application of knowledge and skills that is commonly known as a(n) _____.
question
restrictive
answer
An essay question that focuses on the student's ability to provide specific information is called a(n) _____ essay.
question
extended
answer
An essay question that is meant to measure a student's ability to gather and integrate whatever information that is needed is called a(n) _____ essay.
question
validity
answer
The manner in which an achievement test's scores are interpreted and used impacts its _____.
question
effectiveness
answer
Pre- and Post-test results are commonly used in Louisiana as a measure of teacher _____ in the classroom.
question
sample
answer
A final examination that measures a student's ability to correctly spell 10 words out of the 800 words that were taught during the school year is NOT considered to provide an adequate measure of a student's spelling ability because of the small _____ size.
question
homogeneous
answer
One of the key characteristics of a matching test is that the stems and choices must be _____.
question
norm
answer
Describing the level of an individual's performance compared to that of a group represents a(n) _____ referenced interpretation.
question
criterion
answer
Describing the level of an individual's performance against a set of standards represents a(n) _____ referenced interpretation.
question
analytic
answer
A rubric that rates a student's performance using a range of descriptors that indicate/describe various levels of performance is known as a(n) _____ rubric.
question
norm-referenced test scores
answer
The NCE score is used in reporting _____.
question
70% of the students who took the test received a core that is equal to or less than the student in question.
answer
A student whose percentile rank is 70 suggest that _____.
question
indicate a student's level of mastery of content standards.
answer
A criterion-referenced test produces data that _____.
question
scoring
answer
A major problem in using essay questions to evaluate learning is the difficulty of _____.
question
constructing
answer
A major problem in using interpretive exercises to evaluate learning is the difficulty of _____.
question
true/false
answer
The type of test question that is most susceptible to guessing is _____.
question
how the scores are interpreted
answer
One measure of test validity involves _____.
question
pre-test and post-test
answer
What is the process that can be used to measure a teacher's effectiveness?
question
His percentage correct score is 91.
answer
Brent earned a score of 91 on a 100-item achievement test. Which of the following interpretations is MOST justified?
question
emphasis placed on the topic.
answer
Regarding teaching time-on-task, the distribution of items and tasks in a table of specifications should reflect the relative _____.
question
NCE
answer
This score is a norm-referenced score that has been adjusted so that it can be used in mathematical calculations.
question
Standard Score
answer
This score is produced from a single equal-interval scale of scores from kindergarten through grade 12.
question
NS
answer
This is the abbreviation for a stanine score.
question
NPR
answer
This score is based on the performance of a normed group of students.
question
%C
answer
This score is calculated by dividing the total number of correct responses by the total number of questions and then by multiplying the answer by 100.
question
Informal Assessment
answer
Measures student progress while informing the teacher and the learner of the extent that the presented course material is being learned and where no grades are recorded.
question
Formative Assessment
answer
Measures the extent that a student is making adequate progress during the presentation of course content over a period of several days.
question
Authentic Assessment
answer
Measures a student's ability to apply acquired knowledge and skills to a 'real life' simulation.
question
Summative Assessment
answer
Measures the extent that a student has acquired knowledge and skills after having completed a course.
question
Formal Assessment
answer
Measures student progress and involves the recording of a student's grades.
