LU Tests and Measurements Final Exam Study Guide – Flashcards
Unlock all answers in this set
Unlock answersquestion
The president of the school board announced that your district will begin an intense war on mediocrity in our school district. Within five years our foremost goal is for all our students to move above average on the Comprehensive Tests of Basic Skills...Over the last decade about half the students in your district have been above average. ....Why is the board president's statement unrealistic?
answer
It is not statistically possible for all students to score above average in your district.
question
Recent trends and current trends all suggest that the use of testing and assessment in the schools is likely to...
answer
increase
question
Joan, a third-grade teacher, decides to complete her lesson on "math Facts-Addition" and move on to "Math Facts Subtraction. This is an example of ___________ decision.
answer
instructional
question
According to the authors, test misuse and abuse are most likely to occur whenever...
answer
Test users are unaware of the factors that influence test scores.
question
As a teacher the main advantage of knowing the lay language of validity and reliability is to ...
answer
communicate test results to the parents
question
This type of test has uniform administration and scoring procedures...
answer
Standardized
question
____________ decision is usually made based on standardized test data.
answer
Selection
question
Ms. Palmer's main motive to suggest Ms. Wilson to include the essay items was...
answer
to test students' higher order thinking
question
For the upcoming test, Ms. Palmer will create...
answer
Criterion-Referenced Test (CRT)
question
Who determines whether students with disabilities take the same annual academic assessment required under NCLB?
answer
Individual Educational Plan Team
question
The major distinction between testing and assessment is that assessment is a process that is...
answer
broader than testing
question
Which is the most appropriate marking system to communicate students' grades with the parents?
answer
Letter grades A, B, C, D, E, F
question
Which of the following is NOT a factor that can affect a test's usefulness?
answer
Education Reform
question
Increased use of portfolio and performance assessment techniques in the schools has been suggested to...
answer
reduce pressure to test only for facts and specific skills.
question
Which of the following best describes the current status of performance-based assessment?
answer
A currently popular idea that awaits further debate and development.
question
What is Ms. Palmer's main reasoning for utilizing the Promotion and Graduation Test (PGA)?
answer
For the students to graduate.
question
Both IDEIA and NCLB represent example of
answer
educational reform initiatives
question
A teacher has a new foreign student and wishes to obtain an estimate of the student's math skills. What kind of test should she use?
answer
Non-verbal
question
What is Ms. Palmer's reasoning for creating the criterion referenced test in the mid-semester?
answer
She wants to test students' more specific knowledge of the topics covered.
question
Robert, a 9th grader, has just been told, "The reason you're having so much trouble with division is that you have never mastered multiplication. The Math Basic Skills Tests have indicated this quite clearly. We are going to provide you with instruction in multiplication immediately. Roberts teacher made what kind of a decision relative to his skill level?
answer
Diagnostic
question
As a result of the recent passage of the 2004 Reauthorization of the Individuals with Disabilities Education Act (IDEA-04) the involvement of general education teachers in the education, testing and assessment of special education students is expected to...
answer
increase
question
When selecting a test, which of the following factors should be considered?
answer
The cultural/linguistic background of those being tested.
question
Why is it important to specify what we want to measure before we begin to test?
answer
To avoid interpretive errors
question
Teachers are most frequently involved in what kind of decision?
answer
Instructional
question
The major distinction between testing and assessment is that assessment is a process that is
answer
broader than testing.
question
One of the main advantages of the use of curriculum-based measurements (CBM) is that they...
answer
can be used for progress monitoring of both regular and special education students.
question
How we measure in the classroom should be determined by...
answer
what it is that we want to measure.
question
The main purpose of testing in education is to
answer
provide objective achievement data
question
For progress monitoring, it is important that multiple CBM data points are used to inform decision making to compensate for the
answer
poor reliability of single CBM probes
question
The term used for reassigning a principal and all or part of existing school staff due to unacceptable school performance is
answer
reconstitution
question
In a three tier RTI model, compared to Tier 3 instruction, Tier 2 instruction is typically...
answer
less intensive and less specialized
question
One of the advantages of the standard protocol approach to RTI is
answer
training teachers to implement this approach is easier
question
Which of the following best describes response to intervention (RTI)?
answer
An integrated assessment, intervention and decision-making system
question
According to the three-tier RTI model, about what percentage of students receive Tier 2 instruction?
answer
15%
question
This type of high-stakes test is designed to focus on broad national goals and objectives
answer
Norm-Referenced
question
Universal screening is intended to
answer
assess all students to identify those at educational risk
question
The No Child Left Behind (NCLB) Act requires public schools to assess all students at the end of grades
answer
3 through 8
question
Progress monitoring involves the use of
answer
frequent brief assessments to monitor student responsiveness to instruction
question
According to the authors, basing important decisions only on high-stakes test scores is controversial because these scores are
answer
too limited
question
A colleague insists that RTI and CBM are the same. You state, "That is not correct,
answer
CBM is on of the key RTI assessment components
question
A primary disadvantage of the problem-solving RTI model is
answer
implementation integrity is difficult
question
The intent of high stakes testing is to use educational tests and measurements to
answer
make decisions of prominent educational, financial or social impact
question
A fellow teacher says I've been teaching for 30 years, and we have always used end of year norm-referenced tests to make educational decisions. There is simply no need for us to start using CBM on a weekly basis. Your reply is
answer
they are not sensitive to day to day changes in learning like CBM
question
According to the text, what can a teacher do to prepare and help students prepare for high-stakes testing?
answer
keep discussions of the test simple
question
When RTI is sully implemented it applies to
answer
both regular and special education personnel
question
According to the authors, RTI holds promise to
answer
improve early identification and intervention for struggling readers
question
In a three tier RTI model, in what setting is Tier 1 instruction typically delivered?
answer
The regular classroom
question
Progress monitoring involves the use of
answer
frequent brief assessments to monitor student responsiveness to instruction.
question
It is possible for a student to pass an NCLB required test in one state and yet fail an NCLB required test in another state because
answer
states are free to establish different cut off(i.e. passing) scores.
question
Universal screening is intended to
answer
assess all students to identify those at educational risk
question
According to the text, one of the challenges facing RTI is the lack of
answer
culturally responsive measures and research-based interventions
question
Mr. Reacher wants to know if his class is achieving at or above or below average rate. A(n) ___________ test will help him to get this information
answer
norm-referenced
question
Identify the learning activity from the following list
answer
Watch the Evening News tonight
question
Which of the following phrases best describes the process of analysis?
answer
Breakdown into constituent parts
question
In a criterion referenced test, we are interested in
answer
whether a pupil has achieved mastery of the skill
question
Grade equivalent scores compare a student's performance to
answer
the performance of others
question
Criterion-referenced tests are used to determine
answer
which objectives a student has acquired competence in
question
The average difficulty level of an item for a norm referenced test is appropriate if
answer
half the pupils miss the item
question
The term to describe the extent to which test items match a teacher's instructional objective is
answer
content validity
question
The LEAST important purpose for preparing educational objectives among the following is
answer
to match test items on standardized achievements, so a course of study prepares students for the exam
question
Which of the following is a suggestion to more objectively score essay items?
answer
Grade each person's responses anonymously
question
The use of none of these as an option in a multiple choice item is only appropriate when
answer
the opinions provide absolutely correct or incorrect answers
question
Ownership refer to the perception that the portfolio contains
answer
what the students want
question
Which of the following types of items is best adapted to evaluating student knowledge of numerous technical terms?
answer
matching
question
Which of the following is a poor suggestion for grading an essay test?
answer
Grade one complete paper before going to the next
question
In which of the following situations would the pictorial form of multiple choice items be most useful?
answer
Interpreting a histogram
question
One prominent limitation of essay tests is
answer
the difficulty of analyzing the subparts of the correct response
question
Which of the following item formats is easiest to construct?
answer
essay
question
To test a student's ability to use higher mental processes of logical reasoning and critical thinking a(n) __________ test should be used?
answer
essay
question
Which of the following is a good suggestion to follow in writing true-false items?
answer
Avoid using statements taken directly from the text.
question
Which of the following items is poorly written?
answer
Discuss the causes of the Civil War in depth. You will have 30 minutes.
question
The number of points a scale contains should
answer
change according to the number of variations in the behavior that can be observed.
question
If the same knowledge were tested by the same number of items of different types, which type would the fewest number of pupils be expected to answer correctly by chance?
answer
A short-answer test.
question
For which of the following objectives would an essay test be most clearly superior to an objective test? To appraise the examinee's
answer
ability to assemble and organize his ideas on a topic
question
How many variations in student behavior are being observed when a checklist is used?
answer
two
question
The use of "none of these" as an option in a multiple-choice item is only appropriate when
answer
the opinions provide absolutely correct or incorrect answers
question
In an extended essay, your detailed scoring criteria should at least assign weights to organization, process and
answer
content
question
Which of the following item types is least subject to guessing?
answer
completion
question
For checklist items in which the "no opportunity to observe" box is checked, the behavior in question is coded
answer
receive no rating
question
For which of the following levels of learning outcomes is the restricted response essay question more appropriate?
answer
comprehension
question
The use of scoring criteria in grading essay items consists of
answer
rating or scoring each component of a pupil's response.
question
On an open-book exam, a teacher selects a quotation from the text and asks her students to use the text to prepare an analysis of the quotation. This procedure is referred to as a
answer
dialectic journal
question
The stem of the multiple-choice item presents the pupil with a problem, whereas the choices represent
answer
plausible solutions
question
If you assigned a 1st draft a score of 7, a 2nd draft a score of 8, and a final draft a score of 9, and weighted the three products 20%, 30%, and 50%, respectively, what numerical score would you assign for this sample of work?
answer
8.3
question
The best way in which to view portfolios among other competing forms of assessment would be to see the portfolio as
answer
a means of capturing authentic behavior in a life-like environment.
question
What type of format provides greatest content sampling in the shortest testing time?
answer
True-False
question
Among the most important traits to include when developing a scoring mechanism for the entire portfolio are
answer
organization thoroughness, growth or progress
question
The use of scoring criteria in grading essay items consists of
answer
rating or scoring each component of a pupil's response
question
Which of the following is a shortcoming of performance assessments?
answer
None of the above is a shortcoming
question
Which of the following best reflects a performance assessment?
answer
Developing a class presentation utilizing more than one medium that demonstrates the steps followed in completing the presentation.
question
If a teacher asks 10 essay questions in a two hour exam, how many points should be allocated to each item?
answer
as many as the scoring criteria suggest
question
In rating the portfolio as a whole, which among the following would you want to emphasize most?
answer
Growth in skill or performance
question
Which of the following best describes the current status of performance based assessment? It is...
answer
being advocated as a fairer and more relevant alternative to conventional testing.
question
Which one of the following is an advantage of short answer type items?
answer
The probability of guessing correctly is reduced.
question
Assume a set of 90 normally distributed test scores has a mean of 70 and a standard deviation of 10. If this value is zero, everyone received the same score.
answer
Variance
question
For making predictions, a test that yields a large negative correlation is...
answer
as useful as one with the same sized positive correlation.
question
A person whose z-score was zero would have a raw score equal to...
answer
the mean
question
If a pupil was informed that his z-score was -.6 in a distribution where the mean = 70 and the standard deviation = 10, his raw score would be...
answer
64
question
Is always the same as the 50th percentile
answer
the item refer to the median
question
Assume that a set of 90 normally distributed test scores has a mean of 70 and a standard deviation of 10. A T-score of 75 would equal a raw score of
answer
95
question
What is the median for the following distribution of scores? 5,8,3,5,7,9,5,8,3
answer
5
question
What is the variance of the scores 3, 6, and 9?
answer
the square root of 6
question
A distribution with more than one most frequent score is
answer
multimodal
question
In a negatively skewed distribution, this value is located at the lower end.
answer
the item refers to the mean
question
Assume that a set of 90 normally distributed test scores has a mean of 70 and a standard deviation of 10. Approximately what percentage of cases falls between a z-score of +2 and a z-score of +3?
answer
2%
question
For making predictions, a test that yields a large negative correlation is
answer
as useful as one with the same sized positive correlation
question
In high school, a teacher gave two sections of a class the same arithmetic test. The results were as follows: Section I: Mean 45, SD 6.5; Section II: Mean 45, SD 3.1. Which of the following conclusions is correct?
answer
Section I is more variable than Section II.
question
What percentage of students in a distribution falls between the first and third quartiles?
answer
50%
question
The coefficient of determination is used to
answer
compare the relative strength of coefficients
question
90 normally distributed test scores; mean of 70; SD of 10. A T-score of zero (0) would be equivalent to a raw score of
answer
20
question
The result of computing a linear correlation coefficient when a somewhat curvilinear relationship exists will be a(n)
answer
underestimation of the relationsship
question
The score that is duplicated (repeated) the largest number of times in a set of scores is the
answer
mode
question
The distribution below is (distribution has the hump on the left side)
answer
positively skewed
question
In a normal distribution, approximately what percentage of scores lies between T-scores of 40-80?
answer
84%
question
An r-value of +0.82 can be interpreted to mean that
answer
the two variables tend to be closely related
question
The median is a point on the scale that divides the
answer
number of scores in halves
question
In a frequency distribution of 290 scores, the mean is 99 and the median is 86. One would expect this distribution to be
answer
positively skewed
question
In a negatively skewed distribution this value is located at the lower end
answer
the items refers to the mean
question
Which of the following correlation coefficients indicates the highest degree of linear relationship?
answer
.87
question
If the correlation between piano playing ability and proficiency in weight lifting is negative, we would know that if John is a poor piano player, he would likely be
answer
a good weight lifter
question
One of the disadvantages of a grouped frequency distribution is
answer
that it loses information about individual scores
question
The most dependable derived unit for measuring how far score varies from the mean for the group is called the
answer
standard deviation
question
A pupils reading achievement score is one standard deviation above the national norm. How could you best interpret this finding to her parents?
answer
she is above average in reading
question
An individual reported a correlation of 1.25 between form A and form B of an intelligence test. From this coefficient one would conclude that
answer
a mistake has been made in computing the correlation coefficient
question
What would the correlation likely be in the following diagram? x & y scatterplot where the scores are scattered in an upward direction to the right?
answer
0.50
question
To compute a correlation coefficient between traits A and B, one must have
answer
measures of traits A and B on each subject in one group
question
The optimal number of intervals in a grouped frequency distribution is
answer
dependent on the way the data are distributed
question
Five students received scores of 10, 12, 14, 16, and 28. The mean of these scores is
answer
none of the above
question
If a pupil ranks ninth in a class of 30, his percentile rank is
answer
30
question
In a normal distribution, what percentage of scores will fall between -1 standard deviation and +1 standard deviation?
answer
68%
question
Given (picture of a bell curve leaning towards the right with three lines ABC)
answer
Mode
question
From a measurement point of view, what is the major objection to reporting grades by intervals of one percentage point rather than by five letter grades (A,B,C,D,F,)?
answer
The unit is too small to be judged accurately
question
There is no value in correcting for guessing on a teacher-made test where pupils are instructed to
answer
answer every item
question
Which item appears best for a criterion-referenced test? Chart with Item no.s, pre-test, post-test and difference. 1st three no.s are 84, 86, +2%
answer
4
question
What is the discrimination index of this item? Chart with A, B*, D, D, E
answer
4/27
question
Which of the following is indicated by item 2? Chart with Item 1 and Item 2 and ABCDE. C* is in the chart of Item 2
answer
Guessing
question
The first decision made by the test constructor is determining the
answer
purpose of the test
question
The procedures for item analysis of a norm-referenced test require that both the high group and the low group
answer
contain the same number of pupils
question
One of the questions on an achievement test yields the following item analysis data... Upper/Lower Chart with AB*CDE
answer
-.08
question
What is item 2's difficulty level? Chart with Item 1 and 2 with ABC*D?
answer
16/30
question
Which item is probably too difficult? Chart with %Passing and pre-test, post -test etc.
answer
3
question
The item discrimination index is used in test construction to ensure that there is
answer
maximum variation in performance between individuals.
question
The major reason why care should be taken to ensure that performance assessment instruments should be given adequate front-end or back-end weight for a marking period is that they
answer
require a substantial time and effort commitment
question
Which is the disadvantage of comparisons based on aptitude?
answer
marks tend to unjustly reward low aptitude students
question
Which of the following best describes current practice in weighting and combining components of a composite mark? Most teachers...
answer
fail to equate before they weight
question
Which if any of the following distractors should be replaced?
answer
Option E
question
What is Item 1's difficulty level?
answer
6/24
question
One of the disadvantages of using a pass/fail grading system is that
answer
it makes interpretation on passing grades difficult
question
Which of the following would require the greatest amount of teacher time?
answer
Basing marks on student improvement
question
Which of the following best describes current practice in weighting and combining components of a composite mark? Most teachers
answer
fail to equate before they weight
question
All other things being equal, which of the following marking practices results in the most reliable grades?
answer
A,B,C,D,or F
question
The reliability of grades may be improved by
answer
using five to 15 categories
question
One of the questions on an achievement test yields the following item analysis data....Chart with upper and lower where B*
answer
(b) + (c)
question
What is items 2's discrimination index?
answer
6/15
question
The factor that most seriously limits the vale of grades for certification is that grades
answer
are no comparable between classes and schools
question
Record keeping is most time consuming when grades are based on comparison with
answer
effort
question
Which item should probably be eliminated?
answer
7
question
Combining achievement and attitude (or effort) in a single mark is poor practice because
answer
the mark will be difficult to interpret
question
What is the difficulty level of this item? B* 14 upper 10 lower?
answer
4/54
question
Which of the following is a recommendation to help prepare students for a test?
answer
equalize the advantages between test-wise and non test-wise students
question
Each mark in a course should e assigned and interpreted as
answer
a measure of the level of achievement
question
What is meant by "a given test item is highly discriminating?"
answer
More high-scoring students than low-scoring students answer it correctly
question
Which distractor on Item 1 needs revision or elimination? D* B has 4 and 1
answer
1-B
question
Which of the following will decrease the standard error of measurement? Decreasing
answer
the standard deviation
question
An admissions director correlates scores from the SAT with 3rd year GPA. This is an example of
answer
predictive validity
question
This reliability coefficient is usually over a short time than a long term?
answer
Test-retest
question
The new IQ test you have devised is administered to a gifted class. Its results are then correlated with end of year grades. Compared with the correlation that would be obtained if it were correlated with grades from regular class students, this correlation would be
answer
The answer is not curvilinear***
question
The following table lists the scores obtained from five different tests by Seymour and Butch....Gamma highlighted
answer
chance
question
Is most important for achievement tests such as those constructed by teachers
answer
content validity
question
If a thermometer measured the temperature in an over as 400 degrees F five days in a row when the temperature was actually 397 degrees F, this measuring instrument would be considered quite
answer
reliable but not valid
question
The following table lists the scores obtained from five different tests by Seymore and Butch. Delta highlighted
answer
chance
question
Decreasing the time interval between predictor and criterion measures
answer
increases the validity coefficient
question
A teacher has just computed the reliability of a test she's made after a single administration. What kind of reliability did she compute?
answer
Internal consistency
question
Requires a time interval for its determination
answer
predictive validity
question
Comparing test items with objectives refers to which type of validity
answer
content
question
Comparing a newly formed anxiety scale with an existing anxiety scale yields this type of validity coefficient
answer
concurrent validity
question
To build reliability into a test, it is desirable to
answer
write items of various difficulty levels
question
Can be established by correlating odd with even-numbered items
answer
reliability
question
The correlation between test scores and a criterion is a measure of
answer
validity
question
The following table lists the scores obtained from five different tests by Seymour and Butch. Epsilon highlighted
answer
chance
question
On which of the following (fictitious) tests is content validity most appropriate?
answer
The Beta Achievement Test
question
The following table lists the scores obtained from five different tests by Seymour and Butch. Alpha highlighted..
answer
chance
question
You administer the Quick and Dirty personality test on January 16, 1984 and march 1, 1984 to the same group of subjects and correlate the results...estimate of
answer
test-retest reliability
question
When two intelligence tests are given to an adult a year or two apart, the difference in individual's IQ's or percentile ranks from one test to the other is most likely due to
answer
error of measurement
question
The index which estimates the extent to which a score obtained on a test approximates the individual's true score on the test is the
answer
standard error of measurement
question
Can be established by comparing items with objectives
answer
content validity
question
You have devised a new measure called the PITSS Procrastination Inventory for Teachers in Secondary School....
answer
Concurrent validity
question
Erroneously adding 5 points to each score on a test will cause its reliability coefficient to
answer
do nothing - the reliability coefficient stays the same
question
Which of the following will decrease the standard error of measurement? decreasing the
answer
standard deviation
question
Which type of validity coefficient is most important for personality tests?
answer
construct
question
Is most important for aptitude tests?
answer
predictive validity
question
Which type of validity coefficient is most appropriately used for selection purposes?
answer
predictive
question
Given the following information on a test: M= 70, SD = 10, SEmeas = 2. If a student made a score of 81, we would be 68% certain that his true score would be in the range from...
answer
79 to 83
question
Epsilon highlighted
answer
chance
question
The number of items on the predictor is cut in half. This
answer
decreases the validity coefficient
question
Alpha highlighted
answer
chance
question
What size correlation would be expected between a Standford-Binet given at age 8 and one at age 15?
answer
About .85
question
Which of the following represents the highest degree of relative performance?
answer
A T-score of 72
question
If the instructions for administering and scoring a standardized achievement test are NOT followed rigidly whe it is administered to pupils
answer
reliability will be affected to an unknown extent
question
A teacher give s a final examination to see if students have met his course objectives. This calls for the use of
answer
a teacher-made test
question
One advantage of individual tests of scholastic aptitude is that they provide opportunities for
answer
clinical insights regarding pupil's typical behavior
question
Projective techniques are, as a group, distinguished from other personality measure in their utilizing
answer
ambiguous stimuli
question
As contrasted with various separate achievement tests in the same subjects and obtained from different test publishers, a survey achievement battery yields derived scores for the same school subjects which are more likely to be
answer
comparable
question
With the passage of IDEIA, the severe aptitude-achievement discrepancy approach to Specific Learning Disability (SLD) eligibility decision-making was
answer
made optional
