Research Methods study guide

question

Applied research
answer

Conducted to address issues in which there are practical problems and potential solutions.
question

Authority
answer

1. Reliable or trustworthy sources 2. News media 3. Books 4. Government officials 5. Religious figures 6. Political pundits
question

Basic Research
answer

Attempts to answer fundamental questions about the nature of behavior
question

Empiricism
answer

Knowledge is based on observations. Data (observations) are collected that form the basis of conclusions about the nature of the world
question

Falsifiability
answer

Good scientific ideas are testable. Research can either support or falsify them
question

Intuition
answer

Relies on personal judgement. Example: this ad should persuade them to quit smoking.
question

Pseudoscience
answer

Definitely not a science. Hypotheses generated are not typically testable. Example: a pill that claims to improve memory…or increase weight loss. claims tend to be vague and ignore conflicting evidence
question

Discussion section
answer

Reviews the research from various perspectives. Compares with past results. Includes suggestions for practical applications and for future research on the topic. (strengths and weaknesses)
question

Introduction Section
answer

1. Outlines problems 2. Past research and theories 3. Formal hypotheses or specific expectations
question

Hypothesis
answer

It is a tentative statement about the relationship between two or more variables. It is a testable prediction about what you expect to happen in your study.
question

APA Ethics Code
answer

5 General Principles 1. Beneficence 2. Responsibility 3. Integrity 4. Justice 5. Respect for the rights and dignity of others
question

The Belmont Report
answer

Ethical Principles and Guidelines for the Protection of Human Subjects of Research
question

Justice (Belmont Report)
answer

Achieved through selection of persons
question

Beneficence (Belmont Report)
answer

Achieved through assessment of risks and benefits
question

Autonomy (Belmont Report)
answer

(Respect for persons) – achieved through informed consent
question

Debriefing
answer

Happens after the study. Tells them the purpose of study, anticipated results, practical implications.
question

Exempt Research
answer

Observations. No manipulation of the subject. Example: anonymous surveys, questionnaires, educational tests
question

Honest Experiments
answer

Participants are made aware of the purpose of the research and that they will be studied (e.g., speed dating studies; study skills improvement program)
question

Informed Consent
answer

The purpose is to provide potential participants with all information that might influence their decision about whether to participate
question

Minimal Risk Research
answer

When the risk of harm is no greater than risk encountered in daily life or routine physical or psychological tests. Example: physiological data, moderate exercise. Routine review conducted by the IRB
question

Confounding variable
answer

When an uncontrolled third variable is operating and is not wanted. Changes results of DV. Example: Activity level (IV) weight gain(DV) age (CV)
question

Construct validity
answer

Concerns whether our methods of studying variables are accurate. Example: Think about the bathroom scale—is this an accurate measure of weight?
question

Internal Validity
answer

is the extent to which you are able to say that no other variables except the one you’re studying caused the result. For example, if we are studying the variable of pay and the result of hard work, we want to be able to say that no other reason (not personality, not motivation, not competition) causes the hard work. We want to say that pay and pay alone makes people like Sean work harder.
question

External Validity
answer

Concerns whether we can generalize findings of a study to other settings/places/populations.
question

Correlation coefficient
answer

The way of measuring the strength of the linear association between two variables. Ranges from r = -1.0 to +1.0 Closer to 1 (+ or -) = stronger relationship between variable
question

Curvilinear relationship
answer

As scores on one variable increase, scores on the second variable tend to increase, then decrease, (then increase)
question

Experimental Control
answer

All extraneous variables in an experiment are kept constant; so that it cannot be responsible for the results of a study—in other words, it cannot be the confounding variable. Experimental control is accomplished by treating participants in all groups in the experiment identically; the only difference between groups is the manipulated variable.
question

Experiment Method
answer

One variable is manipulated or controlled and the other is measured (REMEMBER: in the NONexperimental method, both variables are measured). Attempts to eliminate the influence of all potential third variables on the dependent variable
question

Field Experiment
answer

Researchers manipulate an IV in a natural setting, such as a parking lot or a mall. Example: researchers have studied people’s parking behavior by driving a car in a variety of ways
question

Negative Linear Relationship
answer

Higher scores on one variable tend to predict lower scores on the other variable
question

Positive Linear Relationship
answer

Higher scores on one variable tend to predict higher scores on the other variable OR Lower scores on one variable tend to predict lower scores on the other variable
question

Non-experimental method (correlational method)
answer

Relies on observation or interactions to come to a conclusion. The non-experimental researcher must rely on correlations, surveys or case studies, and cannot demonstrate a true cause-and-effect relationship. Cannot manipulate variables. Both variables are measured.
question

Operational Variable
answer

The specific way in which a variable is measured in a particular study
question

Participant Variable
answer

The differing individual characteristics of participants in an experiment. Example: age, background, socioeconomic status, current mood.
question

Randomization
answer

The researcher can be confident that the characteristics of the participants in the two groups will be virtually identical.
question

Third Variable Problem
answer

There is danger that no direct causal relationship exists between the measured variables. X and Y appear to be related. But they do not influence each other. Instead, a third variable (T) causes both of them to change.
question

Concurrent Validity
answer

Examining the relationship between a measure and a behavior at the same time Example: studying a measure of shyness in a group of salespeople (probably not shy) and IT experts (probably shy) in the same company
question

Content Validity
answer

Compare measure with other content that defines the variable. Example: A measure of depression should have content that links to each of the symptoms that define depression
question

Convergent validity
answer

Extent to which scores on a measure are related to scores on other measures. Measures of similar constructs should converge. Example: One measure of shyness should correlate highly with another shyness measure or a measure of social anxiety
question

Cronbach’s Alpha
answer

Correlation of each item on the measure all other items on the measure. Ranges from 0.00 (no reliability) to 1.00 (perfectly reliable). α = .80 or greater indicates high reliability
question

Discriminant Validity
answer

Scores on a measure are not related to variables with which they should not be related. Measure should discriminate between the variable of interest and other unrelated constructs Example: Shyness and value of forcefulness with others should not be related
question

Face Validity
answer

whether or not your study measures what it is supposed to measure. You can think of it as where you just skim the surface in order to form an opinion.
question

Internal Consistency Reliability
answer

Extent to which raters agree in their observations. Single observation of one rater may be unreliable. Solution is to use multiple raters to observe the same behavior. Cohen’s Kappa: Correlation between the observations of raters
question

Interval Scale
answer

Difference between numbers on the scale are meaningful. no absolute zero Example: thermometer
question

Item-Total Correlation
answer

The item total correlation is a correlation between the question score (e.g., 0 or 1 for multiple choice) and the overall assessment score (e.g., 67%)
question

Measurement Error
answer

question

Nominal Scale
answer

No quantitative information. categories.
question

Ordinal Scale
answer

Allow us to rank order the levels of the variable being studied. No particular value is attached to the l ls between numbers Example: Star ratings for movies
question

Pearson Product-Moment Correlation Coefficient
answer

Is a measure of the linear correlation between two variables X and Y, giving a value between +1 and −1.
question

Predictive validity
answer

Using scores on one measure to predict future behaviors. Example: Validity of SAT test is demonstrated by its ability to predict performance in college
question

Ratio Scale
answer

Just like interval, an absolute zero indicates the absence of whats being measured. Example: weight
question

Reactivity
answer

Measure is reactive if awareness of being measured changes peoples’ behavior. A reactive measure tells us how people behave when they know they are being measured, but not how they would behave under natural circumstances. is a phenomenon that occurs when individuals alter their performance or behavior due to the awareness that they are being observed.
question

Split-half reliability
answer

A measure of reliability in which a test is split into two parts and an individual’s scores on both halves are compared.
question

Test-retest reliability
answer

Obtained by administering the same test twice over a period of time to a group of individuals. Example: if a group of students take a geography test just before the end of semester and one when they return to school at the beginning of the next, the tests should produce broadly the same results.
question

Closed-ended questions
answer

Limited number of response alternatives given. More structured. Response alternatives the same for everyone. Example: how much do you dislike or like this class?
question

Graphic Rating Scale
answer

A graphic rating scale is a commonly used scale system for performance appraisals. The scale typically features a Likert scale from 1-3, 1-5, and so on. An example of a 1-3 rating could include responses such as: 1: Poor, 2: Average, and 3: Excellent.
question

Open Ended Questions
answer

Respondents are free to answer any way they would like. Require time to categorize and code
question

Rating Scale
Rating Scale
answer

Ask people to provide \”how much\” judgments on any number of dimensions Example: Amount of agreement, liking, or confidence
question

Semantic Differential Scale
Semantic Differential Scale
answer

Respondents rate any concept (people, objects, behaviors, ideas) on a series of bipolar adjectives
question

Dillman’s (2008) Principles
answer

1. Simplicity 2. Negative wording 3. No Loaded questions 4. No Double-barreled questions 5. Nay Yae questions
question

Attrition/Morality
answer

(dropout factor) Even if groups started the same, dropout may cause them to become different. Pretest allows us to assess whether dropout made groups different. Most likely in longitudinal studies
question

Between-subjects design (also independent groups design)
answer

Subjects participate in only one group – either experimental or control. Comparisons made between different groups of subjects. Random assignment.
question

Carryover Effect
answer

Possible that the effect of the first condition carries over and influences the response to the second condition
question

Confounding variable
Confounding variable
answer

Another variable that occurs along with the independent variable . Is an uncontrolled variable. Cannot determine which variable is responsible for the effect. Good experimental design requires eliminating confounding variables
question

Fatigue effect
answer

Change of performance on second task due to tiredness, boredom, or distraction
question

Matched Pairs Design
answer

People are matched on a participant characteristic. Matched to either the dependent measure or a variable that is strongly related to the dependent variable Example: GPA, weight, diet.
question

Posttest-only design
answer

Obtain two equivalent groups of participants. Introduce the independent variable. Measure the effect of the independent variable on the dependent variable
question

Practice effect (also learning effect)
answer

Practice effects can be defined as influences on performance that arises from a practicing a task. Even after, participants have a tendency to perform initial trials poorly because they are still not warmed up to it
question

Pretest-posttest design
answer

Only difference: A pretest is given to each group prior to introduction of the experimental manipulation. Assures that groups are equivalent at the beginning of the experiment. Not usually necessary with random assignment to conditions
question

Repeated measures design (also within-subjects design)
answer

The same people participate in both conditions. Example: If you wanted 10 participants in each condition, you would need 10 participants total
question

Selection Differences
answer

The difference between the average value of a quantitative character in the whole population and the average value of those selected to reproduce the next generation Example: The selection differential is the difference of the base population mean and the mean of the selected parents. The selection response is how much gain you make when mating the selected parents.
question

Factorial Design
answer

Experiments with more than one IV (or factor). Simplest factorial design: 2 X 2 factorial design. Has two IVs, each IV has two levels. Example: \”Gender\” might be a factor with two levels \”male\” and \”female\” and \”Diet\” might be a factor with three levels \”low\”, \”medium\” and \”high\” protein.
question

Interaction
answer

Exists when the effect of one IV on the DV depends on level of the other IV. Can’t be obtained in simple experimental designs that only have two levels
question

Mixed Factorial Design
Mixed Factorial Design
answer

involves two or more independent variables, of which at least one is a within-subjects (repeated measures) factor and at least one is a between-groups factor. In the simplest case, there will be one between-groups factor and one within-subjects factor.
question

Main Effect
answer

The effect of each IV taken by itself. In a design with 2 IVs, there are two main effects – one for each IV. Tells you about the overall relationship between an IV and the DV

Get instant access to
all materials

Become a Member