Psy Learning and Behavior Exam #2 (4, 5, 6) 6th edt – Flashcards
Unlock all answers in this set
Unlock answersquestion
is the reinforcement of successive approximations of a desired behavior
answer
Shaping
question
positive reinforcement is associated with the release of _____ in the brain.
answer
dopamine
question
according to response deprivation theory, schoolchildren are eager to go to recess because they have deprived of the opportunity to _________
answer
move about/ exercise
question
the two process in two-process theory are ___
answer
pavlovian conditioning; operant learning
question
secondary reinforcers are also called ____ reinforcers
answer
conditioned
question
the first step is building a behavior chain is to do a _____ analysis
answer
task
question
the reappearance of previously effective behavior during extinction is called _____
answer
resurgence
question
the presentation of a stimulus is _____ and the removal is _____ when referring to a stimulus change.
answer
positive; negative
question
an EO (establishing operation) is anything that establishes conditions that improve the effectiveness of a reinforcer is called a _____
answer
MO (motivating operation)
question
negative reinforcement is also called _____ training
answer
avoidance escape
question
name one parameter of reinforcement
answer
-contingency -delay (contiguity) -quality -magnitude -frequency
question
refers to the likelihood that a reinforcer will follow a behavior
answer
contingency
question
is the discontinuation of reinforcement for behavior, leading to a decrease in its frequency
answer
extinction
question
shaping is used to help learners ______ ______ ________.
answer
acquire new behaviors
question
response ____ ______ occurs when some responses are reinforced and others are not
answer
differential reinforcement
question
name a limitation of shaping
answer
-can be time consuming -progress in not always linear and may be erratic -requires a skillful trainer who can recognize a subtle closer approximations -can be misapplied (problems or harmful behaviors can be accidentally shaped)
question
name one of the early proponents of operant (instrumental) conditioning (hint: Skinner is not one of them)
answer
Thorndike & Watson
question
behavior is selected by its consequence
answer
operant learning
question
what is the three-term contingency
answer
A (antecedent stimulus)> B (behavior-operant response) > C (consequence stimulus: reinforcer or punisher)
question
are environmental conditions or stimuli that precede behavior. what "triggers" or "sets off" the behavior
answer
antecedent
question
schedules specify a particular amount or number of behavior that must occur for reinforcement
answer
ratio
question
schedules change from one reinforcer delivery to the next
answer
variable
question
which schedule produces a high stable rate of responding _____
answer
variable ratio (VR)
question
the schedule that is likely to produce a cumulative record with scallops is the ____
answer
fixed interval (FI)
question
a reduction in response rate following reinforcement is called a _____
answer
post reinforcement pause (PRP)
question
thinning a reinforcement schedule too rapidly or too much can produce ____-
answer
ratio strain
question
PRE stands for ____
answer
Partial Reinforcement Effect
question
____ rate of behavior matches (or is proportional to) the rate of reinforcement
answer
Matching Law
question
Thorndike studied animal learning as a way of measuring animal ____
answer
intelligence
question
according to Thorndike's ____ _____ ____, the strength of a behavior depends on ___ _______
answer
law of effect
question
positive and negative reinforcement have this in common: both _______ behavior
answer
strengthen
question
in the _____ _____ procedure, the behavior ends the trial
answer
discrete time
question
the fact that Albert reached for the rat just before the loud noise occurred means that ______ learning was involved
answer
operant
question
A typical chain might include picking up a toothbrush, dampening the brush under the spigot, putting toothpaste on it, moving the bush against the teeth, rinsing the brush, and returning the brush to its container. Obviously, the chain could be extended considerably.
answer
The Odd Couple's
question
Weil wanted to separate the effects of _____ of reinforcement and ______ of reinforcements.
answer
delay
question
in general, the more you increase the amount of a reinforcer, the ____ benefit you get from the increase
answer
less
question
according to the Premark principle, _________ behavior reinforces _________ behavior.
answer
high-probability/likely/strong; low probability/unlikely/weak
question
reinforcement occurs when the consequence of a behavior ______ _____ ______ ______ the behavior
answer
increases the strength of
question
Thorndike's early research used a _______ trial procedure, whereas Skinner used a _______ operant procedure.
answer
discrete; free
question
Kennon Lattal found that he could not shape disk pecking is a pigeon's if the reinforcer were _____
answer
delayed
question
According to David Premack, reinforcement involves a relation between two _____
answer
responses
question
According to ______ _______ theory, an activity becomes reinforcing when an individual is prevented from engaging is it at the baseline rate
answer
response deprivation
question
A ______ reinforcer or _______ ________ is a "natural" reinforcer such as food, water, sex, temperature regulation. _______ ______ stimuli that have effect on life (biological maintenance, survival) effectiveness dependent on state of deprivation and satiation
answer
unconditioned; primary reinforcer; (primary SR+)
question
value has been learned (not biological). May need to be taught (using pairing before effective). Social stimuli praise, preferred activities, money and symbolic representation such as tokens, grades.
answer
secondary reinforcers; conditioned reinforcers (Sr+)
question
is that in operant learning, an important environmental event is contingent on behavior. i.e. you must do something to get food from a vending machine or music from saxophone. A stimulus (the reinforcing or punishing consequence) is contingent on a behavior. Pavlovian conditioning, an important event occurs but it is independent of behavior; one stimulus (the US) is contingent on another stimulus (the CS).
answer
difference between operant learning and Pavlovian learning?
question
"Law of Effect" and used puzzle boxes for cats to try and escape.
answer
Edward Thorndike
question
Advocated a new approach to studying psychology- objective science. Coined "behaviorism" term. Two-term contingency: S>R (stimulus>response). Complex behavior explained by long chains of S-R connections.
answer
John B. Watson
question
developed the theory of operant conditioning. Invented the Skinner box where an animal could be isolated from outside distractions. Cumulative recorder. Made individual not group the objective experimental study.
answer
Burhus Federic Skinner
question
automatic behavior that occurs without reinforcement
answer
autoshaping
question
begin with the last link in the chain and work backward toward the first element
answer
backward chaining
question
a number of acts in a particular sequence
answer
behavior chain
question
training a person to perform a behavior chain
answer
chaining
question
a stimulus change that follows a behavior of interest (usually) immediately after or temporally close to behavior). Serves to "get something", "avoid something/someone" or "intrinsically maintained". Reinforcer or Punisher. The action and effect of consequences on behavior determine if it is reinforcement or punishment.
answer
consequence
question
refers to the degree of correlation between a behavior and its consequence
answer
contingency
question
the gap between a behavior and its reinforcing consequence has a powerful effect on the rate of operant learning. Shorter the interval is, the faster learning occurs
answer
contiguity
question
events that have been arranged by someone for the purpose of modifying behavior
answer
contrived reinforcer
question
the behavior of the participant ends the trial
answer
discrete trial procedure
question
motivational states
answer
drive
question
reinforcers reduce a drive caused by physiological deprivation of (sleep, water, oxygen, sexual stimulation)
answer
drive-reduction theory (Hull's theory of reinforcement)
question
a neurotransmitter known as adrenaline
answer
Epinephrine
question
reinforces behavior in negative reinforcement is escaping from an aversive stimulus
answer
escape-avoidance learning
question
abrupt increase in the behavior on extinction
answer
extinction burst
question
reinforcing performance of the first link in the chain
answer
forward chaining
question
behavior can be repeated any number of times
answer
free operant procedure
question
the nature of the consequence is irrelevant. The behavioral Effect of the consequence is all important
answer
functional analysis
question
reinforcers that have been paired with many different kinds of reinforcers can be used in a wide variety of situations
answer
generalized reinforcer
question
Behaviors leading to satisfying state of affairs are strengthened (stamped in), while behaviors leading to an unsatisfying state of affairs are weakened (stamped out)
answer
Law of Effect
question
an antecedent event that alters the effectiveness of a given reinforcer. Anything that establishes conditions that improve the effectiveness of a reinforcer.
answer
motivating operation (MO)
question
Establishing Operation (EO): Deprivation Sr+ and Aversive stimulation Sr- and Abolishing Operation (AO): satiation Sr+
answer
types of MOs
question
events that follow automatically-naturally from the behavior
answer
natural reinforcer
question
a behavior is strengthened by the removal of or a decrease in the intensity of a stimulus.
answer
negative reinforcement
question
something the individual tries to escape or avoid
answer
negative reinforcer
question
a behavior is followed by the appearance of or an increase in the intensity of, a stimulus.
answer
positive reinforcement
question
is the stimulus, ordinarily something the individual seeks out.
answer
postive reinforcer
question
Skinner found that the type of reinforcement which produces the slowest rate of extinction (i.e. people will go on repeating the behavior for the longest time without reinforcement) is_________ The type of reinforcement which has the quickest rate of extinction is __________.
answer
variable-ratio reinforcement; continuous reinforcement.
question
An animal/human is positively reinforced every time a specific behaviour occurs, e.g. every time a lever is pressed a pellet is delivered and then food delivery is shut off.
answer
Continuous Reinforcement
question
Behavior is reinforced only after the behavior occurs a specified number of times. E.g. one reinforcement is given after every so many correct responses, e.g. after every 5th response. For example a child receives a star for every five words spelt correctly.
answer
Fixed Ratio Reinforcement
question
One reinforcement is given after a fixed time interval providing at least one correct response has been made. An example is being paid by the hour. Another example would be every 15 minutes (half hour, hour, etc.) a pellet is delivered (providing at least one lever press has been made) then food delivery is shut off.
answer
Fixed Interval Reinforcement
question
Behavior is reinforced after an unpredictable number of times. For examples gambling or fishing.
answer
Variable Ratio Reinforcement
question
Providing one correct response has been made, reinforcement is given after an unpredictable amount of time has passed, e.g. on average every 5 minutes. An example is a self-employed person being paid at unpredictable times.
answer
Variable Interval Reinforcement
question
naturally or innately reinforcing. ex. food, water, sexual stimulation, relief from heat and cold, and certain drugs. Unconditioned SR whose effects are not dependent upon learning
answer
primary reinforcer
question
(consequence) ex. spanking and or isolation- follows the behavior probability of the behavior decreases
answer
punisher
question
procedure/phenomenon and or effect. ex. spanking decreases or increase. Contingent on a response. Stimulus presented (positive) or removed stimulus (negative).
answer
punishment
question
(consequence)- follows the behavior; future probability of the behavior increases
answer
reinforcer
question
procedure/ phenomenon and or effect. ex. an increase in the strength of behavior due to its consequence. Contingent on a response. Stimulus presented (positive) or aversive removed (negative)
answer
reinforcement
question
different kinds of behavior have different values, relative to one another, at any given moment. Relative values determine the reinforcing properties of behavior.
answer
Relative value theory (Premark Principle)
question
is that behavior becomes reinforcing when the individual is prevented from engaging in it at its normal frequency. All behaviors have a "natural" baseline level of occurrence- if you restrict below this level, access to the behavior becomes a reinforcer.
answer
Response deprivation theory
question
reinforcers involved in positive reinforcement are usually things people consider rewarding
answer
reward learning
question
a phenomenon where most primary reinforcers lose their effectiveness rather quickly
answer
satiation
question
those that are dependent on their association with other reinforcers. ex. praise, recognition, smiles, and positive feedback. Conditioned Sr whose effects are acquired through pairing with other reinforcers
answer
secondary reinforcer
question
reinforcement delivered by an agent (person)
answer
mediated source of reinforcement (social)
question
reinforcement directly produced by a response
answer
automatic source of reinforcement
question
biology- natural selection behavior- reinforcement, extinction culture- benefits/ costs to the survival of the group
answer
Selection by consequence: three levels
question
modification of response topography through differential reinforcement for other behaviors
answer
shaping
question
the rate at which behavior occurs once it has begun is called the ____ _____
answer
run rate
question
in FT and VT schedules, reinforcement is contingent on time rather than behavior
answer
time; behavior
question
the thinner of the two schedules, FR3 and VR4?
answer
VR4
question
you could do something analogous to stretching the ratio by ______-
answer
stretching the interval
question
the frustration and sequential hypotheses are both variations of the _______ hypothesis
answer
discrimination
question
the difference between multiple and mixed schedules is that in _____ schedules there is a signal that the schedule has changed
answer
multiple
question
The rate of behavior matches (or is proportional) the rate of reinforcement. The Kassinove and Schare study suggest that near misses can serve as
answer
reinforcers