Learning Chapter 5: Operant Learning: Reinforcement – Flashcards
Unlock all answers in this set
Unlock answersquestion
Law of effect
answer
Thorndike Behavior is a function of its consequences
question
Any given behavior can result in what two consequences, according to Thorndike?
answer
satisfying state of affairs annoying state of affairs
question
Operant learning
answer
Also called instrumental learning, response learning, consequence learning, R-S learning. Experiences whereby behavior is strengthened or weakened by its consequences; behavior operates on the environment
question
Skinner developed what four procedures?
answer
positive reinforcement negative reinforcement positive punishment negative punishment
question
Reinforcement
answer
increase in the strength of behavior due to its consequence. Three characteristics: 1) Behavior must have a consequence 2) Behavior must increase in strength 3) The increase in strength must be a result of the consequence. There are two kinds: positive and negative
question
Positive reinforcement
answer
consequence of behavior is the appearance of, or increase in intensity of, a positive reinforcer. Also called reward learning (Skinner didn't like that term).
question
Positive reinforcer
answer
a stimulus that an individual ordinarily seeks.
question
Negative reinforcement
answer
behavior is strengthened by the removal of, or decrease in the intensity of, a negative reinforcer. Also called escape learning or escape-avoidance learning.
question
Negative reinforcer
answer
a stimulus that an individual ordinarily avoids
question
Problems with positive and negative reinforcement
answer
They are not always the same for all people. They often occur together and it can be difficult to tell them apart.
question
What is the strength of behavior?
answer
The frequency or probability of a behavior. The tendency of a behavior to continue after reinforcement is discontinued. The tendency of a behavior to persist after other averse consequences. The tendency of a behavior to persist when more effort is required. The tendency of a behavior to persist even when other reinforcers are available for other behaviors.
question
Behavioral momentum
answer
behavior that has been reinforced many times is more likely to persist even when obstructed.
question
Primary reinforcers
answer
Also unconditioned reinforcers. are innately effective. Ex: food, water, sleep, activity, drugs, electrical impulses to the brain's pleasure areas. Less obvious examples include social contact, exerting control over the environment, sensory stimulation -sometimes, it is difficult to say why these are effective. problems - satiation
question
Satiation
answer
primary reinforcers lose effectiveness. If you aren't hungry, getting food isn't as important.
question
Secondary reinforcers
answer
Also called conditioned reinforcers. Result of learning. Ex: praise, recognition, smiles, applause. Generally weaker than primary. Advantages: Satiate more slowly than primary reinforcers, easier to reinforce immediately (bridges), less disruptive than primary, can be used in many situations.
question
Generalized reinforcers
answer
combined with primary and secondary reinforcers - Money
question
Natural reinforcers
answer
reinforcers that happen spontaneously (naturally)
question
Contrived reinforcers
answer
reinforcers that are provided by someone to modify behavior
question
Compare operant and classical conditioning
answer
The role of behavior: - O: event depends on a behavior - C: event is independent of behavior (S-S), event to event. Involve different kinds of behavior - O: not reflexive (usually) - C: reflexive They do often occur together.
question
Variables affecting operant conditioning
answer
Contingency Contiguity Reinforcer characteristics Behavior characteristics Motivating operations Previous experience Competing contingencies
question
Contingency
answer
degree of correlation between a behavior and its consequence
question
Contiguity
answer
Time gap between behavior and reinforcer Shorter gaps means faster learning. - delays allow time for other behaviors to occur - delay can work if preceded by a particular stimulus (bridge)
question
Reinforcer characteristics affecting conditioning
answer
Size or strength, magnitude Qualitative differences
question
Behavior characteristics affecting conditioning
answer
difficulty of behavior Things like heart rate and biofeedback can be conditioned, but the results are generally small. Difficulty varies with species
question
Motivating operations
answer
anything that changes the effectiveness of a consequence Two kinds: establishing and abolishing Some are predictable, some counterintuitive, like having to work hard makes things more reinforcing.
question
Establishing operations
answer
Increase the effectiveness of a consequence Ex - deprive of food, food becomes more potent as a reinforcer.
question
Abolishing operations
answer
Decrease the effectiveness of a consequence
question
Competing contingencies
answer
If behavior also has punishments or if other behaviors are rewarded
question
Reward pathway
answer
a reward center Brain region that has cells that produce dopamine when stimulated.
question
Dopamine
answer
Neurotransmitter, gives a natural "high"
question
Theories of positive reinforcement
answer
Hull's drive-reduction theory Relative value theory and the Premack Principle Response-deprivation theory
question
Drive-reduction theory
answer
Hull's theory that we have drives (motivational states that drive behavior) and we try to reduce them. The theory works well with primary reinforcers. However, some reinforcers don't reduce needs. So, secondary reinforcers derive reinforcing power from their association with primary reinforcers. Critics say it's hard to classify primary and secondary. The event doesn't have to reduce a drive.
question
Drive
answer
A motivational state that drives behavior
question
Relative Value theory
answer
Relative values of events determine the effectiveness of a reinforcer. Makes no use of drives or primary/secondary reinforcers. Relative values can be reversed Strictly empirical. Problems - doesn't explain secondary reinforcers. Low can reinforce high if deprived of low.
question
Premack principle
answer
High probability behavior reinforces low probability behavior
question
Response-deprivation theory
answer
Timberlake and Allison Also called equilibrium/response restriction. Behavior becomes reinforcing when the individual is prevented from engaging in its normal frequency. The rat must run to get water. If he has enough water, then he must drink to run. Similar to Premack, but relative value is not pivitol - baseline rate. Trouble - the power of "yes."
question
Theories of avoidance
answer
Two-process theory One-process theory
question
Two-process theory
answer
Two kinds of learning are involved in avoidance - CC and OC. Dog - light and shock. Rats in a white compartment and shock. Not all tests support this. If a CS loses its aversiveness, avoidence should fade, but it doesn't.
question
Sidman avoidance procedure
answer
An escape-avoidance training procedure in which no stimulus regularly precedes the aversive stimulus. Also called unsignaled avoidance.
question
One-process theory
answer
The view that avoidance and punishment involve only one procedure—operant learning. Reduction in exposure to shock is reinforcing. Problems - extinction not happening.
question
The relationship between behavior and consequences is called the law of _________________.
answer
effect
question
Reinforcement occurs when the consequences of a behavior _________________ the behavior.
answer
increases
question
Negative reinforcement is sometimes called ________________ learning
answer
escape-avoidance
question
John Nevin suggests that the increase in strength due to reinforced can be considered behavioral ________________.
answer
momentum
question
The most important difference between Pavlovian and operant learning concerns the role of __________________.
answer
behavior
question
An important variable in operant learning that has been largely neglected is ______________.
answer
previous learning experience
question
There are two kinds of motivating operations. Those that increase the effectiveness of a reinforcer are called ____________________.
answer
establishing
question
According to David Premack, reinforcement involves a relation between a high-_________________ behavior and a low-___________________ behavior.
answer
probability, probability
question
According to ____________________ theory, an activity becomes reinforcing when an individual is prevented from engaging in it at the baseline rate.
answer
response-deprivation
question
The two processes of the two-process theory of avoidance are ___________________ and _____________________.
answer
Pavlovian, operant
question
Thorndike studied animal learning as a way of measuring animal ______________.
answer
intelligence
question
According to Thorndike's law of __________, the strength of a behavior depends on its ___________.
answer
effect, consequences
question
Positive and negative reinforcement have this in common: Both ________ behavior.
answer
strengthen
question
The defining feature of primary reinforcers is that they are not dependent on ______________.
answer
Learning
question
___________ refers to the likelihood that a reinforcer will follow a behavior.
answer
Contingency
question
In general, the more you increase the amount of a reinforcer, the _________ benefit you get from the increase.
answer
less
question
A motivating operation is anything that changes the effectiveness of a _______________.
answer
reinforcer
question
Positive reinforcement is associated with the release of ___________ in the brain.
answer
dopamine
question
According to the Premack principle, _____________ behavior reinforces _________ behavior.
answer
high-probability/likely/strong, low-probability/unlikely/weak
question
According to response-deprivation theory, schoolchildren are eager to go to recess because they have been deprived of the opportunity to ____________.
answer
move about/exercise
question
The two processes in two-process theory are_________________.
answer
Pavlovian conditioning and operant learning
question
If a pain stops after taking medicine, this is usually considered a positive thing, so why is it called negative reinforcement if the tendency to take the drug is strengthened?
answer
The drug takes away a bad thing, so it is negative reinforcement.
question
What is the single most important difference between Pavlovian and operant learning?
answer
The role of behavior
question
Why does a delay in a reinforcer reduce its strengthening power?
answer
The delay allows time for other behaviors to occur and other reinforcements/punishments to be given.
question
Sylvia believes that the reinforcement properties of an event depend on the extent to which it provides access to high probability behavior. Sylvia is most likely an advocate of ____ theory.
answer
relative value
question
_____is a neurotransmitter that seems to be important in reinforcement.
answer
Dopamine
question
Studies of delayed reinforcement document the importance of ____.
answer
contiguity
question
Operant learning may also be referred to as ____.
answer
instrumental learning
question
____________________ theory assumes that a behavior becomes reinforcing when we are prevented from performing it as often as we normally would.
answer
Response deprivation
question
The three-term contingency is often represented by the letters ____.
answer
ABC - Antecedent, Behavior, Consequence
question
The level of deprivation is less important when the reinforcer used is a/an ____ reinforcer.
answer
secondary
question
Reinforcers such as praise, positive feedback, and smiles are called ____________________ reinforcers
answer
secondary
question
Negative reinforcement is also called ____.
answer
escape-avoidance training