6. Operant Conditioning.ppt operant ppr,

psychology concept

1. OPERANT OPERANT
CONDITIONINGCONDITIONING

2. DIFFERENT FROM CLASSICALDIFFERENT FROM CLASSICAL

CLASSICAL: Experimenter presents UCS CLASSICAL: Experimenter presents UCS
and CS and then observes the behaviorand CS and then observes the behavior

OPERANT: Participant / Animal must OPERANT: Participant / Animal must
behave in a certain way to get a reward behave in a certain way to get a reward
or avoid a punishmentor avoid a punishment

Def. – Learning in which reinforcement is Def. – Learning in which reinforcement is
contingent upon the subject’s behavior.contingent upon the subject’s behavior.

3. Figure 8.8 Cat in a puzzle box
Myers: Psychology, Eighth Edition
Copyright © 2007 by Worth Publishers
Thorndike’s Puzzle BoxThorndike’s Puzzle Box
Law of Effect: Behavior + Consequences = Learned Behavior

4. B.F. SKINNERB.F. SKINNER

Psychologist most Psychologist most
closely associated closely associated
with operant with operant
conditioningconditioning

5. SKINNER BOXSKINNER BOX

6. REINFORCEMENTREINFORCEMENT

REWARD / PUNISHMENTREWARD / PUNISHMENT

POSITIVE REINFORCEMENT: POSITIVE REINFORCEMENT:

Get a reward or receive something you like for Get a reward or receive something you like for
doing the desired behaviordoing the desired behavior

Social approval, money, foodSocial approval, money, food

NEGATIVE REINFORCEMENT:NEGATIVE REINFORCEMENT:

Something unpleasant is taken away for doing Something unpleasant is taken away for doing
desired behaviordesired behavior

Homework, chores, sales tax on tax free weekendHomework, chores, sales tax on tax free weekend

7. ``
Big Bang Theory

8. REINFORCEMENT cont.REINFORCEMENT cont.

PRIMARY PRIMARY
REINFORCEMENT: REINFORCEMENT:

satisfies a biological satisfies a biological
need such as hunger, need such as hunger,
thirst, or sleep, etc.thirst, or sleep, etc.

SECONDARY SECONDARY
REINFORCEMENT: REINFORCEMENT:

one that has been paired one that has been paired
with a primary re-with a primary re-
inforcer through inforcer through
classical conditioning.classical conditioning.

9. SHAPINGSHAPING

Technique used to teach animals / Technique used to teach animals /
people a more complicated taskpeople a more complicated task

The subject is rewarded for each The subject is rewarded for each
response that is closer to the final response that is closer to the final
desired behaviordesired behavior

Successive approximationsSuccessive approximations

10. SCHEDULES OF REINFORCEMENTSCHEDULES OF REINFORCEMENT

CONTINUOUSCONTINUOUS

RATIO: RATIO:

reinforcement is given after a certain reinforcement is given after a certain
NUMBER NUMBER of responses.of responses.

FIXED RATIO: reinforcement is given after FIXED RATIO: reinforcement is given after
the same number of responses each timethe same number of responses each time

VARIABLE RATIO: reinforcement after VARIABLE RATIO: reinforcement after
varying number of responses.varying number of responses.

11. SCHEDULES cont.SCHEDULES cont.

INTERVAL: INTERVAL:

reinforcement is given after a certain reinforcement is given after a certain
amount of amount of TIME.TIME.

FIXED INTERVAL:FIXED INTERVAL: reinforcement is given reinforcement is given
after the same amount of time each time.after the same amount of time each time.

VARIABLE INTERVAL: amount of time VARIABLE INTERVAL: amount of time
changes between reinforcementschanges between reinforcements

12. EXAMPLESEXAMPLES

Typist gets paid $2 per page Typist gets paid $2 per page

Fixed ratioFixed ratio

Slot machinesSlot machines

Variable ratioVariable ratio

Giving a quiz every FridayGiving a quiz every Friday

Fixed intervalFixed interval

14. CHAININGCHAINING

Learning simple skills, that when Learning simple skills, that when
combined together enable the subject combined together enable the subject
to perform more complex tasks.to perform more complex tasks.

Examples:Examples:

Reading, writing, math, sports, etc.Reading, writing, math, sports, etc.

15. AVERSIVE CONTROLAVERSIVE CONTROL

Using an unpleasant stimulus to influence Using an unpleasant stimulus to influence
behavior.behavior.

NEGATIVE REINFORCEMENT: NEGATIVE REINFORCEMENT:

when an unpleasant stimulus is removed after a when an unpleasant stimulus is removed after a
certain behavior.certain behavior.

ESCAPE CONDITIONING: A person’s behavior causes an ESCAPE CONDITIONING: A person’s behavior causes an
unpleasant event to stopunpleasant event to stop

AVOIDANCE CONDITIONING: Training of an organism to AVOIDANCE CONDITIONING: Training of an organism to
withdraw from an unpleasant stimulus before it starts.withdraw from an unpleasant stimulus before it starts.
Cliff's Buzzer

16. PUNISHMENTPUNISHMENT

An unpleasant An unpleasant
consequence occurs consequence occurs
and and decreasesdecreases the the
frequency of the frequency of the
behavior that behavior that
produced itproduced it
Big Bang Part 2

17. DISADVANTAGES OF DISADVANTAGES OF
PUNISHMENTPUNISHMENT

Unwanted side effects: rage, fear, Unwanted side effects: rage, fear,
aggression (spanked children may aggression (spanked children may
become more aggressive)become more aggressive)

Subjects learn to avoid the punisherSubjects learn to avoid the punisher

Punishment may suppress rather than Punishment may suppress rather than
eliminate such behaviorseliminate such behaviors

Alone it does not teach what is Alone it does not teach what is
acceptable behavioracceptable behavior

18. EXAMPLESEXAMPLES

Which schedule of reinforcement is being Which schedule of reinforcement is being
used?used?

Factory workers?Factory workers?

Fixed intervalFixed interval

Getting paid by the bale for hauling hay?Getting paid by the bale for hauling hay?

Fixed ratioFixed ratio

Pop quizzes?Pop quizzes?

Variable intervalVariable interval

19. Homework from the teacher’s Homework from the teacher’s
perspectiveperspective

Behavior desired from the student?Behavior desired from the student?

Complete homework assignmentsComplete homework assignments

Reinforcement being offered?Reinforcement being offered?

gradesgrades

Positive or negative?Positive or negative?

Primary or secondary?Primary or secondary?

Overworked / underpaid teacher doesn’t want to have Overworked / underpaid teacher doesn’t want to have
to grade EVERY assignmentto grade EVERY assignment

Which schedule of reinforcement would be most Which schedule of reinforcement would be most
beneficial for the teacher to use?beneficial for the teacher to use?

Variable ratioVariable ratio

20. POKER CHIMPSPOKER CHIMPS

Shaping was used to get chimps to perform Shaping was used to get chimps to perform
tasks for foodtasks for food

Classical conditioning was then used to teach Classical conditioning was then used to teach
the chimps to associate poker chips with food.the chimps to associate poker chips with food.

Soon the chimps were performing tasks to get Soon the chimps were performing tasks to get
poker chips to exchange for food in the chip-poker chips to exchange for food in the chip-
o-mato-mat

Generalization and discriminationGeneralization and discrimination

21. Which type of rft. is best for. . .?Which type of rft. is best for. . .?

. . . introducing a new behavior?. . . introducing a new behavior?

. . . maintaining a behavior for a long . . . maintaining a behavior for a long
period of time?period of time?