Deck 19: Actions, Habits, and the Cortico-Striatal System

Full screen (f)
exit full mode
Question
Instrumental behavior is modified by the outcome it produces.
Use Space or
up arrow
down arrow
to flip the card.
Question
According to Thorndike's Law of Effect, instrumental behavior should not be considered purposeful or goal directed.
Question
According to Thorndike's Law of Effect, instrumental behavior is considered purposeful or goal directed.
Question
Thorndike believed that instrumental behaviors are purposeful and organized around goals.
Question
Tolman believed that instrumental behaviors are purposeful and organized around goals.
Question
Tolman's theory placed a heavy emphasis on the value of the outcome produced by an instrumental behavior.
Question
The habit system is more flexible than the action system.
Question
The action system adapts rapidly to changes in contingencies.
Question
The habit system adapts slowly to changes in contingencies.
Question
The habit system adapts rapidly to changes in contingencies.
Question
The habit system is sensitive to repetition.
Question
Actions are supported by expectancies whereas habits are supported by S-R connections.
Question
Reward devaluation will not influence the behavior if it is controlled by the action system.
Question
Reward devaluation will not influence the behavior if it is controlled by the habit system.
Question
Allowing the monkey to eat either all the peanuts or all the grapes it wants reduces the value of one of the rewards.
Question
Discrimination reversal tests are thought to measure flexibility.
Question
Rats with damage to the action system would adapt more rapidly to a discrimination reversal than normal rats.
Question
Rats with damage to the habit system would adapt more rapidly to a discrimination reversal than normal rats.
Question
Rats with damage to the habit system would adapt more rapidly to a discrimination reversal than rats with damage to the action system.
Question
Cocaine use and chronic stress could interfere with the action system, and this could result in the habit system controlling instrumental behaviors.
Question
Like the MTH system, the cortico-striatal system has return-loop organization.
Question
The striatum is a part of the basal ganglia.
Question
Rats with damage to the striatum performed as well as control rats in the adjacent-arm task.
Question
The prelimbic region is critical in the acquisition of the associations that support a habit.
Question
The dopamine reinforcement hypothesis relates dopamine to Thorndike's idea that rewards strengthen associative connections.
Question
What are the two categories of instrumental behavior?
Question
Describe the methodology behind the Thorndike puzzle box.
Question
Describe Thorndike's Law of Effect theory.
Question
What was the significance of Thorndike's test findings that escape latency gradually decreased as a function of trials?
Question
How does Tolman's cognitive expectancy system differ from Thorndike's view?
Question
Explain the term expectancy.
Question
What are the four differences between action and habit?
Question
Explain the term flexibility in the context of instrumental behavior.
Question
Why is the reward devaluation strategy used?
Question
How can one determine whether the correct response is an action supported by an expectancy or a habit supported by an S-R connection?
Question
How does the discrimination reversal learning strategy test the flexibility of the system that supports a particular instrumental behavior?
Question
In an experiment, rats that had limited training were sensitive to the value of the reward, making fewer lever-pressing responses than the control rats. What conclusions can you make?
Question
What is the experimental evidence that the action and habit systems initially compete for control of instrumental behaviors when the requirements of a situation are reversed?
Question
What are the components of the basal ganglia?
Question
What were the results in the adjacent-arm task?
Question
Which three brain regions have been linked to the action system?
Question
What is known about the role of the prelimbic prefrontal cortex in instrumental behavior?
Question
What two brain regions are critical to the acquisition and maintenance of habits?
Question
Consider this statement: The associations that support action-based behavior are still present even after the behavior becomes a habit. Do you agree? Why or why not?
Question
Which hypothesis provides an explanation for drug relapse?
Question
Which theory of instrumental behavior would be most consistent with the dopamine incentive salience hypothesis?
Question
Instrumental behavior is modified by the _______ it produces.
Question
The Law of Effect originated with _______.
Question
Behaviors supported by S-R connections are called _______.
Question
According to _______, the associations that make up an expectancy contain information about relationships between stimuli and relationships between behavior and stimulus outcomes.
Question
_______ are goal directed, purposeful, and motivated by an anticipated outcome; but _______ are not.
Question
The action system acquires _______.
Question
The habit system acquires _______.
Question
If the response is controlled by the _______ system, devaluing the outcome should reduce the likelihood that the response will occur.
Question
If the response is controlled by the _______ system, then reward devaluation will not influence the behavior.
Question
Allowing the monkey to eat either all the peanuts or all the grapes it wants _______ the value of one of the rewards.
Question
The discrimination reversal learning strategy tests the _______ of the system that supports a particular instrumental behavior.
Question
In the conceptual model of instrumental learning, the _______ system is located in level II.
Question
In the conceptual model of instrumental learning, the _______ system is located in level I.
Question
In the conceptual model of instrumental learning, performance of the instrumental response depends on the activation of the response representation in _______.
Question
According to the _______, with limited training, instrumental behaviors are goal directed actions; but with practice; instrumental behaviors tend to shift from actions to habits, meaning they become insensitive to reward devaluation.
Question
Cocaine selectively interferes with _______ in spines located on neurons in the region of the brain that supports the action system.
Question
Cocaine and chronic stress have been found to interfere with the _______ system.
Question
The _______ is at the center of what is sometimes called the cortico-striatal system.
Question
The striatum is the basic input segment of the _______.
Question
An important function of the striatum is to project back to the _______.
Question
Information processed by the striatum projects back to the motor cortex via the _______.
Question
Damage to the _______makes rats insensitive to reward devaluation.
Question
The _______ plays an important role in attaching value to outcomes.
Question
The prelimbic region is critical in the acquisition of the associations that support a(n) _______.
Question
Damage to the _______ can prevent a behavior from ever becoming a habit.
Question
The dopamine neurons are located in the _______, and their fibers project into the nucleus accumbens of the striatum.
Question
The dopamine neurons are located in the ventral tegmental area (VTA), and their fibers project into the _______ of the striatum.
Question
A region of the brain that provides dopamine to the striatum is the _______.
Question
The ventral tegmental area is part of the _______ system.
Question
Instrumental behaviors _______. (Select all that apply.)

A) produce change in the environment
B) can be modified by the consequence they produce
C) can occur with or without intention
D) can only occur with intention
E) None of the above
Question
According to Thorndike's Law of Effect, _______. (Select all that apply.)

A) the role of the reinforcer is to strengthen or weaken S-R connection
B) instrumental behavior is purposeful
C) rewards provide incentive for behavior
D) habits are mediated by expectancies
E) None of the above
Question
According Thorndike's Law of Effect, _______. (Select all that apply.)

A) animals acquire an expectancy
B) animals learn an S-R habit
C) the role of the reinforcer is to provide incentive for performance
D) reinforcers strengthen and weaken S-R connections
E) None of the above
Question
According to Tolman's cognitive theory, _______. (Select all that apply.)

A) animals acquire an expectancy
B) animals learn an S-R habit
C) the role of the reinforcer is to provide incentive for performance
D) the role of the reinforcer is to strengthen or weaken S-R connections
E) None of the above
Question
Which statement(s) is/are true? (Select all that apply.)

A) Tolman believed rewards strengthen S-R connections.
B) Tolman believed that outcomes provide incentives for behavior.
C) Thorndike believed that instrumental behaviors are goal directed.
D) Thorndike believed that instrumental behaviors were mediated by expectancies.
E) Tolman believed that instrumental behaviors are purposeful.
Unlock Deck
Sign up to unlock the cards in this deck!
Unlock Deck
Unlock Deck
1/89
auto play flashcards
Play
simple tutorial
Full screen (f)
exit full mode
Deck 19: Actions, Habits, and the Cortico-Striatal System
1
Instrumental behavior is modified by the outcome it produces.
True
2
According to Thorndike's Law of Effect, instrumental behavior should not be considered purposeful or goal directed.
True
3
According to Thorndike's Law of Effect, instrumental behavior is considered purposeful or goal directed.
False
4
Thorndike believed that instrumental behaviors are purposeful and organized around goals.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
5
Tolman believed that instrumental behaviors are purposeful and organized around goals.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
6
Tolman's theory placed a heavy emphasis on the value of the outcome produced by an instrumental behavior.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
7
The habit system is more flexible than the action system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
8
The action system adapts rapidly to changes in contingencies.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
9
The habit system adapts slowly to changes in contingencies.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
10
The habit system adapts rapidly to changes in contingencies.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
11
The habit system is sensitive to repetition.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
12
Actions are supported by expectancies whereas habits are supported by S-R connections.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
13
Reward devaluation will not influence the behavior if it is controlled by the action system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
14
Reward devaluation will not influence the behavior if it is controlled by the habit system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
15
Allowing the monkey to eat either all the peanuts or all the grapes it wants reduces the value of one of the rewards.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
16
Discrimination reversal tests are thought to measure flexibility.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
17
Rats with damage to the action system would adapt more rapidly to a discrimination reversal than normal rats.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
18
Rats with damage to the habit system would adapt more rapidly to a discrimination reversal than normal rats.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
19
Rats with damage to the habit system would adapt more rapidly to a discrimination reversal than rats with damage to the action system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
20
Cocaine use and chronic stress could interfere with the action system, and this could result in the habit system controlling instrumental behaviors.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
21
Like the MTH system, the cortico-striatal system has return-loop organization.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
22
The striatum is a part of the basal ganglia.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
23
Rats with damage to the striatum performed as well as control rats in the adjacent-arm task.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
24
The prelimbic region is critical in the acquisition of the associations that support a habit.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
25
The dopamine reinforcement hypothesis relates dopamine to Thorndike's idea that rewards strengthen associative connections.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
26
What are the two categories of instrumental behavior?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
27
Describe the methodology behind the Thorndike puzzle box.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
28
Describe Thorndike's Law of Effect theory.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
29
What was the significance of Thorndike's test findings that escape latency gradually decreased as a function of trials?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
30
How does Tolman's cognitive expectancy system differ from Thorndike's view?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
31
Explain the term expectancy.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
32
What are the four differences between action and habit?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
33
Explain the term flexibility in the context of instrumental behavior.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
34
Why is the reward devaluation strategy used?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
35
How can one determine whether the correct response is an action supported by an expectancy or a habit supported by an S-R connection?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
36
How does the discrimination reversal learning strategy test the flexibility of the system that supports a particular instrumental behavior?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
37
In an experiment, rats that had limited training were sensitive to the value of the reward, making fewer lever-pressing responses than the control rats. What conclusions can you make?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
38
What is the experimental evidence that the action and habit systems initially compete for control of instrumental behaviors when the requirements of a situation are reversed?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
39
What are the components of the basal ganglia?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
40
What were the results in the adjacent-arm task?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
41
Which three brain regions have been linked to the action system?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
42
What is known about the role of the prelimbic prefrontal cortex in instrumental behavior?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
43
What two brain regions are critical to the acquisition and maintenance of habits?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
44
Consider this statement: The associations that support action-based behavior are still present even after the behavior becomes a habit. Do you agree? Why or why not?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
45
Which hypothesis provides an explanation for drug relapse?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
46
Which theory of instrumental behavior would be most consistent with the dopamine incentive salience hypothesis?
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
47
Instrumental behavior is modified by the _______ it produces.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
48
The Law of Effect originated with _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
49
Behaviors supported by S-R connections are called _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
50
According to _______, the associations that make up an expectancy contain information about relationships between stimuli and relationships between behavior and stimulus outcomes.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
51
_______ are goal directed, purposeful, and motivated by an anticipated outcome; but _______ are not.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
52
The action system acquires _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
53
The habit system acquires _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
54
If the response is controlled by the _______ system, devaluing the outcome should reduce the likelihood that the response will occur.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
55
If the response is controlled by the _______ system, then reward devaluation will not influence the behavior.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
56
Allowing the monkey to eat either all the peanuts or all the grapes it wants _______ the value of one of the rewards.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
57
The discrimination reversal learning strategy tests the _______ of the system that supports a particular instrumental behavior.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
58
In the conceptual model of instrumental learning, the _______ system is located in level II.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
59
In the conceptual model of instrumental learning, the _______ system is located in level I.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
60
In the conceptual model of instrumental learning, performance of the instrumental response depends on the activation of the response representation in _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
61
According to the _______, with limited training, instrumental behaviors are goal directed actions; but with practice; instrumental behaviors tend to shift from actions to habits, meaning they become insensitive to reward devaluation.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
62
Cocaine selectively interferes with _______ in spines located on neurons in the region of the brain that supports the action system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
63
Cocaine and chronic stress have been found to interfere with the _______ system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
64
The _______ is at the center of what is sometimes called the cortico-striatal system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
65
The striatum is the basic input segment of the _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
66
An important function of the striatum is to project back to the _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
67
Information processed by the striatum projects back to the motor cortex via the _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
68
Damage to the _______makes rats insensitive to reward devaluation.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
69
The _______ plays an important role in attaching value to outcomes.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
70
The prelimbic region is critical in the acquisition of the associations that support a(n) _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
71
Damage to the _______ can prevent a behavior from ever becoming a habit.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
72
The dopamine neurons are located in the _______, and their fibers project into the nucleus accumbens of the striatum.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
73
The dopamine neurons are located in the ventral tegmental area (VTA), and their fibers project into the _______ of the striatum.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
74
A region of the brain that provides dopamine to the striatum is the _______.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
75
The ventral tegmental area is part of the _______ system.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
76
Instrumental behaviors _______. (Select all that apply.)

A) produce change in the environment
B) can be modified by the consequence they produce
C) can occur with or without intention
D) can only occur with intention
E) None of the above
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
77
According to Thorndike's Law of Effect, _______. (Select all that apply.)

A) the role of the reinforcer is to strengthen or weaken S-R connection
B) instrumental behavior is purposeful
C) rewards provide incentive for behavior
D) habits are mediated by expectancies
E) None of the above
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
78
According Thorndike's Law of Effect, _______. (Select all that apply.)

A) animals acquire an expectancy
B) animals learn an S-R habit
C) the role of the reinforcer is to provide incentive for performance
D) reinforcers strengthen and weaken S-R connections
E) None of the above
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
79
According to Tolman's cognitive theory, _______. (Select all that apply.)

A) animals acquire an expectancy
B) animals learn an S-R habit
C) the role of the reinforcer is to provide incentive for performance
D) the role of the reinforcer is to strengthen or weaken S-R connections
E) None of the above
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
80
Which statement(s) is/are true? (Select all that apply.)

A) Tolman believed rewards strengthen S-R connections.
B) Tolman believed that outcomes provide incentives for behavior.
C) Thorndike believed that instrumental behaviors are goal directed.
D) Thorndike believed that instrumental behaviors were mediated by expectancies.
E) Tolman believed that instrumental behaviors are purposeful.
Unlock Deck
Unlock for access to all 89 flashcards in this deck.
Unlock Deck
k this deck
locked card icon
Unlock Deck
Unlock for access to all 89 flashcards in this deck.