Skip to main content
Journal of the Experimental Analysis of Behavior logoLink to Journal of the Experimental Analysis of Behavior
. 1996 Jul;66(1):29–49. doi: 10.1901/jeab.1996.66-29

Token reinforcement, choice, and self-control in pigeons.

K Jackson 1, T D Hackenberg 1
PMCID: PMC1284552  PMID: 8755699

Abstract

Pigeons were exposed to self-control procedures that involved illumination of light-emitting diodes (LEDs) as a form of token reinforcement. In a discrete-trials arrangement, subjects chose between one and three LEDs; each LED was exchangeable for 2-s access to food during distinct posttrial exchange periods. In Experiment 1, subjects generally preferred the immediate presentation of a single LED over the delayed presentation of three LEDs, but differences in the delay to the exchange period between the two options prevented a clear assessment of the relative influence of LED delay and exchange-period delay as determinants of choice. In Experiment 2, in which delays to the exchange period from either alternative were equal in most conditions, all subjects preferred the delayed three LEDs more often than in Experiment-1. In Experiment 3, subjects preferred the option that resulted in a greater amount of food more often if the choices also produced LEDs than if they did not. In Experiment 4, preference for the delayed three LEDs was obtained when delays to the exchange period were equal, but reversed in favor of an immediate single LED when the latter choice also resulted in quicker access to exchange periods. The overall pattern of results suggests that (a) delay to the exchange period is a more critical determinant of choice than is delay to token presentation; (b) tokens may function as conditioned reinforcers, although their discriminative properties may be responsible for the self-control that occurs under token reinforcer arrangements; and (c) previously reported differences in the self-control choices of humans and pigeons may have resulted at least in part from the procedural conventions of using token reinforcers with human subjects and food reinforcers with pigeon subjects.

Full Text

The Full Text of this article is available as a PDF (300.4 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Ainslie G. W. Impulse control in pigeons. J Exp Anal Behav. 1974 May;21(3):485–489. doi: 10.1901/jeab.1974.21-485. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Belke T. W., Pierce W. D., Powell R. A. Determinants of choice for pigeons and humans on concurrent-chains schedules of reinforcement. J Exp Anal Behav. 1989 Sep;52(2):97–109. doi: 10.1901/jeab.1989.52-97. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Chung S. H., Herrnstein R. J. Choice and delay of reinforcement. J Exp Anal Behav. 1967 Jan;10(1):67–74. doi: 10.1901/jeab.1967.10-67. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Fantino E. Editorial. J Exp Anal Behav. 1988 Jan;49(1):1–2. doi: 10.1901/jeab.1988.49-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Flora S. R., Pavlik W. B. Human self-control and the density of reinforcement. J Exp Anal Behav. 1992 Mar;57(2):201–208. doi: 10.1901/jeab.1992.57-201. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Green L., Price P. C., Hamburger M. E. Prisoner's dilemma and the pigeon: Control by immediate consequences. J Exp Anal Behav. 1995 Jul;64(1):1–17. doi: 10.1901/jeab.1995.64-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Horne P. J., Lowe C. F. Determinants of human performance on concurrent schedules. J Exp Anal Behav. 1993 Jan;59(1):29–60. doi: 10.1901/jeab.1993.59-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Hyten C., Madden G. J., Field D. P. Exchange delays and impulsive choice in adult humans. J Exp Anal Behav. 1994 Sep;62(2):225–233. doi: 10.1901/jeab.1994.62-225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Kelleher R. T. Fixed-ratio schedules of conditioned reinforcement with chimpanzees. J Exp Anal Behav. 1958 Aug;1(3):281–289. doi: 10.1901/jeab.1958.1-281. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Logue A. W., King G. R. Self-control and impulsiveness in adult humans when food is the reinforcer. Appetite. 1991 Oct;17(2):105–120. doi: 10.1016/0195-6663(91)90066-2. [DOI] [PubMed] [Google Scholar]
  11. Logue A. W., Peña-Correal T. E., Rodriguez M. L., Kabela E. Self-control in adult humans: variation in positive reinforcer amount and delay. J Exp Anal Behav. 1986 Sep;46(2):159–173. doi: 10.1901/jeab.1986.46-159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Logue A. W., Rodriguez M. L., Peña-Correal T. E., Mauro B. C. Choice in a self-control paradigm: Quantification of experience-based differences. J Exp Anal Behav. 1984 Jan;41(1):53–67. doi: 10.1901/jeab.1984.41-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Malagodi E. F. Acquistion of the token-reward habit in the rat. Psychol Rep. 1967 Jun;20(3 Suppl):1335–1342. doi: 10.2466/pr0.1967.20.3c.1335. [DOI] [PubMed] [Google Scholar]
  14. Malagodi E. F., Webbe F. M., Waddell T. R. Second-order schedules of token reinforcement: effects of varying the schedule of food presentation. J Exp Anal Behav. 1975 Sep;24(2):173–181. doi: 10.1901/jeab.1975.24-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Mazur J. E., Logue A. W. Choice in a "self-control" paradigm: effects of a fading procedure. J Exp Anal Behav. 1978 Jul;30(1):11–17. doi: 10.1901/jeab.1978.30-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Mischel W. Theory and research on the antecedents of self-imposed delay of reward. Prog Exp Pers Res. 1966;3:85–132. [PubMed] [Google Scholar]
  17. Rachlin H., Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972 Jan;17(1):15–22. doi: 10.1901/jeab.1972.17-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Rachlin H., Raineri A., Cross D. Subjective probability and delay. J Exp Anal Behav. 1991 Mar;55(2):233–244. doi: 10.1901/jeab.1991.55-233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Rodriguez M. L., Logue A. W. Adjusting delay to reinforcement: comparing choice in pigeons and humans. J Exp Psychol Anim Behav Process. 1988 Jan;14(1):105–117. [PubMed] [Google Scholar]
  20. Sonuga-Barke E. J., Lea S. E., Webley P. The development of adaptive choice in a self-control paradigm. J Exp Anal Behav. 1989 Jan;51(1):77–85. doi: 10.1901/jeab.1989.51-77. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Webbe F. M., Malagodi E. F. Second-order schedules of token reinforcement: comparisons of performance under fixed-ratio and variable-ratio exchange schedules. J Exp Anal Behav. 1978 Sep;30(2):219–224. doi: 10.1901/jeab.1978.30-219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Zeiler M. D. To wait or to respond? J Exp Anal Behav. 1993 May;59(3):433–444. doi: 10.1901/jeab.1993.59-433. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the Experimental Analysis of Behavior are provided here courtesy of Society for the Experimental Analysis of Behavior

RESOURCES