- Poster presentation
- Open Access
Sunk costs account for rats’ decisions on an intertemporal foraging task
© Wikenheiser and Redish; licensee BioMed Central Ltd. 2012
- Published: 16 July 2012
- Model Subject
- Reward Rate
- Future Gain
- Session Type
- Temporal Horizon
Decision makers commit the sunk cost fallacy when they are influenced by previous investments instead of estimated future returns . As resources previously allocated toward an outcome are irrecoverable, adaptive choices should be based only on the future benefits that could result from available options. Humans clearly show sensitivity to sunk costs in a wide range of situations ; however, there is at best mixed evidence that other species are affected by sunk costs, leading to the suggestion that sunk cost sensitivity depends on complicated cognitive/meta-cognitive mechanisms unlikely to be present in non-human animals .
We tested the extent to which rats are influenced by previous investment and expected future gains in a naturalistic foraging context. Rats foraged for food on a circular path outfitted with three equidistant feeder sites. Each feeder was associated with a delay that remained fixed within a session. Six sets of delays were chosen to create six session types, across which the opportunity cost of time  varied. Upon approaching a feeder, subjects made a stay/go decision; if they remained until the delay expired, food pellets were dispensed. Otherwise, they were free to proceed to the next site.
We computed the optimal strategy for each session type following the prey selection model of foraging theory . Each feeder location was modeled as a prey type with a handling time equal to its delay. Given these parameters, we found that the rate-maximizing strategy in all session types was to wait for food at only the shortest-delayed site. Our subjects did not employ this strategy. Instead, rats nearly always accepted both short and medium length delays, and often waited for even the longest delay.
We tested several possible explanations for rats’ behavior on this task, including satisficing , operant matching  and integration over shorter temporal horizons. We also ran a reinforcement learning  model of the task over a range of discounting rates and action selection parameters. None of these matched the observed behavior.
The sunk cost effect predicts that as investment in a option increases, willingness to abandon that option decreases. Running between feeder locations entails an energetic investment that could bias subjects towards waiting out long delays despite the resulting decrease in reward rate. We fit an aversion parameter A to model subjects’ reluctance to skip feeder sites. Subjects’ unwillingness to abandon sites varied across session types, indicating energetic expenditure (which is equal across sessions) cannot fully account for their suboptimal behavior. Interestingly, we found that A correlated positively with opportunity cost. These data suggest that rats’ decisions are influenced by sunk costs, and that the investment they track likely incorporates both energetic costs and the reinforcement statistics of the environment.
- Arkes HR, Blumer C: The psychology of sunk cost. Organ Behav Hum Dec. 1985, 35: 124-140. 10.1016/0749-5978(85)90049-4.View ArticleGoogle Scholar
- Arkes HR, Ayton P: The sunk cost and concorde effects: are humans less rational than lower animals?. Psych Bull. 1999, 5: 591-600.View ArticleGoogle Scholar
- Niv Y, Daw ND, Joel D, Dayan P: Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology. 2007, 3: 507-520.View ArticleGoogle Scholar
- Stephens DW, Krebs JR: Foraging Theory. 1986, Princeton: Princeton University PressGoogle Scholar
- Simon H: Rationality as process and as product of thought. Am Econ Rev. 1978, 68 (2): 1-16.Google Scholar
- Herrnstein RJ: Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav. 1961, 4: 267-272. 10.1901/jeab.1961.4-267.PubMed CentralView ArticlePubMedGoogle Scholar
- Sutton RS, Barto AG: Reinforcement learning: an introduction. 1998, Cambridge: MIT PressGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.