Abstract
Surveys of insect societies have revealed four key, recurring organizational trends: (i) The most elaborated cooperation occurs in groups of relatives. (ii) Cooperation is typically more elaborate in species with large colony sizes than in species with small colony sizes, the latter exhibiting greater internal reproductive conflict and lesser morphological and behavioral specialization. (iii) Within a species, per capita brood output typically declines as colony size increases. (iv). The ecological factors of resource patchiness and intergroup competition are associated with the most elaborated cooperation. Predictions of all four patterns emerge elegantly from a game-theoretic model in which within-group tug-of-wars are nested within a between-group tug-of-war. In this individual selection model, individuals are faced with the problem of how to partition their energy between investment in intercolony competition versus investment in intracolony competition, i.e., internal tugs-of-war over shares of the resources gained through intergroup competition. An individual's evolutionarily stable investment in between-group competition (i.e., within-group cooperation) versus within-group competition is shown to increase as within-group relatedness increases, to decrease as group size increases (for a fixed number of competing groups), to increase as the number of competing groups in a patch increases, and to decrease as between-group relatedness increases. Moreover, if increasing patch richness increases both the number of individuals within a group and the number of competing groups, greater overall cooperation within larger groups will be observed. The model presents a simple way of determining quantitatively how intergroup conflict will propel a society forward along a “superorganism continuum.”
Keywords: conflict, cooperation, group selection, tug-of-war, social insects
It has recently been argued that the extreme levels of cooperation exhibited by the advanced eusocial insects ultimately must be explained by invoking the “binding” force of intergroup competition rather than by appealing to genetic relatedness, which only amplifies ecologically driven selective forces for cooperation without causing them (1). According to the latter view, group selection must be invoked to understand cooperation in insects (ref. 1 and E. O. Wilson, personal communication). However, it is easy to construct a general, purely individual selection model of cooperation mediated by between-group competition (2). This is not surprising, as it is now well established that trait-group selection models can be mathematically translated into individual selection models (including inclusive fitness models), and vice versa, so the two classes of models cannot be considered alternatives to each other (3, 4).
The truly interesting problem is to determine (with either inclusive fitness or equivalent trait-group selection models) how intergroup competition can increase the extent to which social groups can be viewed as coherent vehicles for gene propagation, i.e., “superorganisms”. We present an individual selection model that incorporates intergroup competition and appears to explain all of the major trends in insect societies. A survey of insect societies reveals at least four key, recurring organizational trends: (i) The most elaborated cooperation, i.e., the highest levels of altruism (with most group members foregoing direct reproduction) and most intricately cooperative communication systems, clearly occur in groups of relatives (5, 6). (ii) Cooperation is typically more elaborate in species with large colony sizes than in species with small colony sizes, the latter being characterized by greater internal reproductive conflict [manifested in dominance hierarchies as in small polistine, ponerine, and leptothoracine societies (7–14)] and lesser morphological and behavioral specialization (12, 13, 15, 16). (iii) Within species exhibiting small to medium-sized colonies, per capita brood output often tends to decline as colony size (number of queens plus workers) increases (16, 17). (iv) Intergroup competition facilitated by the ecological factor of resource patchiness appears to be associated with the most elaborated within-group cooperation (1, 9). A promising framework for constructing a model that potentially accommodates all of the above comparative patterns is “tug-of-war” theory (18).
Tug-of-war theory has been used to understand evolutionarily stable reproductive partitioning when dominants have incomplete control over subordinates, and group members have such limited outside reproductive options that they will not receive reproductive payments to remain in the group (19). In a tug-of-war, each group member selfishly expends some fraction of the total group output to increase its share of that output. The selfish fraction expended is called the “selfish investment” or “selfish effort.” Each group member's share depends on the magnitude of its selfish investment relative to the magnitude of other group members' selfish investments, just as the outcome of a real tug-of-war depends on the relative magnitudes of the forces generated at the two ends of the rope. Thus, an individual's share in the tug-of-war depends on the individual's investment in the tug-of-war relative to the summed investments of the other group members (18). Using game theory, one solves for the jointly optimal values of these selfish investments in the tug-of-war (18), i.e., for the selfish efforts that jointly maximize the group members' inclusive fitnesses. The tug-of-war encompasses the phenomenon of “mutual policing,” in which group members act to increase their own share of reproduction and at the same time limit that of others (20). Game-theoretic models of evolutionarily stable policing efforts and also the evolutionarily stable resistance to policing are necessary for adequate understanding of policing evolution, which is thought to play a key role in the evolution of many animal societies (21).
We explore the theoretical consequences of a two-tiered, but interlocking, competitive tug-of-war incorporating intergroup competition. First, a tug-of-war over resource share occurs within groups, whose members are related by r, and, second, a tug-of war over the amount of resource obtained by a group occurs between groups, which are related to each other by r′ (Fig. 1). The two competitive tug-of-wars are interlocking because a group's ability to outcompete other groups declines the more total energy its group members expend in the within-group tug-of-war. For example, the group's competitive ability increases as the individual invests more time and energy in cooperative foraging, brood care, nest defense, and between-group interference competition; in contrast, the individual's share of resources won increases if it instead invests its time and energy in resource hoarding and aggressive competition with fellow group members over the resources won in intergroup competition. We show that the four major organizational attributes of insect societies (and possibly those of many vertebrate societies) emerge naturally as predictions of this simple “nested” tug-of-war model.
Fig. 1.
The nested tug-of-war. Individuals engage in a selfish tug-of-war over resource shares within groups, and, simultaneously, groups engage in a tug-of-war with each other. The within-group tug-of-war reduces a group's ability to win the between-group tug-of-war.
Suppose that there are n individuals in a cooperative group and that N cooperative groups are competing for a resource of total value R. Each individual is faced with the following decision: Of a private prior energy store t, what fraction f of this private store should be invested in a selfish tug-of-war over resource share within the group, with the remaining fraction 1 − f being used to increase group competitiveness? For example, the private store could be an energy store, a fraction of which (1 − f) will be allocated to performing tasks that help its group outcompete neighboring groups for a limiting resource, and the remaining fraction (f) of which will be devoted to selfishly enhancing the individual's share of the resource won by its group. We refer to f as simply the “selfish fraction.”
We now use f to represent the selfish fraction for a rare mutant in a population, and we let f* represent the population value of this selfish fraction. The mutant's selfish investment in within-group competition is x = ft and in between-group competition is (1 − f)t, with x* and (1 − f*)t representing the corresponding population values of these investments. Thus, the mutant's within-group fraction of whatever resource is won in between-group competition is equal to
![]() |
accounting for the fact that a fraction r of the individual's fellow group members will also display its own mutant value of the competitive investment because of shared kinship.
The competitiveness of this group is equal to the sum of all individuals' investments in the group competitiveness, multiplied by some constant g. We assume a linear group competitiveness function for simplicity and to show how diminishing per capita final group output with increasing group size emerges despite such a linear combination of the individual investments. The mutant's group thus has an overall group-level competitiveness equal to
![]() |
A group not containing the mutant has a competitiveness equal to
![]() |
A group's competitiveness determines that group's share of the contested resource of total value r that results from the between-group tug-of-war. In particular, the mutant's group share of the resource is equal to
![]() |
where r′ is the relatedness between groups, i.e., the fraction of groups that have a genetic composition like the mutant's own group, with respect to the locus of interest. (To see the latter, suppose that the mutant is related to other group members by r. In such a case, a fraction r of group members will have the relevant allele when it is rare. If the mutant had the same relatedness to a competing group, the latter group also would have a fraction r of group members possessing the allele. If only a fraction q of competing groups were as closely related to the mutant as members of its own group, then r′ = qr.)
Thus, the mutant's overall amount of resource obtained W, after both within-group and between-group competition, is equal to
![]() |
We assume that W is positively correlated to the mutant's fitness [because this fitness is modulated by interactions with relatives, it is Hamiltonian “neighbor-modulated fitness” and thus the model is equivalent to a generalized inclusive fitness model (5)].
The mutant's evolutionary stable fractional selfish investment in increasing its within-group share is found by solving
![]() |
in terms of f *. This equation mathematically expresses the condition that the evolutionarily stable investment should be the one yielding the highest fitness in a population of individuals exhibiting that same investment; thus, no alternative mutant strategy can invade the population (22). The solution, which corresponds to a maximum in neighbor-modulated individual fitness, is equal to
![]() |
(That the latter is a fitness maximum is verified by ∂2w/∂f2 < 0 at f = f *.) As the number of group members becomes larger, f * rapidly converges to N(1 − r)/[N − r − rr′(N − 1)]. If groups are large and there are many competing groups, f* converges to just (1 − r)/(1 − rr′). If there are no competing groups (n = 1), f is just 1. [Note that in this mathematical model, f can be interpreted either as the proportion of energy that each individual invests in intracolony conflict or as the proportion of individuals that will devote all (versus none) of their energy to intracolony conflict. On the latter interpretation, the proportion of individuals devoting all their energy to within-colony cooperation, and none to personal reproduction, will be 1 − f*, and thus the reproductive skew will increase as f* decreases. However, we focus in this paper on the implications of the model for the average level of cooperation regardless of which skew-related interpretation is taken.]
As can be verified by checking the derivatives of f* with respect to each of the contained variables, the individual's fractional effort in selfish within-group competition increases as its group size n increases, as the number of competing groups N decreases, as within-group relatedness r decreases, and as the between-group relatedness r′ increases (Fig. 2). In other words, intragroup cooperation will increase as (i) the group size decreases, (ii) the number of competing groups increases, (iii) the within-group relatedness increases, and (iv) the between-group relatedness decreases (all other variables held constant in each of these analyses). These relationships are numerically presented in Fig. 2. We note that the model encompasses both intraspecific and interspecfiic competition; in interspecific competition, the value of the between-group relatedness is just r′ = 0.
Fig. 2.
Fractional investment in group competitiveness. (Upper) Individual's evolutionarily stable investment in group competitiveness (equals the degree of superorganismness) as a function of between group relatedness (r′) and within-group relatedness (r) (n = 100; n = 4; z = w). (Lower) Individual's evolutionarily stable investment in group competitiveness as a function of group size (n) and number of competing groups (N) (r′ = 0; r = 1/2; z = w).
The nested tug-of-war model can be generalized to encompass variable intensities of competition in the following way. We assumed that an individual investing, say, twice as much as another group member in the within-group tug-of-war will receive twice as much resource as will that other group member. But suppose an individual investing an amount h versus another who invests j gets hw/jw as much resource, where w measures the intensity of competition. If w = 0, the two individuals get the same amount of resource no matter how each invests. If w is infinite, then the individual investing even slightly less gets essentially no resource. Thus, to incorporate variable within-group competition intensity, we can modify Eq. 1 to become
![]() |
and we can allow for variable between-group competition intensity by modifying Eq. 4 to become
![]() |
where z is the between-group competition intensity. With these generalizations, the new evolutionarily stable selfish effort becomes just
![]() |
The important prediction that emerges is that the selfish effort declines as within-group competition intensity decreases relative to between-group competition intensity. In fact, if within-group competition intensity is very small relative to that between groups, the individual is favored to invest virtually all of its effort in between-group competition, regardless of the relatedness among group members (i.e., f → 0 as w/z → 0).
In advanced eusocial colonies, f appears to be close to zero. In such advanced social organizations, the colony effectively becomes the target of selection, i.e., it is a coherent “extended phenotype” (23) of the genes within colony members. Selection therefore optimizes caste demography, patterns of division of labor (15), and communication systems at the colony level (9). For example, colonies that employ the most effective recruitment system to retrieve food, or that exhibit the most powerful colony defense against enemies and predators, will be able to raise the largest number of reproductive females and males every year and, thus, will have the greatest fitness within the population of colonies (24).
Thus, a striking characterization of f* is that it precisely measures a society's position along a “superorganism continuum.” At one extreme, f* = 1, group members invest all of their energy in within-group competition, and there is really no cooperative group at all. At the other extreme, f* = 0, group members invest all of their energy in within-group cooperation to outcompete other groups, and the society can be regarded as a “superorganism,” an analogy to a metazoan organism. For values in between these two extremes, the society can be viewed as having both selfish and superorganismal features.
Discussion
Our model predicts an individual's evolutionarily stable, fractional investment in between-group competition (equal to within-group cooperation) versus within-group competition, the latter undermining its success in between-group competition. This cooperative investment, 1 − f*, and thus the degree of group “superorganismness,” increases as within-group relatedness increases, decreases as group size increases (number of competing groups held constant), increases as the number of competing groups in a patch increases, decreases as between-group relatedness increases, and increases as the intensity of between-group competition increases relative to the intensity of within-group competition.
The latter predictions bear directly on the four organizational attributes of insect societies, which we discuss in turn:
(i) The most elaborated cooperation, i.e., the highest levels of altruism and most intricately cooperative communication systems, will tend to occur in groups of relatives. As predicted by our model, the selfish investment declines, and investment in the group increases, as within-group relatedness increases. Thus, within-group genetic relatedness powerfully modulates the degree of cooperation, as is observed in nature, contrary to claims that genetic relatedness is a secondary (or even unimportant) booster of cooperation in insect societies. We assumed a uniform and symmetrical relatedness r among group members. If group members are full-sibling offspring of the dominant breeder, and the sex ratio is equal or males are as genetically valuable as females, tug-of-war theory predicts that there will be no selfish investment at all in the within-group tug-of-war, regardless of the intensity of between-group competition (18). In this case, which encompasses many eusocial societies, the r is effectively 1.0, because siblings are, on average, as valuable as offspring (25). Likewise, in our model, a within-group relatedness of 1 leads to f * = 0. Multiple mating by queens, multiple queens, and intercolony mixing will, in effect, lower the average r within such groups, leading to increasing selfish fraction f* in our model. Thus, increasing genetic heterogeneity will tend the lower the degree of group superorganismness, in accordance with the view that variation in relatedness within groups has a “dissolutive” effect in reducing group reproductive harmony (1). However, a large number of competing groups and/or a strong intensity of between-group competition can overcome low levels of relatedness to yield a society that scores high on the superorganism continuum.
Although our model predicts that relatedness predisposes within-group cooperation, it does not predict that relatedness is necessary for high levels of within-group cooperation. It follows from Eq. 7 that if within-group and between-group relatedness are both 0, the investment in within-group cooperation 1 − f* becomes (N − 1)/(Nn − 1), which will be >0 as long as there is some intergroup competition (n > 1). For example, if the number of competing groups is large and z = w, then the within-group investment in cooperation becomes 1/n. Intriguingly, this may compactly explain why 1 of n unrelated foundresses in desert ant (Acromyrmex versicolor) foundress associations becomes an altruistic forager in the face of raiding threats from many surrounding colonies (26). Alternatively, if the intensity of between-group competition is much greater than that of within-group competition (z ≫ w), as when resources are distributed in locally rich, but sparse, patches, then the within-group cooperation approaches 1.0 regardless of relatedness. The latter result has the potential to explain cooperation among nonrelatives in human societies and may even be relevant to unraveling the mystery of unicolonial ant populations, in which nearly unrelated workers in multiple nests of a “supercolony” living in a saturated habitat appear to frequently tolerate and even cooperate with each other (27).
(ii) Cooperation is typically more elaborate in species with large colony sizes than in species with small colony sizes, the latter being characterized by greater internal reproductive conflict and lesser morphological and behavioral specialization. This attribute may seem to contradict the prediction that cooperation will decline as group size n increases, number of competing groups held constant (which directly explains attribute iii, as discussed below). However, in between-species comparisons, colony size and number of competing groups are likely to be confounded. That is, attribute ii is predicted if larger colonies also tend to be in competition with a larger number of colonies: Suppose that insect colonies occur within resource patches in patchy environments, as supported by evidence that sociality commonly arises in association with resource patchiness (9). The greater the richness of the patch, the greater is expected to be both the number of colonies per patch (N) and the number of individuals per colony (n). For example, suppose that N = aR and n = bR, where R is the resource patch richness, and a and b are constants. That is, suppose that the number of colonies and the number of individuals per colony both increase linearly as the patch richness increases. How does f* change as patch richness R, and thus colony size, increases? The derivative df*/dR is negative if r > [1 + n(N − 2)]/(n − 1)2, which is essentially just the permissive condition r > 0 if group size n is much larger than the number of directly competing groups N, which seems very likely to be the usual case.
Thus, as patch richness increases, both colony size increases and the number of competing colonies increases, with the net result that the degree of cooperation increases (f* decreases), because f* is more sensitive to the number of competing groups than it is to group size for medium to large groups. In other words, species that typically inhabit richer patches will typically have larger colonies and also greater cooperation, as is observed. Greater cooperation in large colonies may also be reflected by the enhanced work tempo of workers in larger colonies (15, 16, 28), on the assumption that worker inactivity reflects enhanced selfishness (e.g., unwillingness to assume the costs of foraging chores).
(iii) Within a species, per capita group output typically declines as colony size increases (number of competing colonies fixed). As f* increases, the per capita colony output decreases. This occurs because larger group size means that individuals can increasingly parasitize the cooperative efforts of other group members, a common feature of many multiperson cooperative games. Because f* increases as colony size increases (values of other variables held constant), the nested tug-of-war correctly therefore predicts that within-species comparisons will tend to show a negative correlation between per capita group output and group size. The result is predicted to hold only if patch size and the number of competing groups are controlled in the analysis, which will usually be the case for within-species comparisons if the analysis is carried out on conspecific colonies from the same site.
(iv) Intergroup competition facilitated by ecological factors of resource patchiness is associated with the most elaborated cooperation. The nested tug-of-war model predicts that cooperation increases (f* decreases) as the number of competing groups (and between-group competition intensity) increase, because greater cooperation increases group competitiveness and a greater number of competing groups increases the pressure of between-group competition. Thus, the model predicts the fourth organizational principle of insect societies.
The utility of the nested tug-of-war model may not be restricted to social insects, but also may elucidate cooperation whenever competition is structured within and between groups, as, for example, is certainly the case in humans. Future tests of the model should focus on experimental manipulation of N, n, z, w, r, and r′ with subsequent observation in the frequency and intensity of within-group conflict. Particularly intriguing is the prediction that within-group cooperation will decline as between-group relatedness increases. For example, the model predicts that within-group cooperation should be more elaborated in species with long-distance dispersal of reproductives than in species with limited dispersal of reproductives, because the latter will more often be competing with rival groups that are related. Moreover, the model predicts that interspecific competition will more effectively promote superorganismness (low f*) than will intraspecific competition, because r′ must be 0 in the latter case.
When ecological and genetic factors advance a society to near the upper extreme of the superorganism continuum, subsequent selection may result in complete loss of costly physiological structures involved in within-group competition. Thus, our model specifies the conditions leading to a “point of no return” in eusocial evolution, i.e., a point at which the capacity for selfishness has become insignificant because the underlying organs (e.g., ovaries and spermatheca) important for within-group competition degenerate or become completely lost (1). Once such organs become obsolete through progressive selective elimination, they are unlikely to be restored in a single mutational step. Thus, our model makes the testable prediction that worker sterility should have been most likely to evolve when intergroup competition was most intense and/or relatedness was exceptionally high.
This model underlines the crucial role of intergroup competition in forcing within-group cooperation (1). It is probably also a potentially useful model for explaining the evolution of human cooperation, and of cooperation among genes within a genome and among cells within multicellular organisms.
Acknowledgments
We thank Jessie Barker, Michelle Cilia, Lee Dugatkin, Tom Seeley, Sheng-Feng Shen, David S. Wilson, and Ed Wilson for comments on an earlier draft of this manuscript. This work was supported by the Andrew D. White Professorship program of Cornell University, the Arizona State University Foundation, and the German Science Foundation (SFB 551).
Footnotes
The authors declare no conflict of interest.
References
- 1.Wilson EO, Hölldobler B. Proc Natl Acad Sci USA. 2005;102:13367–13371. doi: 10.1073/pnas.0505858102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Traulsen A, Nowak M. Proc Natl Acad Sci USA. 2006;103:10952–10955. doi: 10.1073/pnas.0602530103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Dugatkin L, Reeve HK. Adv Study Behav. 1994;23:101–133. [Google Scholar]
- 4.Reeve HK. Evol Hum Behav. 2000;21:65–72. [Google Scholar]
- 5.Hamilton WD. J Theor Biol. 1964;7:1–52. doi: 10.1016/0022-5193(64)90038-4. [DOI] [PubMed] [Google Scholar]
- 6.Hamilton WD. Ann Rev Ecol Sys. 1972;3:193–232. [Google Scholar]
- 7.West Eberhard MJ. In: Natural Selection and Social Behavior. Alexander RD, Tinkle DW, editors. New York: Chiron; 1981. pp. 3–17. [Google Scholar]
- 8.Reeve HK. In: The Social Biology of Wasps. Ross K, editor. Ithaca, NY: Cornell Univ Press; 1991. pp. 99–148. [Google Scholar]
- 9.Hölldobler B, Wilson EO. The Ants. Cambridge, MA: Harvard Univ Press; 1990. [Google Scholar]
- 10.Heinze J, Hölldobler B, Peeters C. Naturwissenschaften. 1994;81:489–497. [Google Scholar]
- 11.Premath S, Sinah A, Gadagkar R. Behav Ecol Sociobiol. 1996;39:125–132. [Google Scholar]
- 12.Peeters C. In: The Evolution of Social Behavior in Insects and Arachnids. Choe JC, Crespi BJ, editors. New York: Cambridge Univ Press; 1997. pp. 372–391. [Google Scholar]
- 13.Bourke AFG. J Evol Biol. 1999;12:245–257. [Google Scholar]
- 14.Heinze J. Adv Study Behav. 2004;34:1–55. [Google Scholar]
- 15.Oster GF, Wilson EO. Caste and Ecology in the Social Insects. Princeton: Princeton Univ Press; 1978. [PubMed] [Google Scholar]
- 16.Karsai I, Wenzel JW. Proc Natl Acad Sci USA. 1998;95:8665–8669. doi: 10.1073/pnas.95.15.8665. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Michener CD. Ins Soc. 1964;11:317–341. [Google Scholar]
- 18.Reeve HK, Emlen ST, Keller L. Behav Ecol. 1998;9:267–278. doi: 10.1016/s0169-5347(98)01450-5. [DOI] [PubMed] [Google Scholar]
- 19.Reeve HK, Shen S-F. Proc Natl Acad Sci USA. 2006;103:8429–8433. [Google Scholar]
- 20.Frank SA. Nature. 1995;377:520–522. doi: 10.1038/377520a0. [DOI] [PubMed] [Google Scholar]
- 21.Wenseleers T, Ratnieks FLW. Nature. 2006;444:50. doi: 10.1038/444050a. [DOI] [PubMed] [Google Scholar]
- 22.Maynard Smith J. Evolution and the Theory of Games. Cambridge, UK: Cambridge Univ Press; 1982. [Google Scholar]
- 23.Dawkins R. The Extended Phenotype. Oxford: Freeman; 1982. [Google Scholar]
- 24.Hölldobler B. J Comp Physiol A. 1999;184:129–141. [Google Scholar]
- 25.Stubblefield JW, Charnov EL. Heredity. 1986;57:181–187. doi: 10.1038/hdy.1986.108. [DOI] [PubMed] [Google Scholar]
- 26.Rissing SW, Pollock GB, Higgins MR, Hagen RH, Smith DR. Nature. 1989;338:420, 422. [Google Scholar]
- 27.van der Hammen T, Pederson JS, Boomsma JJ. Heredity. 2002;89:83–89. doi: 10.1038/sj.hdy.6800098. [DOI] [PubMed] [Google Scholar]
- 28.Anderson C, McShea DW. Biol Rev Cambridge Philos Soc. 2001;76:211–237. doi: 10.1017/s1464793101005656. [DOI] [PubMed] [Google Scholar]