Despite the conserved function of aggression across taxa in obtaining critical resources such as food and mates, serotonin’s (5-HT) modulatory role on aggressive behavior appears to be largely inhibitory for vertebrates but stimulatory for invertebrates. However, critical gaps exist in our knowledge of invertebrates that need to be addressed before definitively stating opposing roles for 5-HT and aggression. Specifically, the role of 5-HT receptor subtypes are largely unknown, as is the potential interactive role of 5-HT with other neurochemical systems known to play a critical role in aggression. Similarly, the influence of these systems in driving sex differences in aggressive behavior of invertebrates is not well understood. Here, we investigated these questions by employing complementary approaches in a novel invertebrate model of aggression, the stalk-eyed fly. A combination of altered social conditions, pharmacological manipulation and 5-HT2receptor knockdown by siRNA revealed an inhibitory role of this receptor subtype on aggression. Additionally, we provide evidence for 5-HT2’s involvement in regulating neuropeptide F activity, a suspected inhibitor of aggression. However, this function appears to be stage-specific, altering only the initiation stage of aggressive conflicts. Alternatively, pharmacologically increasing systemic concentrations of 5-HT significantly elevated the expression of the neuropeptide tachykinin, which did not affect contest initiation but instead promoted escalation via production of high intensity aggressive behaviors. Notably, these effects were limited solely to males, with female aggression and neuropeptide expression remaining unaltered by any manipulation that affected 5-HT. Together, these results demonstrate a more nuanced role for 5-HT in modulating aggression in invertebrates, revealing an important interactive role with neuropeptides that is more reminiscent of vertebrates. The sex-differences described here also provide valuable insight into the evolutionary contexts of this complex behavior.
Significance Statement
Serotonin’s (5-HT) modulatory role in aggression is generally reported as inhibitory in vertebrates but stimulatory in invertebrates. Using a novel invertebrate model system, we provide evidence of common pathways of aggression at the 5-HT receptor subtype level as well as 5-HT’s interactive role with other neurochemical systems namely neuropeptide F and tachykinin. Additionally, we found that these effects were sex-dependent as well as stage-dependent affecting either the initiation or escalation stage of an aggressive contest. Our results reveal the impressive level of conservation with respect to neurochemical mechanisms among species as diverse as vertebrates and invertebrates, and highlights the need to consider multiple factors when determining potential taxonomic differences in how 5-HT mediates aggression.