KOPS - The Institutional Repository of the University of Konstanz

Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires

Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires

Cite This

Files in this item

Files Size Format View

There are no files associated with this item.

KERSHENBAUM, Arik, Vlad DEMARTSEV, David E. GAMMON, Eli GEFFEN, Morgan L. GUSTISON, Amiyaal ILANY, Adriano R. LAMEIRA, 2021. Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires. In: Methods in Ecology and Evolution. British Ecological Society. 12(3), pp. 553-564. ISSN 2041-2096. eISSN 2041-210X. Available under: doi: 10.1111/2041-210X.13536

@article{Kershenbaum2021Shann-52906, title={Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires}, year={2021}, doi={10.1111/2041-210X.13536}, number={3}, volume={12}, issn={2041-2096}, journal={Methods in Ecology and Evolution}, pages={553--564}, author={Kershenbaum, Arik and Demartsev, Vlad and Gammon, David E. and Geffen, Eli and Gustison, Morgan L. and Ilany, Amiyaal and Lameira, Adriano R.} }

Gammon, David E. Kershenbaum, Arik 2021-02-18T13:29:46Z Gammon, David E. eng Ilany, Amiyaal Ilany, Amiyaal Demartsev, Vlad Lameira, Adriano R. Lameira, Adriano R. Gustison, Morgan L. Shannon entropy as a robust estimator of Zipf's Law in animal vocal communication repertoires 1. Information complexity in animals is an indicator of advanced communication and an intricate socio‐ecology. Zipf's Law of least effort has been used to assess the potential information content of animal repertoires, including whether or not a particular animal communication could be ‘language‐like’. As all human languages follow Zipf's law, with a power law coefficient (PLC) close to −1, animal signals with similar probability distributions are postulated to possess similar information characteristics to language. However, estimation of the PLC from limited empirical datasets (e.g. most animal communication studies) is problematic because of biases from small sample sizes.<br />2. The traditional approach to estimating Zipf's law PLC is to find the slope of a log–log rank‐frequency plot. Our alternative option uses the underlying equivalence between Shannon entropy (i.e. whether successive elements of a sequence are unpredictable, or repetitive) and PLC. Here, we test whether an entropy approach yields more robust estimates of Zipf's law PLC than the traditional approach.<br />3. We examined the efficacy of the entropy approach in two ways. First, we estimated the PLC from synthetic datasets generated with a priori known power law probability distributions. This revealed that the estimated PLC using the traditional method is particularly inaccurate for highly stereotyped sequences, even at modest repertoire sizes. Estimation via Shannon entropy is accurate with modest sample sizes even for repertoires with thousands of distinct elements. Second, we applied these approaches to empirical data taken from 11 animal species. Shannon entropy produced a more robust estimate of PLC with lower variance than the traditional method, even when the true PLC is unknown. Our approach for the first time reveals Zipf's law operating in the vocal systems of multiple lineages: songbirds, hyraxes and cetaceans.<br />4. As different methods of estimating the PLC can lead to misleading results in real data, estimating the balance of a communication system between simplicity and complexity is best performed using the entropy approach. This provides a more robust way to investigate the evolutionary constraints and processes that have acted on animal communication systems, and the parallels between these processes and the evolution of language. Kershenbaum, Arik terms-of-use 2021 Geffen, Eli Demartsev, Vlad Geffen, Eli Gustison, Morgan L. 2021-02-18T13:29:46Z

This item appears in the following Collection(s)

Search KOPS


Browse

My Account