KOPS - The Institutional Repository of the University of Konstanz

Permutation tests for hypothesis testing with animal social network data : Problems and potential solutions

Permutation tests for hypothesis testing with animal social network data : Problems and potential solutions

Cite This

Files in this item

Checksum: MD5:24ff6e5ca0ca5b3b82eb373c38fdb238

FARINE, Damien R., Gerald G. CARTER, 2022. Permutation tests for hypothesis testing with animal social network data : Problems and potential solutions. In: Methods in Ecology and Evolution. Wiley. 13(1), pp. 144-156. ISSN 2041-2096. eISSN 2041-210X. Available under: doi: 10.1111/2041-210X.13741

@article{Farine2022-01Permu-55507, title={Permutation tests for hypothesis testing with animal social network data : Problems and potential solutions}, year={2022}, doi={10.1111/2041-210X.13741}, number={1}, volume={13}, issn={2041-2096}, journal={Methods in Ecology and Evolution}, pages={144--156}, author={Farine, Damien R. and Carter, Gerald G.} }

Farine, Damien R. eng 2021-11-11T10:21:43Z Permutation tests for hypothesis testing with animal social network data : Problems and potential solutions Attribution 4.0 International 2022-01 Carter, Gerald G. Carter, Gerald G. Farine, Damien R. 2021-11-11T10:21:43Z 1. Permutation tests are widely used to test null hypotheses with animal social network data, but suffer from high rates of type I and II error when the permutations do not properly simulate the intended null hypothesis.<br /><br />2. Two common types of permutations each have limitations. Pre-network (or datastream) permutations can be used to control ‘nuisance effects’ like spatial, temporal or sampling biases, but only when the null hypothesis assumes random social structure. Node (or node-label) permutation tests can test null hypotheses that include nonrandom social structure, but only when nuisance effects do not shape the observed network.<br /><br />3. We demonstrate one possible solution addressing these limitations: using pre-network permutations to adjust the values for each node or edge before conducting a node permutation test. We conduct a range of simulations to estimate error rates caused by confounding effects of social or non-social structure in the raw data.<br /><br />4. Regressions on simulated datasets suggest that this ‘double permutation’ approach is less likely to produce elevated error rates relative to using only node permutations, pre-network permutations or node permutations with simple covariates, which all exhibit elevated type I errors under at least one set of simulated conditions. For example, in scenarios where type I error rates from pre-network permutation tests exceed 30%, the error rates from double permutation remain at 5%.<br /><br />5. The double permutation procedure provides one potential solution to issues arising from elevated type I and type II error rates when testing null hypotheses with social network data. We also discuss alternative approaches that can provide robust inference, including fitting mixed effects models, restricted node permutations, testing multiple null hypotheses and splitting large datasets to generate replicated networks. Finally, we highlight ways that uncertainty can be explicitly considered and carried through the analysis.

Downloads since Nov 11, 2021 (Information about access statistics)

Farine_2-zmrtuooimgzq8.pdf 22

This item appears in the following Collection(s)

Attribution 4.0 International Except where otherwise noted, this item's license is described as Attribution 4.0 International

Search KOPS


Browse

My Account