Publikation:

Efficient Computer Vision and Machine Learning Methods for Automating Large-Scale Analysis of Collective Animal Behavior

Lade...
Vorschaubild

Dateien

Walter_2-jy3xvzkem2i23.pdf
Walter_2-jy3xvzkem2i23.pdfGröße: 43.39 MBDownloads: 241

Datum

2022

Herausgeber:innen

Kontakt

ISSN der Zeitschrift

Electronic ISSN

ISBN

Bibliografische Daten

Verlag

Schriftenreihe

Auflagebezeichnung

DOI (zitierfähiger Link)
ArXiv-ID

Internationale Patentnummer

Link zur Lizenz

Angaben zur Forschungsförderung

Projekt

Open Access-Veröffentlichung
Open Access Green
Core Facility der Universität Konstanz

Gesperrt bis

Titel in einer weiteren Sprache

Publikationstyp
Dissertation
Publikationsstatus
Published

Erschienen in

Zusammenfassung

Research into biological systems has, as many other fields of research have, greatly profited from an ever-increasing range of computational tools. This is important, not just because automation can make life easier, but because it enables researchers to increasingly address questions that were previously impossible to answer. Around 50 years ago, in 1972, D. Radakov published his book on “Schooling in the Ecology of Fish”, detailing a vast number of interesting hypotheses and experiments to investigate the underlying factors of schooling — none of which he was able to evaluate quantitatively. Not for the lack of trying, but simply because the required technology did not yet exist. Back then, while already enjoying the benefits of the “motion picture film”, the paths and shapes of individuals had to be traced manually. This limited researchers to work with mere seconds of trajectory data, which is hardly enough to form any scientific conclusions about the rules governing each individual’s movements, or the sub-second structure of alarm responses. High-speed cameras, automated tracking and analysis, as well as a much more interconnected scientific community (especially because Radakov lived in the Soviet Union), are developments of the past few decades that significantly improved the prospects in, but not limited to, animal behavior research. In this thesis, I present multiple methods which are specifically designed to assist research in collective behavior, ecology, biomechanics, and hopefully others, that are powerful, yet pragmatic. In the first chapter of my thesis, I present a tool, called TRex, that combines implementations of various methods, each addressing different aspects of typical video-based analyses of behavior, and highlight the importance of their synthesis into a single piece of software — as opposed to the prevalent fragmentation of tools in our field of research. The main focus of this chapter is a machine learning based method for the unsupervised visual identification of individuals, which I demonstrate to be superior to previously available implementations. Importantly, this chapter also builds the foundation for the later chapters, where I take these approaches further, addressing increasingly more difficult scenarios. In Chapter 2, where I focus on the exploration and handling of very large datasets using, as an example, field-data of the termite species Constrictotermes cyphergaster (Silvestri 1901). These eusocial insects are known to live in large colonies, making them an ideal benchmark for the application and, consequantially, improvement of my methods. Furthermore, on this basis, using a simplified representation of trajectory data, I present two methods for behavioral anomaly detection that are able to identify both the temporal and spatial coordinates of unusual events. Finally, in Chapter 3, I address the importance of inter-individual morphological differences, from both a methodological and a biological perspective. There, I present improvements for the matching algorithm I developed in Chapter 1, as well as a machine learning algorithm specifically designed to automatically identify different morphological “types” of individuals under minimal supervision. I end this chapter by using many of the previously described tools to further investigate the dataset I used in Chapter 2, primarily focusing on the differences between two different types of termites (castes), “workers” and “soldiers”, in terms of their movement and an approximation of tactile interactions. This is, to our knowledge, the largest quantitative study of our study species (C. cyphergaster). Together, the methods presented in this thesis form a versatile chain of efficient computer vision and machine learning tools to automate tracking, posture estimation, recording, dataset exploration and to classify morphological types of individuals. Despite the focus on termites in the last two chapters, all of these approaches are designed to work for a wide range of species and in different situations, with many possible applications in a wide range of research fields, including computational biology, neurobiology and ecology.

Zusammenfassung in einer weiteren Sprache

Fachgebiet (DDC)
570 Biowissenschaften, Biologie

Schlagwörter

biology ecology termites tracking recording methods collective behavior

Konferenz

Rezension
undefined / . - undefined, undefined

Forschungsvorhaben

Organisationseinheiten

Zeitschriftenheft

Zugehörige Datensätze in KOPS

Zitieren

ISO 690WALTER, Tristan Leonard, 2022. Efficient Computer Vision and Machine Learning Methods for Automating Large-Scale Analysis of Collective Animal Behavior [Dissertation]. Konstanz: Universität Konstanz
BibTex
@phdthesis{Walter2022Effic-57697,
  year={2022},
  title={Efficient Computer Vision and Machine Learning Methods for Automating Large-Scale Analysis of Collective Animal Behavior},
  author={Walter, Tristan Leonard},
  address={Konstanz},
  school={Universität Konstanz}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/57697">
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dc:rights>Attribution-NonCommercial-ShareAlike 4.0 International</dc:rights>
    <dcterms:abstract xml:lang="eng">Research into biological systems has, as many other fields of research have, greatly profited from an ever-increasing range of computational tools. This is important, not just because automation can make life easier, but because it enables researchers to increasingly address questions that were previously impossible to answer. Around 50 years ago, in 1972, D. Radakov published his book on “Schooling in the Ecology of Fish”, detailing a vast number of interesting hypotheses and experiments to investigate the underlying factors of schooling — none of which he was able to evaluate quantitatively. Not for the lack of trying, but simply because the required technology did not yet exist. Back then, while already enjoying the benefits of the “motion picture film”, the paths and shapes of individuals had to be traced manually. This limited researchers to work with mere seconds of trajectory data, which is hardly enough to form any scientific conclusions about the rules governing each individual’s movements, or the sub-second structure of alarm responses. High-speed cameras, automated tracking and analysis, as well as a much more interconnected scientific community (especially because Radakov lived in the Soviet Union), are developments of the past few decades that significantly improved the prospects in, but not limited to, animal behavior research. In this thesis, I present multiple methods which are specifically designed to assist research in collective behavior, ecology, biomechanics, and hopefully others, that are powerful, yet pragmatic. In the first chapter of my thesis, I present a tool, called TRex, that combines implementations of various methods, each addressing different aspects of typical video-based analyses of behavior, and highlight the importance of their synthesis into a single piece of software — as opposed to the prevalent fragmentation of tools in our field of research. The main focus of this chapter is a machine learning based method for the unsupervised visual identification of individuals, which I demonstrate to be superior to previously available implementations. Importantly, this chapter also builds the foundation for the later chapters, where I take these approaches further, addressing increasingly more difficult scenarios. In Chapter 2, where I focus on the exploration and handling of very large datasets using, as an example, field-data of the termite species Constrictotermes cyphergaster (Silvestri 1901). These eusocial insects are known to live in large colonies, making them an ideal benchmark for the application and, consequantially, improvement of my methods. Furthermore, on this basis, using a simplified representation of trajectory data, I present two methods for behavioral anomaly detection that are able to identify both the temporal and spatial coordinates of unusual events. Finally, in Chapter 3, I address the importance of inter-individual morphological differences, from both a methodological and a biological perspective. There, I present improvements for the matching algorithm I developed in Chapter 1, as well as a machine learning algorithm specifically designed to automatically identify different morphological “types” of individuals under minimal supervision. I end this chapter by using many of the previously described tools to further investigate the dataset I used in Chapter 2, primarily focusing on the differences between two different types of termites (castes), “workers” and “soldiers”, in terms of their movement and an approximation of tactile interactions. This is, to our knowledge, the largest quantitative study of our study species (C. cyphergaster). Together, the methods presented in this thesis form a versatile chain of efficient computer vision and machine learning tools to automate tracking, posture estimation, recording, dataset exploration and to classify morphological types of individuals. Despite the focus on termites in the last two chapters, all of these approaches are designed to work for a wide range of species and in different situations, with many possible applications in a wide range of research fields, including computational biology, neurobiology and ecology.</dcterms:abstract>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/57697"/>
    <dc:contributor>Walter, Tristan Leonard</dc:contributor>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/57697/3/Walter_2-jy3xvzkem2i23.pdf"/>
    <dc:language>eng</dc:language>
    <dcterms:rights rdf:resource="http://creativecommons.org/licenses/by-nc-sa/4.0/"/>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-05-30T11:42:00Z</dcterms:available>
    <dcterms:issued>2022</dcterms:issued>
    <dc:creator>Walter, Tristan Leonard</dc:creator>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/57697/3/Walter_2-jy3xvzkem2i23.pdf"/>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-05-30T11:42:00Z</dc:date>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/28"/>
    <dcterms:title>Efficient Computer Vision and Machine Learning Methods for Automating Large-Scale Analysis of Collective Animal Behavior</dcterms:title>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/28"/>
  </rdf:Description>
</rdf:RDF>

Interner Vermerk

xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter

Kontakt
URL der Originalveröffentl.

Prüfdatum der URL

Prüfungsdatum der Dissertation

April 8, 2022
Hochschulschriftenvermerk
Konstanz, Univ., Diss., 2022
Finanzierungsart

Kommentar zur Publikation

Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Nein
Begutachtet
Diese Publikation teilen