Publikation:

Visual Sheet Music Analytics

Lade...
Vorschaubild

Dateien

Miller_2-100i255h5bf977.pdf
Miller_2-100i255h5bf977.pdfGröße: 97.77 MBDownloads: 37

Datum

2024

Autor:innen

Herausgeber:innen

Kontakt

ISSN der Zeitschrift

Electronic ISSN

ISBN

Bibliografische Daten

Verlag

Schriftenreihe

Auflagebezeichnung

DOI (zitierfähiger Link)
ArXiv-ID

Internationale Patentnummer

Link zur Lizenz

Angaben zur Forschungsförderung

Projekt

Open Access-Veröffentlichung
Open Access Green
Core Facility der Universität Konstanz

Gesperrt bis

Titel in einer weiteren Sprache

Publikationstyp
Dissertation
Publikationsstatus
Published

Erschienen in

Zusammenfassung

Through integrating visual interactive data analysis with sheet music, this thesis addresses a new interdisciplinary field: Visual Musicology. This work bridges the gap between information visualization and musicology, paving the way for new methods to analyze and interpret music data, specifically focusing on sheet music. The Western common music notation (CMN), used in sheet music, is uncontested among musicologists, educators, students, and musicians. Nevertheless, CMN's intricate and complex design challenges interpreting and analyzing large amounts of sheet music collections, particularly for those who are no visualization experts. We address these challenges by introducing novel visual analytics solutions that extend beyond the scope of existing research in the field. The initial foundational pillar establishes Visual Musicology, where we introduce the Visual Musicology Graph and the Methodology Transfer Model as organizational frameworks stimulating interdisciplinary research collaboration. They facilitate solution transfer across domains, as demonstrated through various musicological scenarios such as embodied music interaction. We also examine existing music notation techniques, discovering opportunities for unapplied designs that replace or connect CMN with advanced visualization techniques. Then, visualization designs for augmenting digital sheet music with harmonic and rhythmic fingerprints based on domain-specific concepts are presented, including the circle of fifths and rhythm tree. We show how to employ melodic operators to trace the progression of melodies in compositions, enabling analysts to understand the melodic relationship of the motivic and thematic material. By augmenting instead of replacing CMN, our research shows that these designs improve the accessibility and understandability of sheet music for people with varying musical and visual analytic expertise. Through active collaboration with musicologists and comprehensive qualitative user studies, our research assesses the applicability and effectiveness of the augmentation strategy. Building on these previous two foundational parts, the thesis proposes two approaches for sheet music analysis: Bottom-Up Composition Analysis (MusicVis) and Top-Down Corpus Analysis (CorpusVis). MusicVis enriches digital sheet music by extending the harmonic, rhythmic, and melodic analysis through flexible visual interactive queries and seamless transitions to abstract analysis levels. Conversely, CorpusVis facilitates macro-level exploration of sheet music collections. Qualitative user studies show that the proposed techniques support the interpretation and understanding of complex musical structures at different levels of abstraction while, for instance, scalability remains a limitation. The thesis concludes by reflecting on lessons learned, such as building on familiar concepts and separating independent data characteristics for analysis. We also address challenges encountered during our conducted Visual Sheet Music Analytics research, like transforming abstract musical concepts into intuitive visual representations while factoring in user requirements. Furthermore, we emphasize specific future research projects in Visual Musicology, such as integrating our proposed fingerprint designs into AR platforms, thus offering a hands-on approach for musicians to interact with augmented sheet music while learning and playing their instruments.

Zusammenfassung in einer weiteren Sprache

Fachgebiet (DDC)
004 Informatik

Schlagwörter

Visual Analytics, Music Notation, Visual Musicology, Sheet Music, MusicXML, D3, Circle of Fifths, Harmony, Rhythm, Melody, Corpus Analysis, Pattern Detection

Konferenz

Rezension
undefined / . - undefined, undefined

Forschungsvorhaben

Organisationseinheiten

Zeitschriftenheft

Zugehörige Datensätze in KOPS

Zitieren

ISO 690MILLER, Matthias, 2024. Visual Sheet Music Analytics [Dissertation]. Konstanz: Universität Konstanz
BibTex
@phdthesis{Miller2024Visua-70419,
  year={2024},
  title={Visual Sheet Music Analytics},
  author={Miller, Matthias},
  address={Konstanz},
  school={Universität Konstanz}
}
RDF
<rdf:RDF
    xmlns:dcterms="http://purl.org/dc/terms/"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
    xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
    xmlns:bibo="http://purl.org/ontology/bibo/"
    xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#"
    xmlns:foaf="http://xmlns.com/foaf/0.1/"
    xmlns:void="http://rdfs.org/ns/void#"
    xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > 
  <rdf:Description rdf:about="https://kops.uni-konstanz.de/server/rdf/resource/123456789/70419">
    <dcterms:rights rdf:resource="http://creativecommons.org/licenses/by-nc/4.0/"/>
    <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/70419/4/Miller_2-100i255h5bf977.pdf"/>
    <dc:creator>Miller, Matthias</dc:creator>
    <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/70419"/>
    <foaf:homepage rdf:resource="http://localhost:8080/"/>
    <dc:rights>Attribution-NonCommercial 4.0 International</dc:rights>
    <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/>
    <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/server/rdf/resource/123456789/36"/>
    <dc:language>eng</dc:language>
    <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-07-18T08:00:39Z</dcterms:available>
    <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/70419/4/Miller_2-100i255h5bf977.pdf"/>
    <dcterms:abstract>Through integrating visual interactive data analysis with sheet music, this thesis addresses a new interdisciplinary field: Visual Musicology. This work bridges the gap between information visualization and musicology, paving the way for new methods to analyze and interpret music data, specifically focusing on sheet music. The Western common music notation (CMN), used in sheet music, is uncontested among musicologists, educators, students, and musicians. Nevertheless, CMN's intricate and complex design challenges interpreting and analyzing large amounts of sheet music collections, particularly for those who are no visualization experts. We address these challenges by introducing novel visual analytics solutions that extend beyond the scope of existing research in the field. The initial foundational pillar establishes Visual Musicology, where we introduce the Visual Musicology Graph and the Methodology Transfer Model as organizational frameworks stimulating interdisciplinary research collaboration. They facilitate solution transfer across domains, as demonstrated through various musicological scenarios such as embodied music interaction. We also examine existing music notation techniques, discovering opportunities for unapplied designs that replace or connect CMN with advanced visualization techniques. Then, visualization designs for augmenting digital sheet music with harmonic and rhythmic fingerprints based on domain-specific concepts are presented, including the circle of fifths and rhythm tree. We show how to employ melodic operators to trace the progression of melodies in compositions, enabling analysts to understand the melodic relationship of the motivic and thematic material. By augmenting instead of replacing CMN, our research shows that these designs improve the accessibility and understandability of sheet music for people with varying musical and visual analytic expertise. Through active collaboration with musicologists and comprehensive qualitative user studies, our research assesses the applicability and effectiveness of the augmentation strategy. Building on these previous two foundational parts, the thesis proposes two approaches for sheet music analysis: Bottom-Up Composition Analysis (MusicVis) and Top-Down Corpus Analysis (CorpusVis). MusicVis enriches digital sheet music by extending the harmonic, rhythmic, and melodic analysis through flexible visual interactive queries and seamless transitions to abstract analysis levels. Conversely, CorpusVis facilitates macro-level exploration of sheet music collections. Qualitative user studies show that the proposed techniques support the interpretation and understanding of complex musical structures at different levels of abstraction while, for instance, scalability remains a limitation. The thesis concludes by reflecting on lessons learned, such as building on familiar concepts and separating independent data characteristics for analysis. We also address challenges encountered during our conducted Visual Sheet Music Analytics research, like transforming abstract musical concepts into intuitive visual representations while factoring in user requirements. Furthermore, we emphasize specific future research projects in Visual Musicology, such as integrating our proposed fingerprint designs into AR platforms, thus offering a hands-on approach for musicians to interact with augmented sheet music while learning and playing their instruments.</dcterms:abstract>
    <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2024-07-18T08:00:39Z</dc:date>
    <dcterms:title>Visual Sheet Music Analytics</dcterms:title>
    <dc:contributor>Miller, Matthias</dc:contributor>
    <dcterms:issued>2024</dcterms:issued>
  </rdf:Description>
</rdf:RDF>

Interner Vermerk

xmlui.Submission.submit.DescribeStep.inputForms.label.kops_note_fromSubmitter

Kontakt
URL der Originalveröffentl.

Prüfdatum der URL

Prüfungsdatum der Dissertation

May 24, 2024
Hochschulschriftenvermerk
Konstanz, Univ., Diss., 2024
Finanzierungsart

Kommentar zur Publikation

Allianzlizenz
Corresponding Authors der Uni Konstanz vorhanden
Internationale Co-Autor:innen
Universitätsbibliographie
Ja
Begutachtet
Link zu Forschungsdaten
Beschreibung der Forschungsdaten
Contains some of the MusicXML files that were used to create visual illustrations such as in the appendix.
Diese Publikation teilen