KOPS - The Institutional Repository of the University of Konstanz

Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf Smartphones

Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf Smartphones

Cite This

Files in this item

Checksum: MD5:3666bda2eb797443492ad675b640d043

BABIC, Teo, Harald REITERER, Michael HALLER, 2022. Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf Smartphones. In: Multimodal Technologies and Interaction. MDPI. 6(10), 94. eISSN 2414-4088. Available under: doi: 10.3390/mti6100094

@article{Babic2022-10-19Under-58898.3, title={Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf Smartphones}, year={2022}, doi={10.3390/mti6100094}, number={10}, volume={6}, journal={Multimodal Technologies and Interaction}, author={Babic, Teo and Reiterer, Harald and Haller, Michael}, note={Article Number: 94} }

<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/rdf/resource/123456789/58898.3"> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> <dc:rights>Attribution 4.0 International</dc:rights> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dcterms:issued>2022-10-19</dcterms:issued> <dcterms:rights rdf:resource="http://creativecommons.org/licenses/by/4.0/"/> <dc:contributor>Haller, Michael</dc:contributor> <dcterms:abstract xml:lang="eng">Over decades, many researchers developed complex in-lab systems with the overall goal to track multiple body parts of the user for a richer and more powerful 2D/3D interaction with a distant display. In this work, we introduce a novel smartphone-based tracking approach that eliminates the need for complex tracking systems. Relying on simultaneous usage of the front and rear smartphone cameras, our solution enables rich spatial interactions with distant displays by combining touch input with hand-gesture input, body and head motion, as well as eye-gaze input. In this paper, we firstly present a taxonomy for classifying distant display interactions, providing an overview of enabling technologies, input modalities, and interaction techniques, spanning from 2D to 3D interactions. Further, we provide more details about our implementation—using off-the-shelf smartphones. Finally, we validate our system in a user study by a variety of 2D and 3D multimodal interaction techniques, including input refinement.</dcterms:abstract> <dc:creator>Reiterer, Harald</dc:creator> <dc:creator>Babic, Teo</dc:creator> <foaf:homepage rdf:resource="http://localhost:8080/jspui"/> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/58898.3"/> <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/58898.3/1/Babic_2-10nz1ryixe8s66.pdf"/> <dcterms:title>Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf Smartphones</dcterms:title> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-10-25T12:55:49Z</dcterms:available> <dc:contributor>Babic, Teo</dc:contributor> <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/58898.3/1/Babic_2-10nz1ryixe8s66.pdf"/> <dc:contributor>Reiterer, Harald</dc:contributor> <dc:language>eng</dc:language> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2022-10-25T12:55:49Z</dc:date> <dc:creator>Haller, Michael</dc:creator> </rdf:Description> </rdf:RDF>

Downloads since Oct 25, 2022 (Information about access statistics)

Babic_2-10nz1ryixe8s66.pdf 15

This item appears in the following Collection(s)

Attribution 4.0 International Except where otherwise noted, this item's license is described as Attribution 4.0 International

Version History

Version Item Date Summary Publication Version

*Selected version

Search KOPS


Browse

My Account