Type of Publication: | Contribution to a conference collection |
Publication status: | Accepted |
Author: | Babic, Teo; Perteneder, Florian; Reiterer, Harald; Haller, Michael |
Year of publication: | 2020 |
Conference: | CHI 2020, Apr 25, 2020 - Apr 30, 2020, Honolulu, Hawaii, USA |
DOI (citable link): | https://dx.doi.org/10.1145/3334480.3382962 |
Summary: |
The interaction with distant displays often demands complex, multi-modal inputs which need to be achieved with a very simple hardware solution so that users can perform rich inputs wherever they encounter a distant display. We present Simo, a novel approach, that transforms a regular smartphone into a highly-expressive user motion tracking device and controller for distant displays. Both the front and back cameras of the smartphone are used simultaneously to track the user’s hand as well as the head, and body movements in real-world space and scale. In this work, we first define the possibilities for simultaneous face- and world-tracking using current off-the-shelf smartphones. Next, we present the implementation of a smartphone app enabling hand, head, and body motion tracking. Finally, we present a technical analysis outlining the possible tracking range.
|
CCS Classification: | •Human-centered computing → Interaction devices; Interaction techniques; |
Subject (DDC): | 004 Computer Science |
Keywords: | Smartphone; 3D interaction; mobile devices; distant displays; augmented reality; spatial interaction; motion tracking |
Link to License: | In Copyright |
Bibliography of Konstanz: | Yes |
BABIC, Teo, Florian PERTENEDER, Harald REITERER, Michael HALLER, 2020. Simo: Interactions with Distant Displays by Smartphones with Simultaneous Face and World Tracking. CHI 2020. Honolulu, Hawaii, USA, Apr 25, 2020 - Apr 30, 2020. Available under: doi: 10.1145/3334480.3382962
@inproceedings{Babic2020Inter-48874, title={Simo: Interactions with Distant Displays by Smartphones with Simultaneous Face and World Tracking}, year={2020}, doi={10.1145/3334480.3382962}, author={Babic, Teo and Perteneder, Florian and Reiterer, Harald and Haller, Michael} }
<rdf:RDF xmlns:dcterms="http://purl.org/dc/terms/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/" xmlns:dspace="http://digital-repositories.org/ontologies/dspace/0.1.0#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:void="http://rdfs.org/ns/void#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > <rdf:Description rdf:about="https://kops.uni-konstanz.de/rdf/resource/123456789/48874"> <dcterms:abstract xml:lang="eng">The interaction with distant displays often demands complex, multi-modal inputs which need to be achieved with a very simple hardware solution so that users can perform rich inputs wherever they encounter a distant display. We present Simo, a novel approach, that transforms a regular smartphone into a highly-expressive user motion tracking device and controller for distant displays. Both the front and back cameras of the smartphone are used simultaneously to track the user’s hand as well as the head, and body movements in real-world space and scale. In this work, we first define the possibilities for simultaneous face- and world-tracking using current off-the-shelf smartphones. Next, we present the implementation of a smartphone app enabling hand, head, and body motion tracking. Finally, we present a technical analysis outlining the possible tracking range.</dcterms:abstract> <dc:contributor>Perteneder, Florian</dc:contributor> <void:sparqlEndpoint rdf:resource="http://localhost/fuseki/dspace/sparql"/> <bibo:uri rdf:resource="https://kops.uni-konstanz.de/handle/123456789/48874"/> <dcterms:isPartOf rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dspace:isPartOfCollection rdf:resource="https://kops.uni-konstanz.de/rdf/resource/123456789/36"/> <dc:rights>terms-of-use</dc:rights> <dcterms:available rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-03-02T09:20:35Z</dcterms:available> <dcterms:issued>2020</dcterms:issued> <dc:date rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2020-03-02T09:20:35Z</dc:date> <dc:contributor>Babic, Teo</dc:contributor> <dc:creator>Reiterer, Harald</dc:creator> <dc:language>eng</dc:language> <dc:contributor>Haller, Michael</dc:contributor> <dcterms:rights rdf:resource="https://rightsstatements.org/page/InC/1.0/"/> <dc:creator>Babic, Teo</dc:creator> <dc:contributor>Reiterer, Harald</dc:contributor> <dc:creator>Perteneder, Florian</dc:creator> <dcterms:title>Simo: Interactions with Distant Displays by Smartphones with Simultaneous Face and World Tracking</dcterms:title> <dspace:hasBitstream rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/48874/1/LBW221.pdf"/> <dc:creator>Haller, Michael</dc:creator> <dcterms:hasPart rdf:resource="https://kops.uni-konstanz.de/bitstream/123456789/48874/1/LBW221.pdf"/> <foaf:homepage rdf:resource="http://localhost:8080/jspui"/> </rdf:Description> </rdf:RDF>
LBW221.pdf | 158 |