Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs

Augmented Reality (AR) applications are known for using unconventional devices and enabling different ways to interact with the virtual elements of the environment. Head-mounted displays (HMDs), for example, enrich the user experience by providing greater immersion than other display devices. Most c...

Descripción completa

Detalles Bibliográficos
Autores: Batistão, Lucca Vieira [UNESP], Sementille, Antonio Carlos [UNESP], Corrêa, Cléber Gimenez, Sanches, Silvio Ricardo Rodrigues
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:Brasil
Institución:Universidade Estadual Paulista (UNESP)
Repositorio:Repositório Institucional da UNESP
Idioma:inglés
OAI Identifier:oai:repositorio.unesp.br:11449/306323
Acceso en línea:http://dx.doi.org/10.1007/s11042-024-18736-5
https://hdl.handle.net/11449/306323
Access Level:acceso abierto
Palabra clave:Augmented reality
Head-mounted displays
Perception and interaction
Peripersonal space
id BR_6f814dc59682dc3821eaa661e1208cc6
oai_identifier_str oai:repositorio.unesp.br:11449/306323
network_acronym_str BR
network_name_str Brasil
repository_id_str
spelling Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDsAugmented realityHead-mounted displaysPerception and interactionPeripersonal spaceAugmented Reality (AR) applications are known for using unconventional devices and enabling different ways to interact with the virtual elements of the environment. Head-mounted displays (HMDs), for example, enrich the user experience by providing greater immersion than other display devices. Most conventional HMDs are expensive or have restrictions, such as a limited field of view, making them inappropriate for many applications. With the increased computational power on mobile, some HMD models integrate conventional smartphones into the equipment. Smartphone-based HMDs have the advantage of being cheaper, so they can decrease the cost of AR systems. In addition, smartphone-based HMDs have the processing power, field of view, and camera quality required for most AR applications. Many applications that can use smartphone-based HMDs use the peripersonal space, distances of up to 1 meter from the user, as a region to interact with the virtual objects of the environment. As it is a specific region, it is essential to evaluate whether the device’s limitations affect the performance of any interaction within this space. In this work, we created a system that combines a depth sensor and an HMD device to evaluate whether the user’s performance using pinch gestures to interact inside the peripersonal space is uniform when using a smartphone-based HMD in AR applications. The results showed that such equipment is suitable for applications where interaction occurs under these conditions, as the user’s performance in similar tasks is not affected when the interaction occurs within the peripersonal space.Universidade Estadual Paulista Júlio de Mesquita Filho, SPUniversidade Tecnológica Federal do Paraná, PRUniversidade Estadual Paulista Júlio de Mesquita Filho, SPUniversidade Estadual Paulista (UNESP)Universidade Tecnológica Federal do Paraná2025-04-29T20:05:54Z2024-10-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article80873-80887http://dx.doi.org/10.1007/s11042-024-18736-5Multimedia Tools and Applications, v. 83, n. 34, p. 80873-80887, 2024.1573-77211380-7501https://hdl.handle.net/11449/30632310.1007/s11042-024-18736-52-s2.0-85187188946Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengMultimedia Tools and Applicationsinfo:eu-repo/semantics/openAccessBatistão, Lucca Vieira [UNESP]Sementille, Antonio Carlos [UNESP]Corrêa, Cléber GimenezSanches, Silvio Ricardo Rodrigues2025-04-30T13:57:20Zoai:repositorio.unesp.br:11449/306323Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestrepositoriounesp@unesp.bropendoar:29462025-04-30T13:57:20Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false
dc.title.none.fl_str_mv Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
title Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
spellingShingle Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
Batistão, Lucca Vieira [UNESP]
Augmented reality
Head-mounted displays
Perception and interaction
Peripersonal space
title_short Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
title_full Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
title_fullStr Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
title_full_unstemmed Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
title_sort Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
dc.creator.none.fl_str_mv Batistão, Lucca Vieira [UNESP]
Sementille, Antonio Carlos [UNESP]
Corrêa, Cléber Gimenez
Sanches, Silvio Ricardo Rodrigues
author Batistão, Lucca Vieira [UNESP]
author_facet Batistão, Lucca Vieira [UNESP]
Sementille, Antonio Carlos [UNESP]
Corrêa, Cléber Gimenez
Sanches, Silvio Ricardo Rodrigues
author_role author
author2 Sementille, Antonio Carlos [UNESP]
Corrêa, Cléber Gimenez
Sanches, Silvio Ricardo Rodrigues
author2_role author
author
author
dc.contributor.none.fl_str_mv Universidade Estadual Paulista (UNESP)
Universidade Tecnológica Federal do Paraná
dc.subject.por.fl_str_mv Augmented reality
Head-mounted displays
Perception and interaction
Peripersonal space
topic Augmented reality
Head-mounted displays
Perception and interaction
Peripersonal space
description Augmented Reality (AR) applications are known for using unconventional devices and enabling different ways to interact with the virtual elements of the environment. Head-mounted displays (HMDs), for example, enrich the user experience by providing greater immersion than other display devices. Most conventional HMDs are expensive or have restrictions, such as a limited field of view, making them inappropriate for many applications. With the increased computational power on mobile, some HMD models integrate conventional smartphones into the equipment. Smartphone-based HMDs have the advantage of being cheaper, so they can decrease the cost of AR systems. In addition, smartphone-based HMDs have the processing power, field of view, and camera quality required for most AR applications. Many applications that can use smartphone-based HMDs use the peripersonal space, distances of up to 1 meter from the user, as a region to interact with the virtual objects of the environment. As it is a specific region, it is essential to evaluate whether the device’s limitations affect the performance of any interaction within this space. In this work, we created a system that combines a depth sensor and an HMD device to evaluate whether the user’s performance using pinch gestures to interact inside the peripersonal space is uniform when using a smartphone-based HMD in AR applications. The results showed that such equipment is suitable for applications where interaction occurs under these conditions, as the user’s performance in similar tasks is not affected when the interaction occurs within the peripersonal space.
publishDate 2024
dc.date.none.fl_str_mv 2024-10-01
2025-04-29T20:05:54Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv http://dx.doi.org/10.1007/s11042-024-18736-5
Multimedia Tools and Applications, v. 83, n. 34, p. 80873-80887, 2024.
1573-7721
1380-7501
https://hdl.handle.net/11449/306323
10.1007/s11042-024-18736-5
2-s2.0-85187188946
url http://dx.doi.org/10.1007/s11042-024-18736-5
https://hdl.handle.net/11449/306323
identifier_str_mv Multimedia Tools and Applications, v. 83, n. 34, p. 80873-80887, 2024.
1573-7721
1380-7501
10.1007/s11042-024-18736-5
2-s2.0-85187188946
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv Multimedia Tools and Applications
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 80873-80887
dc.source.none.fl_str_mv Scopus
reponame:Repositório Institucional da UNESP
instname:Universidade Estadual Paulista (UNESP)
instacron:UNESP
instname_str Universidade Estadual Paulista (UNESP)
instacron_str UNESP
institution UNESP
reponame_str Repositório Institucional da UNESP
collection Repositório Institucional da UNESP
repository.name.fl_str_mv Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)
repository.mail.fl_str_mv repositoriounesp@unesp.br
_version_ 1853671847682375680
score 15,300724