Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs
Augmented Reality (AR) applications are known for using unconventional devices and enabling different ways to interact with the virtual elements of the environment. Head-mounted displays (HMDs), for example, enrich the user experience by providing greater immersion than other display devices. Most c...
| Autores: | , , , |
|---|---|
| Tipo de recurso: | artículo |
| Estado: | Versión publicada |
| Fecha de publicación: | 2024 |
| País: | Brasil |
| Institución: | Universidade Estadual Paulista (UNESP) |
| Repositorio: | Repositório Institucional da UNESP |
| Idioma: | inglés |
| OAI Identifier: | oai:repositorio.unesp.br:11449/306323 |
| Acceso en línea: | http://dx.doi.org/10.1007/s11042-024-18736-5 https://hdl.handle.net/11449/306323 |
| Access Level: | acceso abierto |
| Palabra clave: | Augmented reality Head-mounted displays Perception and interaction Peripersonal space |
| id |
BR_6f814dc59682dc3821eaa661e1208cc6 |
|---|---|
| oai_identifier_str |
oai:repositorio.unesp.br:11449/306323 |
| network_acronym_str |
BR |
| network_name_str |
Brasil |
| repository_id_str |
|
| spelling |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDsAugmented realityHead-mounted displaysPerception and interactionPeripersonal spaceAugmented Reality (AR) applications are known for using unconventional devices and enabling different ways to interact with the virtual elements of the environment. Head-mounted displays (HMDs), for example, enrich the user experience by providing greater immersion than other display devices. Most conventional HMDs are expensive or have restrictions, such as a limited field of view, making them inappropriate for many applications. With the increased computational power on mobile, some HMD models integrate conventional smartphones into the equipment. Smartphone-based HMDs have the advantage of being cheaper, so they can decrease the cost of AR systems. In addition, smartphone-based HMDs have the processing power, field of view, and camera quality required for most AR applications. Many applications that can use smartphone-based HMDs use the peripersonal space, distances of up to 1 meter from the user, as a region to interact with the virtual objects of the environment. As it is a specific region, it is essential to evaluate whether the device’s limitations affect the performance of any interaction within this space. In this work, we created a system that combines a depth sensor and an HMD device to evaluate whether the user’s performance using pinch gestures to interact inside the peripersonal space is uniform when using a smartphone-based HMD in AR applications. The results showed that such equipment is suitable for applications where interaction occurs under these conditions, as the user’s performance in similar tasks is not affected when the interaction occurs within the peripersonal space.Universidade Estadual Paulista Júlio de Mesquita Filho, SPUniversidade Tecnológica Federal do Paraná, PRUniversidade Estadual Paulista Júlio de Mesquita Filho, SPUniversidade Estadual Paulista (UNESP)Universidade Tecnológica Federal do Paraná2025-04-29T20:05:54Z2024-10-01info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/article80873-80887http://dx.doi.org/10.1007/s11042-024-18736-5Multimedia Tools and Applications, v. 83, n. 34, p. 80873-80887, 2024.1573-77211380-7501https://hdl.handle.net/11449/30632310.1007/s11042-024-18736-52-s2.0-85187188946Scopusreponame:Repositório Institucional da UNESPinstname:Universidade Estadual Paulista (UNESP)instacron:UNESPengMultimedia Tools and Applicationsinfo:eu-repo/semantics/openAccessBatistão, Lucca Vieira [UNESP]Sementille, Antonio Carlos [UNESP]Corrêa, Cléber GimenezSanches, Silvio Ricardo Rodrigues2025-04-30T13:57:20Zoai:repositorio.unesp.br:11449/306323Repositório InstitucionalPUBhttp://repositorio.unesp.br/oai/requestrepositoriounesp@unesp.bropendoar:29462025-04-30T13:57:20Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP)false |
| dc.title.none.fl_str_mv |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| title |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| spellingShingle |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs Batistão, Lucca Vieira [UNESP] Augmented reality Head-mounted displays Perception and interaction Peripersonal space |
| title_short |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| title_full |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| title_fullStr |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| title_full_unstemmed |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| title_sort |
Pinch gesture interaction in the peripersonal space using VST smartphone-based HMDs |
| dc.creator.none.fl_str_mv |
Batistão, Lucca Vieira [UNESP] Sementille, Antonio Carlos [UNESP] Corrêa, Cléber Gimenez Sanches, Silvio Ricardo Rodrigues |
| author |
Batistão, Lucca Vieira [UNESP] |
| author_facet |
Batistão, Lucca Vieira [UNESP] Sementille, Antonio Carlos [UNESP] Corrêa, Cléber Gimenez Sanches, Silvio Ricardo Rodrigues |
| author_role |
author |
| author2 |
Sementille, Antonio Carlos [UNESP] Corrêa, Cléber Gimenez Sanches, Silvio Ricardo Rodrigues |
| author2_role |
author author author |
| dc.contributor.none.fl_str_mv |
Universidade Estadual Paulista (UNESP) Universidade Tecnológica Federal do Paraná |
| dc.subject.por.fl_str_mv |
Augmented reality Head-mounted displays Perception and interaction Peripersonal space |
| topic |
Augmented reality Head-mounted displays Perception and interaction Peripersonal space |
| description |
Augmented Reality (AR) applications are known for using unconventional devices and enabling different ways to interact with the virtual elements of the environment. Head-mounted displays (HMDs), for example, enrich the user experience by providing greater immersion than other display devices. Most conventional HMDs are expensive or have restrictions, such as a limited field of view, making them inappropriate for many applications. With the increased computational power on mobile, some HMD models integrate conventional smartphones into the equipment. Smartphone-based HMDs have the advantage of being cheaper, so they can decrease the cost of AR systems. In addition, smartphone-based HMDs have the processing power, field of view, and camera quality required for most AR applications. Many applications that can use smartphone-based HMDs use the peripersonal space, distances of up to 1 meter from the user, as a region to interact with the virtual objects of the environment. As it is a specific region, it is essential to evaluate whether the device’s limitations affect the performance of any interaction within this space. In this work, we created a system that combines a depth sensor and an HMD device to evaluate whether the user’s performance using pinch gestures to interact inside the peripersonal space is uniform when using a smartphone-based HMD in AR applications. The results showed that such equipment is suitable for applications where interaction occurs under these conditions, as the user’s performance in similar tasks is not affected when the interaction occurs within the peripersonal space. |
| publishDate |
2024 |
| dc.date.none.fl_str_mv |
2024-10-01 2025-04-29T20:05:54Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
http://dx.doi.org/10.1007/s11042-024-18736-5 Multimedia Tools and Applications, v. 83, n. 34, p. 80873-80887, 2024. 1573-7721 1380-7501 https://hdl.handle.net/11449/306323 10.1007/s11042-024-18736-5 2-s2.0-85187188946 |
| url |
http://dx.doi.org/10.1007/s11042-024-18736-5 https://hdl.handle.net/11449/306323 |
| identifier_str_mv |
Multimedia Tools and Applications, v. 83, n. 34, p. 80873-80887, 2024. 1573-7721 1380-7501 10.1007/s11042-024-18736-5 2-s2.0-85187188946 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
Multimedia Tools and Applications |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
80873-80887 |
| dc.source.none.fl_str_mv |
Scopus reponame:Repositório Institucional da UNESP instname:Universidade Estadual Paulista (UNESP) instacron:UNESP |
| instname_str |
Universidade Estadual Paulista (UNESP) |
| instacron_str |
UNESP |
| institution |
UNESP |
| reponame_str |
Repositório Institucional da UNESP |
| collection |
Repositório Institucional da UNESP |
| repository.name.fl_str_mv |
Repositório Institucional da UNESP - Universidade Estadual Paulista (UNESP) |
| repository.mail.fl_str_mv |
repositoriounesp@unesp.br |
| _version_ |
1853671847682375680 |
| score |
15,300724 |