TY - GEN
T1 - LensCap
T2 - 19th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2021
AU - Hu, Jinhan
AU - Iosifescu, Andrei
AU - Likamwa, Robert
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/6/24
Y1 - 2021/6/24
N2 - Augmented Reality (AR) enables smartphone users to interact with virtual content spatially overlaid on a continuously captured physical world. Under the current permission enforcement model in popular operating systems, AR apps are given Internet permission at installation time, and request camera permission and external storage write permission at runtime through a user's approval. With these permissions granted, any Internet-enabled AR app could silently collect camera frames and derived visual information for malicious intent without a user's awareness. This raises serious concerns about the disclosure of private user data in their living environments. To give users more control over application usage of their camera frames and the information derived from them, we introduce LensCap, a split-process app design framework, in which the app is split into a camera-handling visual process and a connectivity-handling network process. At runtime, LensCap manages secured communications between split processes, enacting fine-grained data usage monitoring. LensCap also allows both processes to present interactive user interfaces. With LensCap, users can decide what forms of visual data can be transmitted to the network, while still allowing visual data to be used for AR purposes on device. We prototype LensCap as an Android library and demonstrate its usability as a plugin in Unreal Engine. Performance evaluation results on five AR apps confirm that visual privacy can be preserved with an insignificant latency penalty (< 1.3 ms) at 60 FPS.
AB - Augmented Reality (AR) enables smartphone users to interact with virtual content spatially overlaid on a continuously captured physical world. Under the current permission enforcement model in popular operating systems, AR apps are given Internet permission at installation time, and request camera permission and external storage write permission at runtime through a user's approval. With these permissions granted, any Internet-enabled AR app could silently collect camera frames and derived visual information for malicious intent without a user's awareness. This raises serious concerns about the disclosure of private user data in their living environments. To give users more control over application usage of their camera frames and the information derived from them, we introduce LensCap, a split-process app design framework, in which the app is split into a camera-handling visual process and a connectivity-handling network process. At runtime, LensCap manages secured communications between split processes, enacting fine-grained data usage monitoring. LensCap also allows both processes to present interactive user interfaces. With LensCap, users can decide what forms of visual data can be transmitted to the network, while still allowing visual data to be used for AR purposes on device. We prototype LensCap as an Android library and demonstrate its usability as a plugin in Unreal Engine. Performance evaluation results on five AR apps confirm that visual privacy can be preserved with an insignificant latency penalty (< 1.3 ms) at 60 FPS.
KW - AR application development
KW - augmented reality security
KW - split-process control
KW - unreal engine
KW - visual privacy
UR - http://www.scopus.com/inward/record.url?scp=85110073922&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85110073922&partnerID=8YFLogxK
U2 - 10.1145/3458864.3467676
DO - 10.1145/3458864.3467676
M3 - Conference contribution
AN - SCOPUS:85110073922
T3 - MobiSys 2021 - Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services
SP - 14
EP - 27
BT - MobiSys 2021 - Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services
PB - Association for Computing Machinery, Inc
Y2 - 24 June 2021 through 2 July 2021
ER -