IP Library › Granted Patent US 12,498,793
Granted Patent B2
US 12,498,793 · App. 18/402,454 · Granted Dec 16, 2025

Translating a 3D volume in extended reality

Inventor: Mason Spong (Provo, UT)
Assignee: Snap Inc.
G06F3/017G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,498,793
App. No.
18/402,454
Granted
Dec 16, 2025
Kind
B2
Abstract

An extended Reality (XR) system that translates virtual objects in an XR user interface using gestures is provided. The XR system displays a virtual object to a user in an extended reality interface, detects a pinch gesture and its selection location within the virtual object's boundaries, and determines an offset vector from the virtual object's center point to the pinch gesture's selection location. The XR system generates a translated virtual object using the offset vector and a current location of the pinch gesture, and displays the translated virtual object to the user.

Claims (52)

1 . A machine-implemented method comprising:

providing an extended Reality (XR) user interface of an XR system, the XR user interface comprising a virtual object displayed to a user;

detecting a pinch gesture being made by the user, a selection location of the pinch gesture within a boundary of the virtual object;

determining an offset vector from a center point of the virtual object to the selection location;

generating a translated virtual object by translating the virtual object using the offset vector and a current location of the pinch gesture; and

displaying the translated virtual object to the user in the XR user interface.

2 . The machine-implemented method of claim 1 , wherein detecting the pinch gesture comprises determining that a thumb portion and an index finger portion of a hand of the user are within a threshold distance of each other.

3 . The machine-implemented method of claim 1 , wherein the boundary of the virtual object comprises a collision boundary defined by a collider object associated with the virtual object.

4 . The machine-implemented method of claim 1 , wherein detecting the pinch gesture comprises using a machine learning model trained to detect pinch gestures.

5 . The machine-implemented method of claim 1 , further comprising:

detecting that the pinch gesture has ended based on a thumb portion and an index finger portion of a hand of the user exceeding a threshold distance from each other.

6 . The machine-implemented method of claim 1 , wherein translating the virtual object comprises updating a position of the virtual object relative to a center point defined for the virtual object.

7 . The machine-implemented method of claim 1 , further comprising:

while the pinch gesture is held by the user, repeating the operations of:

determining the current location of the pinch gesture;

generating the translated virtual object by translating the virtual object using the offset vector, the current location of the pinch gesture, and the center point of the virtual object; and

displaying the translated virtual object to the user in the XR user interface.

8 . A machine comprising:

at least one processor; and

at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:

providing an extended Reality (XR) user interface of an XR system, the XR user interface comprising a virtual object displayed to a user;

detecting a pinch gesture being made by the user, a selection location of the pinch gesture within a boundary of the virtual object;

determining an offset vector from a center point of the virtual object to the selection location;

generating a translated virtual object by translating the virtual object using the offset vector and a current location of the pinch gesture; and

displaying the translated virtual object to the user in the XR user interface.

9 . The machine of claim 8 , wherein detecting the pinch gesture comprises determining that a thumb portion and an index finger portion of a hand of the user are within a threshold distance of each other.

10 . The machine of claim 8 , wherein the boundary of the virtual object comprises a collision boundary defined by a collider object associated with the virtual object.

11 . The machine of claim 8 , wherein detecting the pinch gesture comprises using a machine learning model trained to detect pinch gestures.

12 . The machine of claim 8 , wherein the operations further comprise:

detecting that the pinch gesture has ended based on a thumb portion and an index finger portion of a hand of the user exceeding a threshold distance from each other.

13 . The machine of claim 8 , wherein translating the virtual object comprises updating a position of the virtual object relative to a center point defined for the virtual object.

14 . The machine of claim 8 , wherein the operations further comprise:

while the pinch gesture is held by the user, repeating the operations of:

determining the current location of the pinch gesture;

generating the translated virtual object by translating the virtual object using the offset vector, the current location of the pinch gesture, and the center point of the virtual object; and

displaying the translated virtual object to the user in the XR user interface.

15 . A machine-storage medium, the machine-storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:

providing an extended Reality (XR) user interface of an XR system, the XR user interface comprising a virtual object displayed to a user;

detecting a pinch gesture being made by the user, a selection location of the pinch gesture within a boundary of the virtual object;

determining an offset vector from a center point of the virtual object to the selection location;

generating a translated virtual object by translating the virtual object using the offset vector and a current location of the pinch gesture; and

displaying the translated virtual object to the user in the XR user interface.

16 . The machine-storage medium of claim 15 , wherein detecting the pinch gesture comprises determining that a thumb portion and an index finger portion of a hand of the user are within a threshold distance of each other.

17 . The machine-storage medium of claim 15 , wherein the boundary of the virtual object comprises a collision boundary defined by a collider object associated with the virtual object.

18 . The machine-storage medium of claim 15 , wherein detecting the pinch gesture comprises using a machine learning model trained to detect pinch gestures.

19 . The machine-storage medium of claim 15 , wherein the operations further comprise:

detecting that the pinch gesture has ended based on a thumb portion and an index finger portion of a hand of the user exceeding a threshold distance from each other.

20 . The machine-storage medium of claim 15 , wherein the operations further comprise:

while the pinch gesture is held by the user, repeating the operations of:

determining the current location of the pinch gesture;

generating the translated virtual object by translating the virtual object using the offset vector, the current location of the pinch gesture, and the center point of the virtual object; and

displaying the translated virtual object to the user in the XR user interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 2, 2024
From: SPONG, MASON
To: SNAP INC.
Reel/Frame 065997/0833 →
Continuity (1)
Related Publication 20250216948A1 · Jul 3, 2025
References Cited (92)
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 7996793B2 · Latta et al. · 2011 [cited by applicant]
US 8487938B2 · Latta et al. · 2013 [cited by applicant]
US 8856691B2 · Geisner et al. · 2014 [cited by applicant]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9230160B1 · Kanter · 2016 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10579869B1 · Xiong et al. · 2020 [cited by applicant]
US 10591730B2 · Rodriguez, II et al. · 2020 [cited by applicant]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11307747B2 · Dancie et al. · 2022 [cited by applicant]
US 11372529B1 · Jain · 2022 [cited by examiner]
US 11531402B1 · Stolzenberg · 2022 [cited by applicant]
US 11546505B2 · Canberk · 2023 [cited by applicant]
US 20090012788A1 · Gilbert et al. · 2009 [cited by applicant]
US 20110301934A1 · Tardif · 2011 [cited by applicant]
US 20140171036A1 · Simmons · 2014 [cited by applicant]
US 20150120293A1 · Wohlert et al. · 2015 [cited by applicant]
US 20150370320A1 · Connor · 2015 [cited by applicant]
US 20170123487A1 · Hazra et al. · 2017 [cited by applicant]
US 20170277684A1 · Dharmarajan Mary · 2017 [cited by applicant]
US 20170277685A1 · Takumi · 2017 [cited by applicant]
US 20170351910A1 · Elwazer et al. · 2017 [cited by applicant]
US 20180158370A1 · Pryor · 2018 [cited by applicant]
US 20190146219A1 · Rodriguez, II · 2019 [cited by applicant]
US 20190362562A1 · Benson · 2019 [cited by examiner]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210174034A1 · Retek et al. · 2021 [cited by applicant]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210295602A1 · Scapel · 2021 [cited by examiner]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
US 20210405761A1 · Canberk · 2021 [cited by applicant]
US 20220188539A1 · Chan et al. · 2022 [cited by applicant]
US 20220206588A1 · Canberk et al. · 2022 [cited by applicant]
US 20220300730A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220300731A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220301231A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220326781A1 · Hwang et al. · 2022 [cited by applicant]
US 20220334649A1 · Hwang et al. · 2022 [cited by applicant]
US 20220375174A1 · Arya et al. · 2022 [cited by applicant]
US 20240377893A1 · Yoon · 2024 [cited by examiner]
CN 103049761 · 2016 [cited by applicant]
EP 3707693 · 2020 [cited by applicant]
EP 4172726 · 2023 [cited by applicant]
EP 4172730 · 2023 [cited by applicant]
KR 20220158824 · 2022 [cited by applicant]
WO 2016168591 · 2016 [cited by applicant]
WO 2019094618 · 2019 [cited by applicant]
WO 2022005687 · 2022 [cited by applicant]
WO 2022005693 · 2022 [cited by applicant]
WO 2022060549 · 2022 [cited by applicant]
WO 2022066578 · 2022 [cited by applicant]
WO 2022132381 · 2022 [cited by applicant]
WO 2022146678 · 2022 [cited by applicant]
WO 2022198182 · 2022 [cited by applicant]
WO 2022216784 · 2022 [cited by applicant]
WO 2022225761 · 2022 [cited by applicant]
WO 2022245765 · 2022 [cited by applicant]
WO 2023176420 · 2023 [cited by applicant]
WO 2025147391 · 2025 [cited by applicant]
“International Application Serial No. PCT US2024 060753, International Search Report mailed Apr. 4, 2025”, 5 pgs. [cited by applicant]
“International Application Serial No. PCT US2024 060753, Written Opinion mailed Apr. 4, 2025”, 6 pgs. [cited by applicant]
Changming, He, “A Novel Human Computer Interaction Paradigm for Volume Visualization in Projection-Based Virtual Environments”, Smart Graphics; [Lecture Notes In Computer Science;;LNCS], Springer Berlin Heidelberg, Berl… [cited by applicant]