IP Library Granted Patent US 12,208,326
Granted Patent B2
US 12,208,326 · App. 18/281,281 · Granted Jan 28, 2025

Virtual automatic aiming

Inventor: Gregory Peng (Bellevue, WA)
Assignee: Bungie, Inc.
A63F13/426A63F13/2145A63F13/79
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,208,326
App. No.
18/281,281
Filed
Sep 8, 2023
Granted
Jan 28, 2025
Kind
B2
Art Unit
3715
USPC
463/31
Abstract

Described herein are techniques for implementing a virtualized physical controller. The techniques may comprise displaying, on a touchscreen display, an origin object and a set of potential target objects, receiving, from a user via the touchscreen display, a touch input associated with an action to be performed with respect to the origin object, determining, based on the action, a target object of the set of potential target objects on which the action is to be performed, changing a facing of the origin object to be directed toward the target object, and causing the action to be performed by the origin object on the target object.

Claims (36)

1. A method for virtual automatic aiming, the method comprising:

generating a display of one or more virtual controller input options to present on a touchscreen that includes a display of an origin object and a set of potential target objects;

receiving a touch input at a location on the touchscreen, wherein the virtual controller input option at the location is associated with an action to be performed by the origin object;

determining a target object from among the set of potential target objects based on the action and stored preference data that includes historic object targeting patterns;

changing a direction of a facing of the origin object based on a relative location of the determined target object with respect to the origin object; and

causing the action to be performed by the origin object toward the determined target object.

2. The method of claim 1 , wherein determining the target object from among the set of potential target objects includes excluding a subset of the set of potential target objects determined to be outside one or more volumes associated with the action.

3. The method of claim 2 , further comprising determining the one or more volumes associated with the action based at least in part on a range of distance associated with the action.

4. The method of claim 2 , further comprising determining the one or more volumes associated with the action based at least in part on a conical section expanding from the origin object in the direction of the facing.

5. The method of claim 1 , wherein changing the direction of the facing of the origin object includes rotating a direction of a front of the origin object to point toward the determined target object.

6. The method of claim 1 , wherein the action includes moving toward the determined target object.

7. The method of claim 1 , wherein the historic object targeting patterns further include data regarding one or more of a distance between the origin object and one or more of the potential target objects, an angle between the origin object and one or more of the potential target objects, and type of one or more of the potential target objects.

8. The method of claim 1 , wherein the stored preference data includes information provided during a configuration phase.

9. The method of claim 1 , further comprising generating ranking data based on the historic object targeting patterns, wherein determining the target object is further based on the ranking data.

10. A user device for virtual automatic aiming, the device comprising:

a touchscreen configured to display an origin object and a set of potential target objects; and

a processor that executes instructions stored in a memory to:

generate a display of one or more virtual controller input options to present on the touchscreen;

detect a touch input at a location on the touchscreen, wherein the virtual controller input option at the location is associated with an action to be performed by the origin object;

determine a target object from among the set of potential target objects based on the action and stored preference data that includes historic object targeting patterns;

change a direction of a facing of the origin object based on a relative location of the determined target object with respect to the origin object; and

cause the action to be performed by the origin object toward the determined target object.

11. The device of claim 10 , wherein the processor determines the target object from among the set of potential target objects by excluding a subset of the set of potential target objects determined to be outside one or more volumes associated with the action.

12. The device of claim 11 , wherein the processor executes further instructions to determine the one or more volumes associated with the action based at least in part on a range of distance associated with the action.

13. The device of claim 11 , wherein the processor executes further instructions to determine the one or more volumes associated with the action based at least in part on a conical section expanding from the origin object in the direction of the facing.

14. The device of claim 10 , wherein the processor changes the direction of the facing of the origin object by rotating a direction of a front of the origin object to point toward the determined target object.

15. The device of claim 10 , wherein the action includes moving toward the determined target object.

16. The device of claim 10 , wherein the historic object targeting patterns further include data regarding one or more of a distance between the origin object and one or more of the potential target objects, an angle between the origin object and one or more of the potential target objects, and type of one or more of the potential target objects.

17. The device of claim 10 , wherein the stored preference data includes information provided during a configuration phase.

18. The device of claim 10 , wherein the processor executes further instructions to generate ranking data based on the historic object targeting patterns, wherein determining the target object is further based on the ranking data.

19. A non-transitory, computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for virtual automatic aiming, the method comprising:

generating a display of one or more virtual controller input options to present on a touchscreen that includes a display of an origin object and a set of potential target objects;

receiving a touch input at a location on the touchscreen, wherein the virtual controller input option at the location is associated with an action to be performed by the origin object;

determining a target object from among the set of potential target objects based on the action and stored preference data that includes historic object targeting patterns;

changing a direction of a facing of the origin object based on a relative location of the determined target object with respect to the origin object; and

causing the action to be performed by the origin object toward the determined target object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2026
From: BUNGIE, INC.
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 074404/0767 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2023
From: PENG, GREGORY
To: BUNGIE, INC.
Reel/Frame 064911/0576 →
Continuity (2)
Provisional Application 63158961 · Mar 10, 2021
Related Publication 20240149155A1 · May 9, 2024
References Cited (126)
US 6582299B1 · Matsuyama · 2003 [cited by examiner]
US 6626759B1 · Matsuoka · 2003 [cited by applicant]
US 8979652B1 · Ciszewski et al. · 2015 [cited by applicant]
US 9004997B1 · Prosin · 2015 [cited by examiner]
US 9238175B2 · Ciszewski et al. · 2016 [cited by applicant]
US 9764226B2 · Prosin · 2017 [cited by examiner]
US 10388053B1 · Carter et al. · 2019 [cited by applicant]
US 10994205B2 · Takafuji et al. · 2021 [cited by applicant]
US 11511191B2 · Zhuang et al. · 2022 [cited by applicant]
US 11596866B1 · McCain et al. · 2023 [cited by applicant]
US 11794107B2 · Kutcher · 2023 [cited by applicant]
US 12097432B2 · Timmins · 2024 [cited by applicant]
US 20030032478A1 · Takahama et al. · 2003 [cited by applicant]
US 20070270215A1 · Miyamoto · 2007 [cited by examiner]
US 20090181736A1 · Haigh-Hutchinson · 2009 [cited by examiner]
US 20100009733A1 · Garvin · 2010 [cited by examiner]
US 20100009734A1 · Sambongi · 2010 [cited by examiner]
US 20110165939A1 · Borst et al. · 2011 [cited by applicant]
US 20120011464A1 · Hayashi · 2012 [cited by examiner]
US 20120322522A1 · Ishikawa et al. · 2012 [cited by applicant]
US 20120322523A1 · Woodard · 2012 [cited by examiner]
US 20130079140A1 · Watkins et al. · 2013 [cited by applicant]
US 20130196767A1 · Garvin et al. · 2013 [cited by applicant]
US 20140179430A1 · Miyamoto et al. · 2014 [cited by applicant]
US 20150034722A1 · Roman · 2015 [cited by examiner]
US 20150157940A1 · Hall · 2015 [cited by examiner]
US 20150258439A1 · Prosin · 2015 [cited by examiner]
US 20150273333A1 · Ciszewski · 2015 [cited by examiner]
US 20150356781A1 · Miller · 2015 [cited by applicant]
US 20180264364A1 · Zou · 2018 [cited by applicant]
US 20180292952A1 · Norman et al. · 2018 [cited by applicant]
US 20190381403A1 · Lin et al. · 2019 [cited by applicant]
US 20200038756A1 · Takafuji et al. · 2020 [cited by applicant]
US 20200094135A1 · Miao · 2020 [cited by applicant]
US 20200122025A1 · Tsuchiya et al. · 2020 [cited by applicant]
US 20200376383A1 · Guimaraes · 2020 [cited by examiner]
US 20220137800A1 · Long et al. · 2022 [cited by applicant]
US 20220193550A1 · Wang et al. · 2022 [cited by applicant]
US 20220203237A1 · Kutcher · 2022 [cited by applicant]
US 20220266144A1 · Zhuang et al. · 2022 [cited by applicant]
US 20230099016A1 · McCain et al. · 2023 [cited by applicant]
US 20230241496A1 · Vaught et al. · 2023 [cited by applicant]
US 20230249076A1 · Lin et al. · 2023 [cited by applicant]
US 20230277941A1 · Fukada et al. · 2023 [cited by applicant]
US 20240042322A1 · Timmins · 2024 [cited by applicant]
AU 2022234397 · 2024 [cited by applicant]
CA 3212973 · 2022 [cited by applicant]
CA 3212975 · 2022 [cited by applicant]
CN 110975289 · 2020 [cited by applicant]
CN 111068324 · 2020 [cited by applicant]
CN 111714891A · 2020 [cited by applicant]
CN 111773724A · 2020 [cited by applicant]
CN 112306351 · 2021 [cited by applicant]
CN 116963810 · 2023 [cited by applicant]
CN 116964551 · 2023 [cited by applicant]
EP 4284527A · 2023 [cited by applicant]
EP 4288861A · 2023 [cited by applicant]
IL 305744A · 2023 [cited by applicant]
IL 305745A · 2023 [cited by applicant]
IL 305744B · 2024 [cited by applicant]
JP 2020039947A · 2020 [cited by applicant]
JP 2024509788 · 2024 [cited by applicant]
JP 2024512246 · 2024 [cited by applicant]
JP 7532679 · 2024 [cited by applicant]
JP 7532682 · 2024 [cited by applicant]
KR 1020130027621A · 2013 [cited by applicant]
KR 20130027621A · 2013 [cited by applicant]
KR 20150095999A · 2015 [cited by applicant]
KR 20150116299A · 2015 [cited by applicant]
KR 1020170001539A · 2017 [cited by applicant]
KR 20170001539A · 2017 [cited by applicant]
KR 1020180119002 · 2018 [cited by applicant]
MX MXa2023010554 · 2023 [cited by applicant]
MX MXa2023010555 · 2023 [cited by applicant]
WO WO2022192493 · 2022 [cited by applicant]
WO WO2022192495 · 2022 [cited by applicant]
International Patent Application No. PCT/US2022/019685, International Search Report and Written Opinion mailed Jun. 21, 2022, 9 pages. [cited by applicant]
PCT Application No. PCT/US2022/019682, International Search Report and Written Opinion mailed Jun. 10, 2022, 8 pages. [cited by applicant]
PCT Application No. PCT/US2022/019682, International Preliminary Report on Patentability mailed Sep. 12, 2023, 4 pages. [cited by applicant]
PCT Application No. PCT/US2022/019685, International Preliminary Report on Patentability mailed Sep. 12, 2023, 4 pages. [cited by applicant]
New Zealand Application No. 803265, Examination Report dated Sep. 20, 2023. [cited by applicant]
Japanese Application No. 2023-551983, Office Action dated Feb. 20, 2024. [cited by applicant]
Japanese Application No. 2023-550046, Office Action dated Feb. 20, 2024. [cited by applicant]
Canadian Application No. 3212973, Examiner's Report dated Oct. 4, 2023. [cited by applicant]
Canadian Application No. 3212975, Examiner's Report dated Dec. 27, 2023. [cited by applicant]
Australian Application No. 2022232621, Examination Report No. 1 dated Oct. 24, 2023. [cited by applicant]
Australian Application No. 2022234397, Examination Report No. 1 dated Oct. 13, 2023. [cited by applicant]
PCT/US2022/019685, Gregory Peng, Virtual Automatic Aiming, Mar. 10, 2022. [cited by applicant]
P6002246/2023, Gregory Peng, Virtual Automatic Aiming, Sep. 7, 2023. [cited by applicant]
2022234397, Gregory Peng, Virtual Automatic Aiming, Sep. 7, 2023. [cited by applicant]
3212975, Gregory Peng, Virtual Automatic Aiming, Sep. 8, 2023. [cited by applicant]
202280020327.8, Gregory Peng, Virtual Automatic Aiming, Sep. 8, 2023. [cited by applicant]
22767961.0, Gregory Peng, Virtual Automatic Aiming, Sep. 6, 2023. [cited by applicant]
305744, Gregory Peng, Virtual Automatic Aiming, Sep. 7, 2023. [cited by applicant]
2023-550046, Gregory Peng, Virtual Automatic Aiming, Aug. 18, 2023. [cited by applicant]
MX/a/2023/010555, Gregory Peng, Virtual Automatic Aiming, Sep. 7, 2023. [cited by applicant]
803479, Gregory Peng, Virtual Automatic Aiming, Sep. 7, 2023. [cited by applicant]
2023124999, Gregory Peng, Virtual Automatic Aiming, Sep. 29, 2023. [cited by applicant]
523450615, Gregory Peng, Virtual Automatic Aiming, Sep. 10, 2023. [cited by applicant]
PCT/US2022/019682, Luke Timmins, Markup Free Ledge Grab, Mar. 10, 2022. [cited by applicant]
P6002251/2023, Luke Timmins, Markup Free Ledge Grab, Sep. 7, 2023. [cited by applicant]
2022232621, Luke Timmins, Markup Free Ledge Grab, Aug. 31, 2023. [cited by applicant]
3212973, Luke Timmins, Markup Free Ledge Grab, Sep. 8, 2023. [cited by applicant]
202280020245.3, Luke Timmins, Markup Free Ledge Grab, Sep. 8, 2023. [cited by applicant]
22767959.4, Luke Timmins, Markup Free Ledge Grab, Sep. 1, 2023. [cited by applicant]
305745, Luke Timmins, Markup Free Ledge Grab, Sep. 7, 2023. [cited by applicant]
2023-551983, Luke Timmins, Markup Free Ledge Grab, Aug. 25, 2023. [cited by applicant]
MX/a/2023/010554, Luke Timmins, Markup Free Ledge Grab, Sep. 7, 2023. [cited by applicant]
803265, Luke Timmins, Markup Free Ledge Grab, Aug. 31, 2023. [cited by applicant]
2023124998, Luke Timmins, Markup Free Ledge Grab, Sep. 29, 2023. [cited by applicant]
523450619, Luke Timmins, Markup Free Ledge Grab, Sep. 10, 2023. [cited by applicant]
Canadian Application No. 3212973, Examiner's Report dated Apr. 29, 2024. [cited by applicant]
Israeli Application No. 305745, Office Action dated Mar. 5, 2024. [cited by applicant]
U.S. Appl. No. 18/281,281, Non-Final Office Action dated May 9, 2024. [cited by applicant]
Australian Application No. 2022232621, Examination Report No. 2 dated May 20, 2024. [cited by applicant]
Australian Application No. 2022234397, Examination Report No. 2 dated May 15, 2024. [cited by applicant]
Canadian Application No. 3212975, Examiner's Report dated Jun. 5, 2024. [cited by applicant]
Chinese Application No. 202280020245.3, First Office Action dated Mar. 8, 2024. [cited by applicant]
Mexican Application No. MX/a/2023/010554, Office Action dated Apr. 9, 2024. [cited by applicant]
Mexican Application No. MX/a/2023/010555, Office Action dated Apr. 9, 2024. [cited by applicant]
U.S. Appl. No. 18/281,280, Non-Final Office Action dated Dec. 22, 2023. [cited by applicant]
Australian Application No. 2022232621, Examination Report No. 3 dated Aug. 19, 2024. [cited by applicant]
Australian Application No. 2022234397, Examination Report No. 3 dated Aug. 8, 2024. [cited by applicant]
European Application No. 22767959.4, Extended European Search Report dated Aug. 29, 2024. [cited by applicant]
European Application No. 22767961.0, Extended European Search Report dated Jul. 31, 2024. [cited by applicant]
Chinese Application No. 202280020245.3, Second Office Action dated Oct. 26, 2024. [cited by applicant]
Cited By (3)
US 12,440,766 US 12,521,631 US 12,667,784