IP Library Granted Patent US 9,535,496
Granted Patent B2
US 9,535,496 · App. 13/840,268 · Granted Jan 3, 2017

Visual gestures

Inventor: Brian Mullins (Garden Grove, CA)
Assignee: DAQRI, LLC
G06F3/013G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,535,496
App. No.
13/840,268
Granted
Jan 3, 2017
Kind
B2
Abstract

Visual gestures in a device allow a user to select and activate features in a display of the device. A visual reference on a physical object is identified. A visualization of a virtual object engaged with an image of the physical object is generated in a display of a device. The virtual object corresponds to the visual reference. A rendering of the visualization of the virtual object is based a position of the display relative to the visual reference. A focus area in the display and a feature of the object are determined. A state of the feature is changed when the feature is in the focus area of the display.

Claims (48)

1. A device comprising:

a display;

a camera configured to generate an image that depicts a physical object; and

a virtual gesture application implemented by a hardware processor of the device and configured to perform operations comprising:

identify a visual reference on the physical object,

generate a virtual object corresponding to the visual reference,

rendering the virtual object in the display based a position of the display relative to the visual reference,

identifying a first and a second trigger area in the display, the first trigger area including a first predefined static area of the display, the second trigger area including a second predefined static area of the display, the first predefined static area being distinct from the second predefined static area,

determining that an interactive feature of the virtual object is located inside the first or second trigger area,

performing a first action on the interactive feature in response to the interactive feature being located inside the first trigger area and a second action on the interactive feature in response to the interactive feature being located inside the second trigger area, the first action being distinct from the second action.

2. The device of claim 1 , further comprising:

a storage device coupled to the processor, the storage device comprising a database configured to store visual references, virtual objects that correspond to the visual references, and features of the virtual objects, the features of the virtual objects being configured to change state when located in the first and second trigger area.

3. The device of claim 1 , wherein the first trigger area includes a first corner area of the display, the second trigger area includes a second corner area that is distinct from the first corner area.

4. The device of claim 3 , wherein the first trigger area includes an area located in the center of the display.

5. The device of claim 1 , wherein the first action is performed on the interactive feature in response to the interactive feature being located inside the first trigger area for a time duration exceeding a time threshold.

6. The device of claim 1 ,

wherein the first action is performed on the virtual object in response to the interactive feature being located inside the first trigger area, and the second action is performed on the virtual object in response to the interactive feature being located inside the second trigger area.

7. The device of claim 1 ,

wherein the first action includes replacing a first component of the virtual object with a second component of the virtual object in response to the interactive feature being located inside the first trigger area, and the second action includes replacing a third component of the virtual object with a fourth component of the virtual object in response to the interactive feature being located inside the second trigger area.

8. The device of claim 1 ,

wherein the first action causes the interactive feature to change to a first state in response to the interactive feature being located inside the first trigger area, and the second action causes the interactive feature to change to a second state in response to the interactive feature being located inside the second trigger area.

9. A computer-implemented method comprising:

identifying a visual reference on an image that depicts a physical object;

generating a virtual object corresponding to the visual reference;

rendering the virtual object in a display of a device based on a position of the display relative to the visual reference;

identifying a first and a second trigger area in the display, the first trigger area including a first predefined static area of the display, the second trigger area including a second predefined static area of the display, the first predefined static area being distinct from the second predefined static area;

determining that an interactive feature of the virtual object is located inside the first or second trigger area;

performing a first action on the interactive feature in response to the interactive feature being located inside the first trigger area; and

performing a second action on the interactive feature in response to the interactive feature being located inside the second trigger area.

10. The computer-implemented method of claim 9 , further comprising:

storing, in a database, visual references, virtual objects that correspond to the visual references, and features of the virtual objects, the features of the virtual objects being configured to change state when located in the first and second trigger area.

11. The computer-implemented method of claim 9 , wherein the first trigger area includes a first corner area of the display, the second trigger area includes a second corner area that is distinct from the first corner area.

12. The computer-implemented method of claim 11 , wherein the first trigger area includes an area located in the center of the display.

13. The computer-implemented method of claim 9 , wherein the first action is performed on the interactive feature in response to the interactive feature being located inside the first trigger area for a time duration exceeding a time threshold.

14. The computer-implemented method of claim 9 ,

wherein the first action is performed on the virtual object in response to the interactive feature being located inside the first trigger area, and the second action is performed on the virtual object in response to the interactive feature being located inside the second trigger area.

15. The computer-implemented method of claim 9 ,

wherein the first action includes replacing a first component of the virtual object with a second component of the virtual object in response to the interactive feature being located inside the first trigger area, and the second action includes replacing a third component of the virtual object with a fourth component of the virtual object in response to the interactive feature being located inside the second trigger area.

16. The computer-implemented method of claim 14 ,

wherein the first action causes the interactive feature to change to a first state in response to the interactive feature being located inside the first trigger area, and the second action causes the interactive feature to change to a second state in response to the interactive feature being located inside the second trigger area.

17. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

identifying a visual reference on an image that depicts a physical object;

generating a virtual object corresponding to the visual reference;

rendering the virtual object in a display of a device based on a position of the display relative to the visual reference;

identifying a first and a second trigger area in the display, the first trigger area including a first predefined static area of the display, the second trigger area including a second predefined static area of the display, the first predefined static area being distinct from the second predefined static area;

determining that an interactive feature of the virtual object is located inside the first or second trigger area;

performing a first action on the interactive feature in response to the interactive feature being located inside the first trigger area; and

performing a second action on the interactive feature in response to the interactive feature being located inside the second trigger area.

Assignments (14)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2014
From: MULLINS, BRIAN
To: DAQRI, INC
Reel/Frame 033546/0788 →
CHANGE OF NAME Recorded May 23, 2013
From: POEM INVESTOR GROUP, LLC
To: DAQRI, LLC
Reel/Frame 030488/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2013
From: DAQRI, INC.
To: POEM INVESTOR GROUP, LLC
Reel/Frame 030437/0590 →
Continuity (1)
Related Publication 20140267012A1 · Sep 18, 2014