IP Library Granted Patent US 10,488,941
Granted Patent B2
US 10,488,941 · App. 16/198,691 · Granted Nov 26, 2019

Combining virtual reality and augmented reality

Inventors: Pak Kit Lam (Kowloon, HK); Peter Han Joo Chong (Kowloon, HK)
Assignee: Zyetric Technologies Limited
G06F3/017A63F13/213A63F13/2145G06F3/04845G06F3/04883A63F2300/1075A63F2300/1093A63F2300/8082G06F3/0346G06F2203/04808G06K9/00355G06T19/006G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,488,941
App. No.
16/198,691
Filed
Nov 21, 2018
Granted
Nov 26, 2019
Kind
B2
Art Unit
2693
USPC
345/156
Abstract

At an electronic device having a display, a first sensor, and a second sensor different than the first sensor, a view is displayed on the display. The view includes an interface object at a first location. A first gesture is detected based on first data from the first sensor, wherein the first gesture identifies the interface object. A second gesture is detected based on second data from the second sensor. A second location is determined for the interface object based on the second gesture. The display of the interface object is updated from the first location to the second location in the view.

Claims (41)

1. A method, comprising:

at an electronic device having a display, a first sensor, and a second sensor different than the first sensor:

displaying a view on the display, wherein the view includes an interface object at a first location, wherein the view includes image data from an image sensor of the electronic device and graphical elements generated by the electronic device overlaid onto the image data;

detecting a first gesture based on first data from the first sensor, wherein the first gesture identifies the interface object;

detecting a second gesture based on second data from the second sensor;

determining a second location for the interface object based on the second gesture; and

updating the display of the interface object from the first location to the second location in the view.

2. The method of claim 1 , wherein the electronic device further includes a third sensor different than the first sensor and the second sensor, wherein detecting the second gesture is further based on third data from the third sensor.

3. The method of claim 1 , wherein the first sensor is a first image sensor on a first side of the electronic device and the second sensor is a second image sensor on a second side of the electronic device different than the first side.

4. The method claim 1 , wherein the second sensor is a touch screen sensor integrated over the display.

5. The method of claim 1 , wherein the first sensor is the image sensor.

6. The method of claim 5 , wherein the first gesture is a hand movement in the field of view of the image sensor.

7. The method of claim 1 , wherein the first sensor is a first image sensor on a first side of the electronic device and the second sensor is a touch screen sensor on a second side of the electronic device different than the first side.

8. The method of claim 1 , wherein the interface object is a graphical element generated by the electronic device.

9. The method of claim 1 , wherein the view is of an augmented reality environment.

10. The method of claim 1 , wherein the first data and the second data represent movement of one hand of a user of the electronic device.

11. The method of claim 1 , wherein the first data represent movement of one hand of a user of the electronic device and the second data represent movement of the electronic device.

12. The method of claim 1 , wherein the first data represents movement of one hand of a user of the electronic device and the second data represents other movement of the user of the device.

13. A non-transitory computer-readable storage medium encoded with a computer program executable by an electronic device having a display, a first sensor, and a second sensor different than the first sensor, the computer program comprising instructions for:

displaying a view on the display, wherein the view includes an interface object at a first location, wherein the view includes image data from an image sensor of the electronic device and graphical elements generated by the electronic device overlaid onto the image data;

detecting a first gesture based on first data from the first sensor, wherein the first gesture identifies the interface object;

detecting a second gesture based on second data from the second sensor;

determining a second location for the interface object based on the second gesture; and

updating the display of the interface object from the first location to the second location in the view.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the electronic device further includes a third sensor different than the first sensor and the second sensor, wherein detecting the second gesture is further based on third data from the third sensor.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the first sensor is a first image sensor on a first side of the electronic device and the second sensor is a second image sensor on a second side of the electronic device different than the first side.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the second sensor is a touch screen sensor integrated over the display.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the first sensor is the image sensor.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the first gesture is a hand movement in the field of view of the image sensor.

19. The non-transitory computer-readable storage medium of claim 13 , wherein the first sensor is a first image sensor on a first side of the electronic device and the second sensor is a touch screen sensor on a second side of the electronic device different than the first side.

20. An electronic device comprising:

a display;

a first sensor;

a second sensor different than the first sensor;

a processor;

memory encoded with a computer program executable by the processor, the computer program having instructions for:

displaying a view on the display, wherein the view includes an interface object at a first location, wherein the view includes image data from an image sensor of the electronic device and graphical elements generated by the electronic device overlaid onto the image data;

detecting a first gesture based on first data from the first sensor, wherein the first gesture identifies the interface object;

detecting a second gesture based on second data from the second sensor;

determining a second location for the interface object based on the second gesture; and

updating the display of the interface object from the first location to the second location in the view.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2019
From: LAM, PAK KIT; CHONG, PETER HAN JOO
To: ZYETRIC TECHNOLOGIES LIMITED
Reel/Frame 048418/0745 →
Continuity (3)
Continuation PCTCN2017117746 · Dec 21, 2017
Provisional Application 62437539 · Dec 21, 2016
Related Publication 20190087015A1 · Mar 21, 2019
Cited By (35)
US 12,236,515 US 12,236,546 US 12,242,706 US 12,283,020 US 12,287,921 US 12,288,285 US 12,307,580 US 12,333,083 US 12,437,494 US 12,443,273 US 12,456,271 US 12,461,641 US 12,475,635 US 12,511,847 US 12,524,142 US 12,524,956 US 12,524,977 US 12,535,931 US 12,536,762 US 12,541,280 US 12,566,532 US 12,596,472 US 12,608,115 US 12,608,877 US 12,608,890 US 12,620,187 US 12,625,608 US 12,632,157 US 12,632,170 US 12,633,044 US 12,663,907 US 12,675,958 US 12,681,587 US 12,687,922 US 12,688,660