Granted Patent B1

US 11,169,600 · App. 16/950,137 · Granted Nov 9, 2021

Inventors: Ilteris Canberk (Marina del Rey, CA); Dhritiman Sagar (Marina del Rey, CA); Mathieu Vignau (Los Angeles, CA)

Assignee: Snap Inc.

G06F3/012G02B21/006G02B27/0101G02B27/0172G06T19/006G02B2027/0138

Abstract

Claims (69)

1. A method of displaying a virtual object, said method comprising:

initiating a face-tracking application on a mobile device to identify a face of a user wearing a wearable device relative to a three-dimensional coordinate system, the wearable device having a display;

locating said wearable device relative to said coordinate system; and

rendering a virtual object on said display in a first location along a path relative to said coordinate system.

2. The method of claim 1 , further comprising:

receiving from said face-tracking application track data associated with a track traveled by said wearable device in motion; and

displaying said virtual object on said display in a second location along said path based on said track data, such that said path of said virtual object is substantially linked to said track traveled by said wearable device.

3. The method of claim 1 , further comprising:

receiving from said face-tracking application course data associated with a course traveled by said mobile device in motion; and

displaying said virtual object on said display in a third location along said path based on said course data, such that said path of said virtual object is substantially linked to said course traveled by said mobile device.

4. The method of claim 1 , further comprising:

receiving from said face-tracking application track data associated with a track traveled by said wearable device in motion;

receiving from said face-tracking application course data associated with a course traveled by said mobile device in motion; and

displaying said virtual object on said display in a subsequent location along said path based on said track data and said course data, such that said path of said virtual object is substantially linked both to said track traveled by said wearable device and to said course traveled by said mobile device.

5. The method of claim 4 , wherein said wearable device further comprises a processor and a memory, and wherein said step of displaying said virtual object comprises:

said processor receiving said track data;

said processor receiving said course data; and

said processor computing said subsequent location along said path.

6. The method of claim 1 , wherein said step of initiating a face-tracking application further comprises:

engaging a camera coupled to and supported by said mobile device; and

acquiring via said camera one or more anchors associated with said face;

and wherein said method further comprises:

selectively suspending said step of acquiring after said wearable device is located, such that a second face is not acquired by said face-tracking application.

7. The method of claim 1 , wherein said display is semi-transparent and facilitates a view of a physical environment, and wherein said step of displaying said virtual object further comprises:

overlaying said virtual object onto said view of said physical environment, such that said virtual object is persistently viewable along said path relative to said physical environment.

8. The method of claim 1 , wherein said step of rendering said virtual object in a first location along a path further comprises:

locating said mobile device relative to said coordinate system;

estimating a hand position of a hand holding said mobile device relative to said coordinate system; and

overlaying said virtual object near said hand position, such that said hand appears to be grasping said virtual object.

9. The method of claim 1 , wherein said wearable device further comprises a processor, a memory, a projector, and at least one lens assembly configured and positioned to function as said display; and

wherein said step of rendering said virtual object further comprises projecting said virtual object via said projector onto said display.

10. The method of claim 1 , further comprising:

opening an experience application on said wearable device;

and wherein said step of rendering said virtual object further comprises:

selecting said virtual object from a collection of objects associated with said experience application.

11. A system comprising:

a wearable device comprising a processor, a memory, and a display;

a mobile device comprising a central processor, a local memory, and a transceiver configured for wireless communication with said processor;

programming in said memory, wherein execution of said programming by said processor configures said wearable device to perform functions, including functions to:

initiate a face-tracking application on said mobile device to identify a face relative to a three-dimensional coordinate system, and to locate said wearable device relative to said coordinate system; and

render a virtual object on said display in a first location along a path relative to said coordinate system.

12. The system of claim 11 , wherein said execution further configures said wearable device to:

receive from said face-tracking application track data associated with a track traveled by said wearable device in motion;

receive from said face-tracking application course data associated with a course traveled by said mobile device in motion; and

display said virtual object on said display in a subsequent location along said path based on said track data and said course data, such that said path of said virtual object is substantially linked both to said track traveled by said wearable device and to said course traveled by said mobile device.

13. The system of claim 11 , wherein said face-tracking application performs a function of acquiring said face, and wherein said execution further configures said wearable device to:

selectively suspend said step of acquiring after said wearable device is located, such that a second face is not acquired by said face-tracking application.

14. The system of claim 11 , wherein said display is semi-transparent and facilitates a view of a physical environment, and wherein said execution further configures said wearable device to:

overlay overlaying said virtual object onto said view of said physical environment, such that said virtual object is persistently viewable along said path relative to said physical environment.

15. The system of claim 11 , wherein said execution further configures said wearable device to:

estimate a hand position of a hand holding said mobile device relative to said coordinate system; and

overlay said virtual object near said hand position, such that said hand appears to be grasping said virtual object.

16. The system of claim 11 , wherein said wearable device further comprises a projector and at least one lens assembly configured and positioned to function as said display; and

wherein execution further configures said wearable device to project said virtual object via said projector onto said display.

17. The system of claim 11 , wherein execution further configures said wearable device to:

open an experience application on said wearable device; and

select said virtual object from a collection of objects associated with said experience application.

18. A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor to perform the steps of:

initiating a face-tracking application on a mobile device to identify said face relative to a three-dimensional coordinate system;

locating said wearable device relative to said coordinate system; and

rendering a virtual object onto a display in a first location along a path relative to said coordinate system, wherein said display is coupled to and supported by a wearable device.

19. The non-transitory computer-readable medium of claim 18 , further comprising:

receiving from said face-tracking application track data associated with a track traveled by said wearable device in motion;

receiving from said face-tracking application course data associated with a course traveled by said mobile device in motion; and

displaying said virtual object on said display in a subsequent location along said path based on said track data and said course data, such that said path of said virtual object is substantially linked both to said track traveled by said wearable device and to said course traveled by said mobile device.

20. The non-transitory computer-readable medium of claim 18 , wherein said step of rendering said virtual object in a first location along a path further comprises:

locating said mobile device relative to said coordinate system;

estimating a hand position of a hand holding said mobile device relative to said coordinate system; and

overlaying said virtual object near said hand position, such that said hand appears to be grasping said virtual object.

Assignments (1)

Continuity (1)

Cited By (116)

US 12,190,739 US 12,200,399 US 12,204,105 US 12,204,693 US 12,204,807 US 12,210,736 US 12,212,536 US 12,216,823 US 12,216,827 US 12,217,367 US 12,223,402 US 12,229,342 US 12,231,437 US 12,236,148 US 12,236,512 US 12,244,552 US 12,265,663 US 12,265,664 US 12,266,057 US 12,271,517 US 12,271,532 US 12,271,586 US 12,277,632 US 12,282,607 US 12,287,647 US 12,288,298 US 12,299,798 US 12,300,275 US 12,307,287 US 12,314,472 US 12,314,485 US 12,327,302 US 12,332,438 US 12,333,658 US 12,340,142 US 12,344,409 US 12,348,855 US 12,353,628 US 12,353,840 US 12,360,531 US 12,360,663 US 12,361,648 US 12,361,664 US 12,367,606 US 12,367,616 US 12,372,975 US 12,373,096 US 12,374,055 US 12,380,618 US 12,380,925 US 12,382,188 US 12,387,403 US 12,393,613 US 12,401,772 US 12,405,672 US 12,405,675 US 12,406,448 US 12,411,555 US 12,412,347 US 12,423,910 US 12,429,953 US 12,432,441 US 12,437,491 US 12,443,270 US 12,443,325 US 12,443,335 US 12,450,851 US 12,452,384 US 12,456,263 US 12,462,507 US 12,468,395 US 12,468,396 US 12,468,439 US 12,469,090 US 12,469,219 US 12,482,171 US 12,494,078 US 12,498,783 US 12,498,793 US 12,517,521 US 12,518,490 US 12,524,146 US 12,530,086 US 12,530,088 US 12,531,959 US 12,547,295 US 12,547,309 US 12,572,216 US 12,572,261 US 12,573,100 US 12,580,784 US 12,608,126 US 12,614,567 US 12,626,455 US 12,632,984 US 12,633,061 US 12,638,951 US 12,641,190 US 12,650,732 US 12,656,875 US 12,656,876 US 12,657,753 US 12,670,643 US 12,670,674 US 12,675,168 US 12,675,169 US 12,693,770 US 12,700,187 US 12,705,009 US 12,710,807 US 12,712,835 US 12,726,454 US 12,731,341 US 12,731,342 US 12,737,053 US 12,746,455