IP Library Granted Patent US 11,967,032
Granted Patent B2
US 11,967,032 · App. 18/066,094 · Granted Apr 23, 2024

Augmented reality content experience sharing using digital multimedia files

Inventor: Yen-Lin Chen (San Jose, CA)
Assignee: Google LLC
G06T19/006G06F16/483G06F16/487G06T17/20G06V20/20G06V40/171
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,967,032
App. No.
18/066,094
Granted
Apr 23, 2024
Kind
B2
Abstract

A computer-implemented method includes capturing visual data of an environment using an image sensor of an electronic device and non-visual data of the environment using one or more non-image sensors of the electronic device. Feature descriptors of one or more objects in the environment are generated using the visual data of the environment and the non-visual data of the environment. A map of the environment is generated using the feature descriptors of the one or more objects. One or more virtual objects are anchored to at least one of the objects using the map. The visual data, the non-visual data, and the map are combined in a digital multimedia container file. The digital multimedia container file is stored on the electronic device or on another electronic device connected to the electronic device.

Claims (35)

1. A computer-implemented method, comprising:

recording an augmented reality session of an environment using an image sensor of an electronic device, wherein the augmented reality session includes one or more virtual objects inserted in the environment and the environment is located in a first geographic location;

storing the augmented reality session in a digital multimedia container file on the electronic device; and

playing back the augmented reality session of the environment on the electronic device from the digital multimedia container file in a second geographic location without using the image sensor, wherein the second geographic location is a different location than the first geographic location.

2. The computer-implemented method of claim 1 , wherein the digital multimedia container file is a moving picture experts group-4 (MPEG-4) format.

3. The computer-implemented method of claim 1 , wherein the digital multimedia container file is QuickTime (MOV) format.

4. The computer-implemented method of claim 1 , wherein:

recording the augmented reality session includes capturing visual data of the environment using the image sensor of the electronic device and non-visual data of the environment using one or more non-image sensors of the electronic device; and

storing the augmented reality session includes storing the visual data of the environment and the non-visual data of the environment using one or more customizable tracks in the digital multimedia container file.

5. The computer-implemented method of claim 1 , wherein the electronic device is a first electronic device, the computer-implemented method further comprising:

transferring the digital multimedia container file to a second electronic device; and

playing back the augmented reality session of the environment on the second electronic device from the digital multimedia container file in a third geographic location, wherein the third geographic location is a different location than the first geographic location.

6. A computer program product, the computer program product being tangibly embodied on a non-transitory computer-readable medium and including executable code that, when executed by an electronic device, is configured to cause the electronic device to:

record an augmented reality session of an environment using an image sensor of the electronic device, wherein the augmented reality session includes one or more virtual objects inserted in the environment and the environment is located in a first geographic location;

store the augmented reality session in a digital multimedia container file on the electronic device; and

play back the augmented reality session of the environment on the electronic device from the digital multimedia container file in a second geographic location without using the image sensor, wherein the second geographic location is a different location than the first geographic location.

7. The computer program product of claim 6 , wherein the digital multimedia container file is a moving picture experts group-4 (MPEG-4) format.

8. The computer program product of claim 6 , wherein the digital multimedia container file is QuickTime (MOV) format.

9. The computer program product of claim 6 , wherein:

recording the augmented reality session includes capturing visual data of the environment using the image sensor of the electronic device and non-visual data of the environment using one or more non-image sensors of the electronic device; and

storing the augmented reality session includes storing the visual data of the environment and the non-visual data of the environment using one or more customizable tracks in the digital multimedia container file.

10. The computer program product of claim 6 , wherein the electronic device is a first electronic device, and further comprising executable code that, when executed by the electronic device, is configured to cause the electronic device to:

transfer the digital multimedia container file to a second electronic device; and

play back the augmented reality session of the environment on the second electronic device from the digital multimedia container file in a third geographic location, wherein the third geographic location is a different location than the first geographic location.

11. A device, comprising:

an image sensor;

one or more non-image sensors;

a memory having instructions; and

a processor configured by the instructions to:

record an augmented reality session of an environment including visual data using the image sensor and non-visual data using the one or more non-image sensors, wherein the augmented reality session includes one or more virtual objects inserted in the environment and the environment is located in a first geographic location;

store the augmented reality session in a digital multimedia container file in the memory; and

play back the augmented reality session of the environment from the digital multimedia container file in a second geographic location without using the image sensor, wherein the second geographic location is a different location than the first geographic location.

12. The device of claim 11 , wherein the digital multimedia container file is a moving picture experts group-4 (MPEG-4) format.

13. The device of claim 11 , wherein the digital multimedia container file is QuickTime (MOV) format.

14. The device of claim 11 , wherein the processor is configured by the instructions to store the visual data of the environment and the non-visual data of the environment using one or more customizable tracks in the digital multimedia container file.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2022
From: CHEN, YEN-LIN
To: GOOGLE LLC
Reel/Frame 062179/0022 →
Continuity (2)
Continuation 17301596 · Apr 8, 2021
Related Publication 20230114704A1 · Apr 13, 2023