IP Library Granted Patent US 9,286,727
Granted Patent B2
US 9,286,727 · App. 14/222,494 · Granted Mar 15, 2016

System and method for presenting true product dimensions within an augmented real-world setting

Inventors: Eunjoo Kim (San Diego, CA); Per Orum Nielsen (San Diego, CA)
Assignee: QUALCOMM Incorporated
G06T19/006G06Q30/0601G06Q30/0643G09G5/377G06T2210/21
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,286,727
App. No.
14/222,494
Granted
Mar 15, 2016
Kind
B2
Abstract

Methods, systems, computer-readable media, and apparatuses for presenting a representation of an augmented real-world setting are presented. In some embodiments, a method includes presenting a representation of an augmented real-world setting. The method includes capturing a plurality of images of a real-world setting. The method also includes analyzing one or more real-world objects within the plurality of images of the real-world setting. The method further includes receiving information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation and overlaying an augmented reality object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step.

Claims (56)

1. A method for presenting a representation of an augmented real-world setting using a mobile device, the method comprising:

capturing a plurality of images of a real-world setting;

analyzing, via the mobile device, one or more real-world objects within the plurality of images of the real-world setting;

receiving information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

overlaying an augmented reality (AR) object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step; and

displaying additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

2. The method of claim 1 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

3. The method of claim 1 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

4. The method of claim 1 further comprising, updating, via the mobile device, the augmented real-world setting based at least in part on a perspective of the real-world setting from the mobile device.

5. The method of claim 1 wherein the analyzing step comprises determining physical dimensions of the one or more real-world objects within at least one image of the real-world setting.

6. The method of claim 1 further comprising determining whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

7. The method of claim 6 further comprising recommending, via the mobile device, a second position for overlaying the AR object depicting the real-world product within at least one of the plurality of images of the real-world setting, in response to determining the conflict.

8. The method of claim 6 further comprising recommending, via the mobile device, one or more alternate real-world products, in response to determining the conflict.

9. The method of claim 8 further comprising updating the augmented real-world setting by replacing the AR object with a second AR object depicting at least one of the one or more alternate real-world products within at least one of the plurality of images of the real-world setting.

10. The method of claim 1 further comprising receiving the information pertaining to the real-world product from a server computer.

11. The method of claim 1 wherein the first physical dimensions and the second physical dimensions comprise at least one of a height, length, and width.

12. An apparatus for presenting a representation of an augmented real-world setting, the apparatus comprising:

an image capture device configured to capture a plurality of images of a real-world setting;

a display device configured to display the augmented real-world setting;

a processor coupled to the image capture device and the display device, wherein the processor is configured to:

analyze one or more real-world objects within the plurality of images of the real-world setting;

receive information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

overlay an AR object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting based at least in part on the analyzing step; and

display, via the display device, additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

13. The apparatus of claim 12 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

14. The apparatus of claim 12 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

15. The apparatus of claim 12 wherein the processor is further configured to update the augmented real-world setting based at least in part on a perspective of the real-world setting from the image capture device.

16. The apparatus of claim 12 wherein the analyzing step comprises determining physical dimensions of the one or more real-world objects within at least one image of the real-world setting.

17. The apparatus of claim 12 wherein the processor is further configured to determine whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

18. The apparatus of claim 17 wherein the processor is further configured to recommend a second position for overlaying the AR object depicting the real-world product within at least one of the plurality of images of the real-world setting, in response to determining the conflict.

19. The apparatus of claim 17 wherein the processor is further configured to recommend one or more alternate real-world products, in response to determining the conflict.

20. The apparatus of claim 19 wherein the processor is further configured to update the augmented real-world setting by replacing the AR object with a second AR object depicting at least one of the one or more alternate real-world products within at least one of the plurality of images of the real-world setting.

21. The apparatus of claim 12 wherein the processor is further configured to receive the information pertaining to the real-world product from a server computer.

22. The apparatus of claim 12 wherein the first physical dimensions and the second physical dimensions comprise at least one of a height, length, and width.

23. An apparatus for presenting a representation of an augmented real-world setting, the apparatus comprising:

means for capturing a plurality of images of a real-world setting;

means for analyzing one or more real-world objects within the plurality of images of the real-world setting;

means for receiving information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

means for overlaying an augmented reality (AR) object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step; and

means for displaying additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

24. The apparatus of claim 23 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

25. The apparatus of claim 23 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

26. The apparatus of claim 23 further comprising:

means for updating the augmented real-world setting based at least in part on a perspective of the real-world setting from the mobile device; and

means for determining whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

27. A processor-readable, non-transitory, computer readable medium comprising processor readable instructions configured to cause a processor, on a mobile device, to:

capture a plurality of images of a real-world setting;

analyze one or more real-world objects within the plurality of images of the real-world setting;

receive information pertaining to a real-world product, wherein the information is indicative of first physical dimensions of the real-world product during a first mode of operation and second physical dimensions of the real-world product during a second mode of operation;

overlay an augmented reality (AR) object depicting the real-world product during the first mode of operation, and having the first physical dimensions, within at least one of the plurality of images of the real-world setting, based at least in part on the analyzing step; and

display additional information pertaining to the real-world product during the second mode of operation, and having the second physical dimensions, within at least one of the plurality of images of the real-world setting.

28. The processor-readable, non-transitory, computer readable medium of claim 27 wherein displaying the additional information further comprises updating the AR object to depict the real world product during the second mode of operation and having the second physical dimensions.

29. The processor-readable, non-transitory, computer readable medium of claim 27 wherein the additional information comprises a notification that the second physical dimensions conflict with the one or more real-world objects within the real-world setting.

30. The processor-readable, non-transitory, computer readable medium of claim 27 wherein the instructions are further configured to cause the processor to:

update, via the mobile device, the augmented real-world setting based at least in part on a perspective of the real-world setting from the mobile device; and

determine whether the overlaid AR object depicting the real-world product conflicts with the one or more real-world objects within the augmented real-world setting, based at least in part on at least one of the first physical dimensions of the product model or the second physical dimensions of the real-world product.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2014
From: KIM, EUNJOO; NIELSEN, PER ORUM
To: QUALCOMM INCORPORATED
Reel/Frame 032918/0173 →
Continuity (2)
Provisional Application 61805103 · Mar 25, 2013
Related Publication 20140285522A1 · Sep 25, 2014