IP Library Patent Application 15389095
Patent Application
App. No. 15/389,095

VISUALIZATION OF PHYSICAL INTERACTIONS IN AUGMENTED REALITY

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/389,095
Abstract

An imaging device of a device captures an image. The device identifies a first and second object in the image, determines physical properties of the first and second object, generates a model of a predicted interaction between the first and second object based on the physical properties of the first and second object, identifies an area in the image based on the model of the predicted interaction between the first and second object, and augments the image at the area in a display of the device.

Claims (55)

1 . A device comprising:

an imaging device to capture an image; and

an augmented reality application implemented by a hardware processor of the device and configured to perform operations comprising:

identifying a first and second object in the image;

determining physical properties of the first and second object;

generating a model of a predicted interaction between the first and second object based on the physical properties of the first and second object;

identifying an area in the image based on the model of the predicted interaction between the first and second object; and

augmenting the image at the area in a display of the device.

2 . The device of claim 1 , wherein the area in the image includes a location of the predicted interaction between the first and second object.

3 . The device of claim 1 , wherein the area in the image identifies a predicted collision between the first and second object.

4 . The device of claim 1 , wherein the physical properties comprises a velocity and a direction of each of the first and second object.

5 . The device of claim 1 , wherein the physical properties comprise one or more three-dimensional simulated trajectory paths of the first and second object.

6 . The device of claim 1 , wherein the operations further comprise:

identifying a third object in the image;

determining that the third object can withstand an impact based on the model of the predicted interaction between the first and second object; and

augmenting the image at another area based on the location of the third object.

7 . The device of claim 1 , wherein the operations further comprise:

identifying a third object in the image;

determining that the third object can withstand an impact from the first or second object; and

augmenting the image at another area based on the location of the third object.

8 . The device of claim 1 , wherein the area of the augmented image includes at least one of a colored area, a shaded area, a patterned area, and a marked area.

9 . The device of claim 1 , wherein the operations further comprise:

augmenting a first area of the image with a first color, the first area identifying an area affected by the model of the predicted interaction between the first and second object; and

augmenting a second area of the image with a second color distinct from the first color, the second area identifying an area not affected by the model of the predicted interaction between the first and second object.

10 . The device of claim 9 , wherein the size of the first and second area corresponds to an impact intensity between the first and second object.

11 . A computer-implemented method comprising:

capturing an image with an imaging device;

identifying a first and second object in the image;

determining physical properties of the first and second object;

generating a model of a predicted interaction between the first and second object based on the physical properties of the first and second object;

identifying an area in the image based on the model of the predicted interaction between the first and second object; and

augmenting the image at the area in a display of the device.

12 . The method of claim 11 , wherein the area in the image includes a location of the predicted interaction between the first and second object.

13 . The method of claim 11 , wherein the area in the image identifies a predicted collision between the first and second object.

14 . The method of claim 11 , wherein the physical properties comprise a velocity and a direction of each of the first and second object.

15 . The method of claim 11 , wherein the physical properties comprise one or more three-dimensional simulated trajectory paths of the first and second object.

16 . The method of claim 11 , further comprising:

identifying a third object in the image;

determining that the third object can withstand an impact based on the model of the predicted interaction between the first and second object; and

augmenting the image at another area based on the location of the third object.

17 . The method of claim 11 , further comprising:

identifying a third object in the image;

determining that the third object can withstand an impact from the first or second object; and

augmenting the image at another area based on the location of the third object.

18 . The method of claim 11 , wherein the area of the augmented image includes at least one of a colored area, a shaded area, a patterned area, and a marked area.

19 . The method of claim 11 , wherein the operations further comprise:

augmenting a first area of the image with a first color, the first area identifying an area affected by the model of the predicted interaction between the first and second object; and

augmenting a second area of the image with a second color distinct from the first color, the second area identifying an area not affected by the model of the predicted interaction between the first and second object.

20 . A non-transitory machine-readable medium comprising instructions that when executed by one or more processors of a machine cause the machine to perform operations comprising:

capturing an image with an imaging device;

identifying a first and second object in the image;

determining physical properties of the first and second object;

generating a model of a predicted interaction between the first and second object based on the physical properties of the first and second object;

identifying an area in the image based on the model of the predicted interaction between the first and second object; and

augmenting the image at the area in a display of the device.

Assignments (8)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2016
From: MULLINS, BRIAN; KAMMERAIT, MATTHEW; BROADDUS, CHRISTOPHER
To: DAQRI, LLC
Reel/Frame 040755/0799 →