IP Library Granted Patent US 12,293,473
Granted Patent B2
US 12,293,473 · App. 17/900,208 · Granted May 6, 2025

Interactive augmented reality display

Inventor: Jiecong Lu (Philadelphia, PA)
Assignee: Jiecong Lu
G06T19/006G06T17/20G06T19/20G06V20/20G06T2219/2012G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,293,473
App. No.
17/900,208
Granted
May 6, 2025
Kind
B2
Abstract

A mobile device may provide an augmented reality display of a scene. The mobile device may include a camera for capturing a scene comprising one or more objects, a display for displaying an image or video of the scene, a processor, and a memory. The mobile device may display an image of the scene on the display. The mobile device may receive real-time data associated with a mathematical relationship between a plurality of parameters. The mobile device may overlay a three-dimensional plot and an information field over the displayed image. The mobile device may display curvature information on the three-dimensional plot. The mobile device may display a modified three-dimensional plot using updated curvature information and/or a modified input. In response to selection of a point on the three-dimensional plot, the mobile device may display a plurality of vectors extending from the point indicating rate of change information.

Claims (39)

1. A mobile device for providing an augmented reality display of a scene, comprising:

a camera for capturing a scene comprising one or more objects;

a display for displaying an image or video of the scene;

a processor; and

a memory, the processor configured to:

display an image of the scene on the display;

receive real-time data associated with a mathematical relationship between a plurality of parameters;

overlay a three-dimensional plot and an information field over the displayed image, the three-dimensional plot representing the mathematical relationship of the real-time data, the information field configured to display and enable modification of one or more of the plurality of parameters;

determine curvature information associated with the three-dimensional plot;

display the curvature information on the three-dimensional plot;

modify an input of the plurality of parameters in response to a user action, update the curvature information based on the modification to the input;

display a modified three-dimensional plot using the updated curvature information and the modified input;

in response to selection of a point on the three-dimensional plot, display a plurality of vectors extending from the point and update the information field to display vector information associated with the plurality of vectors.

2. The mobile device of claim 1 , wherein the three-dimensional plot is derived using a Black-Scholes equation.

3. The mobile device of claim 1 , wherein the three-dimensional plot comprises a surface mesh with a heat map indicating mean curvature information.

4. The mobile device of claim 1 , wherein the processor is further configured to change a visualization mode of the three-dimensional plot from a first visualization mode to a second visualization mode.

5. The mobile device of claim 4 , wherein the first visualization mode comprises a normal mode in which a value at each point on the three-dimensional plot is mapped to a color spectrum, and wherein the second visualization mode comprises a curvature mode in which a mean curvature at each point on the three-dimensional plot is mapped to the color spectrum.

6. The mobile device of claim 1 , wherein the plurality of vectors indicate rate of change information for the real-time data at the selected point.

7. The mobile device of claim 1 , wherein the curvature information indicates rate of change information for the real-time data.

8. The mobile device of claim 1 , wherein the processor is further configured to display one or more two-dimensional plots that represent projections of the three-dimensional plot at the selected point.

9. The mobile device of claim 8 , wherein each of the one or more two-dimensional plots comprise a vector that corresponds to one of the plurality of vectors.

10. A method of providing an augmented reality display of a scene, the method comprising:

capturing a scene comprising one or more objects;

displaying an image of the scene on the display;

receiving real-time data associated with a mathematical relationship between a plurality of parameters;

overlaying a three-dimensional plot and an information field over the displayed image, the three-dimensional plot representing the mathematical relationship of the real-time data, the information field configured to display and enable modification of one or more of the plurality of parameters;

determining curvature information associated with the three-dimensional plot;

displaying the curvature information on the three-dimensional plot;

modifying an input of the plurality of parameters in response to a user action, update the curvature information based on the modification to the input;

displaying a modified three-dimensional plot using the updated curvature information and the modified input;

in response to selection of a point on the three-dimensional plot, displaying a plurality of vectors extending from the point and update the information field to display vector information associated with the plurality of vectors.

11. The method of claim 10 , wherein the three-dimensional plot is derived using a Black-Scholes equation.

12. The method of claim 10 , wherein the three-dimensional plot comprises a surface mesh with a heat map indicating mean curvature information.

13. The method of claim 10 , further comprising changing a visualization mode of the three-dimensional plot from a first visualization mode to a second visualization mode.

14. The method of claim 13 , wherein the first visualization mode comprises a normal mode in which a value at each point on the three-dimensional plot is mapped to a color spectrum, and wherein the second visualization mode comprises a curvature mode in which a mean curvature at each point on the three-dimensional plot is mapped to the color spectrum.

15. The method of claim 10 , wherein the plurality of vectors indicate rate of change information for the real-time data at the selected point.

16. The method of claim 10 , wherein the curvature information indicates rate of change information for the real-time data.

17. The method of claim 10 , further comprising displaying one or more two-dimensional plots that represent projections of the three-dimensional plot at the selected point.

18. The mobile device of claim 17 , wherein each of the one or more two-dimensional plots comprise a vector that corresponds to one of the plurality of vectors.

Continuity (2)
Provisional Application 63240396 · Sep 3, 2021
Related Publication 20230073282A1 · Mar 9, 2023
References Cited (8)
US 11409402B1 · Cole · 2022 [cited by examiner]
US 20110219339A1 · Densham · 2011 [cited by examiner]
US 20130181974A1 · Liu · 2013 [cited by examiner]
US 20200004343A1 · Doornenbal · 2020 [cited by examiner]
US 20200401212A1 · Devries · 2020 [cited by examiner]
US 20210232719A1 · Ganihar · 2021 [cited by examiner]
US 20220068026A1 · Viswanathan · 2022 [cited by examiner]
CN 116324680A · 2023 [cited by examiner]