IP Library Granted Patent US 10,503,962
Granted Patent B2
US 10,503,962 · App. 15/910,124 · Granted Dec 10, 2019

Navigating among images of an object in 3D space

Inventors: Ilya A. Kriveshko (Boxborough, MA); Dmitriy A. Dedkov (Everett, MA)
Assignee: Midmark Corporation
G06K9/00214A61C13/0004G06K9/00201G06T17/00H04N13/221G06T2207/10012G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,503,962
App. No.
15/910,124
Granted
Dec 10, 2019
Kind
B2
Abstract

A three-dimensional model of an object is employed to aid in navigation among a number of images of the object taken from various viewpoints. In general, an image of an object such as a digital photograph is displayed in a user interface or the like. When a user selects a point within the display that corresponds to a location on the surface of the object, another image may be identified that provides a better view of the object. In order to maintain user orientation to the subject matter while navigating to this destination viewpoint, the display may switch to a model view and a fly-over to the destination viewpoint may be animated using the model. When the destination viewpoint is reached, the display may return to an image view for further inspection, marking, or other manipulation by the user.

Claims (21)

1. A computing device comprising a display screen, the computing device configured to display on the display screen a graphical user interface comprising an image display area that alternately displays:

a first image of an object, the first image selected from a number of images taken of the object, and showing a surface of the object from a first viewpoint;

an animation of a spatial transition from the first viewpoint to a second viewpoint that provides an improved view of a user-selected location on the surface of the object in the first image, the animation rendered from a three-dimensional model of the object; and

a second image of the object selected from the number of images and showing the object from the second viewpoint,

except that if a user interrupt of the animation is received during the display of the animation, then the image display area automatically exits the animation at a point of the interrupt and displays a nearest image from the number of images at the point of the interrupt.

2. The computing device of claim 1 wherein the animation is a texture-mapped animation.

3. The computing device of claim 1 wherein the first image and the second image are selected from a plurality of frames of video data that originate from a center channel of a video camera having one or more side channels that capture data used to generate the three-dimensional model.

4. The computing device of claim 3 wherein the user interface displays a two-dimensional map illustrating a current location of the camera.

5. The computing device of claim 4 wherein the two-dimensional map is displayed in the image display area.

6. The computing device of claim 3 wherein the user interface displays a three-dimensional map illustrating a current location of the camera.

7. The computing device of claim 6 wherein the three-dimensional map is displayed in the image display area.

8. The computing device of claim 1 wherein the object includes human dentition.

9. The computing device of claim 8 wherein the object includes at least one of teeth, gums, dentures, and braces.

10. The computing device of claim 8 wherein the object includes a prepared tooth surface.

11. The computing device of claim 1 wherein the user interface displays controls for receiving the user interrupt.

12. The computing device of claim 1 wherein the images are color two-dimensional images.

13. The computing device of claim 1 wherein the images are grayscale two-dimensional images.

14. The computing device of claim 1 wherein the user interface displays position and orientation information during the animation.

15. The computing device of claim 1 wherein the user interface displays a label, a landmark, or a grid during the animation.

16. The computing device of claim 1 wherein the image display area displays the animation with an acceleration from the first viewpoint and a deceleration to the second viewpoint.

17. The computing device of claim 1 wherein the image display area displays the animation with a zoom out at or near the first viewpoint.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2022
From: MIDMARK CORPORATION
To: MEDIT CORP.
Reel/Frame 059615/0654 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2019
From: 3M INNOVATIVE PROPERTIES COMPANY
To: MIDMARK CORPORATION
Reel/Frame 049065/0301 →
Continuity (3)
Continuation 12811268
Provisional Application 61019159 · Jan 4, 2008
Related Publication 20180196995A1 · Jul 12, 2018