IP Library › Granted Patent US 10,390,770
Granted Patent B2
US 10,390,770 · App. 15/484,973 · Granted Aug 27, 2019

Medical overlay mirror

Inventors: Paul G. Allen (Mercer Island, WA); Edward K. Y. Jung (Bellevue, WA); Royce A. Levien (Lexington, MA); Mark A. Malamud (Seattle, WA); John D. Rinaldo, Jr. (Bellevue, WA)
Assignee: Invention Science Fund I, LLC
A61B5/7445A45D44/005A61B5/0079A61B5/749G06F3/005G06F3/017G06F3/041G06T11/60A45D2044/007A61B2017/00207G09G2340/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,390,770
App. No.
15/484,973
Granted
Aug 27, 2019
Kind
B2
Abstract

Medical overlay mirror methods and related systems.

Claims (85)

1. A system, comprising:

at least one processor; and

one or more instructions which, when executed on the at least one processor, configure the at least one processor for performing one or more operations including at least:

providing a display of at least one field of view of a light reflecting structure;

facilitating a zoomed-in display of the at least one field of view of the light reflecting structure responsive to a selection by a user of a region of the at least one field of view for the zoomed-in display;

identifying one or more landmarks present within one or more images and present within the zoomed-in display;

registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the identifying the one or more landmarks present within the one or more images and present within the zoomed-in display;

comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature;

overlaying at least one portion of at least one of the one or more images or the at least one field of view of the light reflecting structure; and

outputting one or more presentations of the at least one of the one or more images or the at least one field of view of the light reflecting structure, including at least outputting at least one alert if the at least one specified feature exceeds the at least one reference value by at least one defined amount.

2. A method, comprising:

providing a display of at least one field of view of a light reflecting structure;

facilitating a zoomed-in display of the at least one field of view of the light reflecting structure responsive to a selection by a user of a region of the at least one field of view for the zoomed-in display;

identifying one or more landmarks present within one or more images and present within the zoomed-in display;

registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the identifying the one or more landmarks present within the one or more images and present within the zoomed-in display;

comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature;

overlaying at least one portion of at least one of the one or more images or the at least one field of view of the light reflecting structure; and

outputting one or more presentations of the at least one of the one or more images or the at least one field of view of the light reflecting structure, including at least outputting at least one alert if the at least one specified feature exceeds the at least one reference value by at least one defined amount,

wherein at least one of the identifying, registering, comparing, overlaying, or outputting is at least partially implemented using at least one processor.

3. A system, comprising:

circuitry configured for providing a display of at least one field of view of a light reflecting structure;

circuitry configured for facilitating a zoomed-in display of the at least one field of view of the light reflecting structure responsive to a selection by a user of a region of the at least one field of view for the zoomed-in display;

circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display;

circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display;

circuitry configured for comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature;

circuitry configured for overlaying at least one portion of at least one of the one or more images or the at least one field of view of the light reflecting structure; and

circuitry configured for outputting one or more presentations of the at least one of the one or more images or the at least one field of view of the light reflecting structure, including at least outputting at least one alert if the at least one specified feature exceeds the at least one reference value by at least one defined amount.

4. The system of claim 3 , further comprising:

circuitry configured for sorting the one or more images.

5. The system of claim 4 , wherein circuitry configured for sorting the one or more images comprises:

circuitry configured for sorting the one or more images at least partially based on at least one aspect of at least one landmark.

6. The system of claim 5 , wherein circuitry configured for sorting the one or more images at least partially based on at least one aspect of at least one landmark comprises:

circuitry configured for categorizing the one or more images at least partially based on image recognition of the at least one aspect of the at least one landmark; and

circuitry configured for ordering the one or more images at least partially based on one or more categories.

7. The system of claim 5 , wherein circuitry configured for sorting the one or more images at least partially based on at least one aspect of at least one landmark comprises:

circuitry configured for ordering the one or more images chronologically to show progression of the at least one landmark over time.

8. The system of claim 3 , wherein circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying the one or more landmarks present within one or more previously-captured images and present within the zoomed-in display.

9. The system of claim 8 , wherein circuitry configured for identifying the one or more landmarks present within one or more previously-captured images and present within the zoomed-in display comprises:

circuitry configured for receiving an indication of at least one landmark of interest in at least one of the one or more previously-captured images; and

circuitry configured for identifying at least one corresponding portion of the zoomed-in display portraying the at least one landmark of interest.

10. The system of claim 9 , wherein circuitry configured for receiving an indication of at least one landmark of interest in at least one of the one or more previously-captured images comprises:

circuitry configured for receiving the indication of at least one landmark of interest in the at least one of the one or more previously-captured images via at least one user interface used by the user to select the region of the at least one field of view for the zoomed-in display.

11. The system of claim 9 , wherein circuitry configured for receiving an indication of at least one landmark of interest in at least one of the one or more previously-captured images comprises:

circuitry configured for using image recognition to determine the indication of the at least one landmark of interest in the at least one of the one or more previously-captured images.

12. The system of claim 3 , wherein circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying one or more skin tone landmarks present within the one or more images and present within the zoomed-in display.

13. The system of claim 3 , wherein circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying one or more facial expression landmarks present within the one or more images and present within the zoomed-in display, including at least identifying at least one facial expression identifiable as being associated with at least one mental illness.

14. The system of claim 3 , wherein circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying at least one stable image feature present within the one or more images and present within the zoomed-in display.

15. The system of claim 3 , wherein circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display comprises:

circuitry configured for creating a time-lapse sequence of the at least some of the one or more images and the zoomed-in display subsequent to registration of the at least some of the one or more images with the at least one field of view of the light reflecting structure.

16. The system of claim 3 , wherein circuitry configured for outputting one or more presentations of the at least one of the one or more images or the at least one field of view of the light reflecting structure, including at least outputting at least one alert if the at least one specified feature exceeds the at least one reference value by at least one defined amount comprises:

circuitry configured for receiving one or more medical diagnostic readings; and

circuitry configured for temporally correlating at least one of the one or more images and the at least one field of view of the light reflecting structure with at least some of the one or more medical diagnostic readings.

17. The system of claim 16 , wherein circuitry configured for receiving one or more medical diagnostic readings comprises:

circuitry configured for receiving one or more medical diagnostic readings including at least one of blood pressure, heart rate, height, or weight.

18. The system of claim 16 , wherein circuitry configured for temporally correlating at least one of the one or more images and the at least one field of view of the light reflecting structure with at least some of the one or more medical diagnostic readings comprises:

circuitry configured for linking the at least one of the one or more images taken at a particular time and the at least one field of view of the light reflecting structure with at least some of the one or more medical diagnostic readings obtained contemporaneously with the at least one of the one or more images taken at a particular time and with the at least one field of view of the light reflecting structure.

19. The system of claim 3 , wherein circuitry configured for outputting one or more presentations of the at least one of the one or more images or the at least one field of view of the light reflecting structure, including at least outputting at least one alert if the at least one specified feature exceeds the at least one reference value by at least one defined amount comprises:

circuitry configured for overlaying at least one indication that at least one of the one or more landmarks present within the one or more images and present within the zoomed-in display has progressed.

20. The system of claim 3 , wherein circuitry configured for comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature comprises:

circuitry configured for comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature, the at least one specified feature including one or more of a skin lesion or a jowl of a particular size.

21. The system of claim 3 , wherein circuitry configured for comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature comprises:

circuitry configured for comparing at least one specified feature visible in at least one of the one or more images or the at least one field of view of the light reflecting structure against at least one reference value associated with the at least one specified feature, the at least one specified feature including a body feature.

22. The system of claim 3 , wherein circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display; and

circuitry configured for registering the at least some of the one or more images with the zoomed-in display at least partially based on the circuitry configured for identifying the at least two anchor points.

23. The system of claim 3 , wherein circuitry configured for overlaying at least one portion of at least one of the one or more images or the at least one field of view of the light reflecting structure comprises:

circuitry configured for overlaying at least one portion of at least one of the one or more images to create at least one multi-angle view incorporating the at least one field of view of the light reflecting structure.

24. The system of claim 3 , wherein circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display.

25. The system of claim 24 , wherein circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display, the zoomed-in display not readily visually coordinated with the at least one field of view of the light reflecting structure.

26. The system of claim 25 , wherein circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display, the zoomed-in display not readily visually coordinated with the at least one field of view of the light reflecting structure comprises:

circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display, the at least two anchor points facilitating coordination between an un-zoomed field of view of the light reflecting structure and the zoomed-in display of the at least one field of view of the light reflecting structure.

27. The system of claim 3 , wherein circuitry configured for identifying one or more landmarks present within one or more images and present within the zoomed-in display comprises:

circuitry configured for identifying at least two anchor points present within at least some of the one or more images and present within the zoomed-in display; and

wherein circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display includes at least:

circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the circuitry configured for identifying the at least two anchor points present within the at least some of the one or more images and present within the zoomed-in display.

28. The system of claim 3 , wherein circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display comprises:

circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on at least two anchor points identified by the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display.

29. The system of claim 28 , wherein circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on at least two anchor points identified by the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display comprises:

circuitry configured for registering at least some of the one or more images with the at least one field of view of the light reflecting structure at least partially based on at least two anatomical feature aspects identified by the circuitry configured for identifying the one or more landmarks present within the one or more images and present within the zoomed-in display.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2022
From: THE INVENTION SCIENCE FUND I, LLC
To: VENTRK, LLC
Reel/Frame 058995/0120 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2022
From: SEARETE LLC
To: THE INVENTION SCIENCE FUND I, L.L.C.
Reel/Frame 058639/0473 →
Continuity (3)
Continuation 14882296 · Oct 13, 2015
Continuation 13068674 · May 16, 2011
Related Publication 20170311905A1 · Nov 2, 2017