IP Library Granted Patent US 10,621,733
Granted Patent B2
US 10,621,733 · App. 15/859,640 · Granted Apr 14, 2020

Enhanced visualization of breathing or heartbeat of an infant or other monitored subject

Inventors: Yoky Matsuoka (Los Altos Hills, CA); Shwetak Patel (Seattle, WA); Michael Dixon (Sunnyvale, CA)
Assignee: Google LLC
G06T7/246A61B5/0022A61B5/0077A61B5/0205A61B5/113A61B5/1128A61B5/1135A61B5/4806A61B5/743A61B5/744G06K9/00342G06K9/00711G06T3/4069A61B5/0046A61B5/02427A61B5/0816A61B5/6898A61B5/725A61B5/7264A61B5/747A61B2503/04A61B2576/00A61B2576/02G06T2207/10016G06T2207/30076G06T2207/30196G08B21/0415G08B21/0476H04N7/183
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,621,733
App. No.
15/859,640
Filed
Dec 31, 2017
Granted
Apr 14, 2020
Kind
B2
Examiner
FLORES, LEON
Art Unit
2661
USPC
382/107
Abstract

A method of monitoring physical characteristics of subjects in sleep environments may include receiving, through a video camera, a video feed of a subject in a sleep environment; analyzing the video feed of the subject to identify motion of the subject in the video feed; and causing a mobile device to present a representation of the motion of the subject, wherein the motion of the subject is exaggerated.

Claims (16)

1. A method of monitoring physical characteristics of subjects in sleep environments, the method comprising: receiving, through a video camera, a video feed of a subject in a sleep environment; analyzing the video feed of the subject to identify motion of the subject in the video feed that is below a threshold amount of motion; generating a displacement map for pixels moving below the threshold amount of motion, wherein the displacement map comprises values indicating a distance by which the pixels in a previous frame have moved in relation to a current frame; and causing a mobile device to present a representation of the motion of the subject, wherein the motion of the subject that is below the threshold amount of motion is exaggerated by: scaling the values in the displacement map; altering pixel locations in the video feed based on the displacement map after scaling the values in the displacement map; and displaying the pixels with altered locations in an overlaid fashion in the video feed.

2. The method of claim 1 , wherein analyzing the video feed of the subject to identify motion of the subject in the video feed comprises identifying motions of the subject that are repeated.

3. The method of claim 1 , wherein analyzing the video feed of the subject to identify the motion of the subject in the video feed comprises analyzing the video feed of the subject to identify motion of the subject in the video feed comprises identifying motions of the subject that are repeated and less than a threshold amount of motion.

4. The method of claim 1 , wherein analyzing the video feed further comprises identifying an area in a field-of-view of the camera that includes the motion of the subject.

5. The method of claim 4 , wherein analyzing the video feed further comprises reducing a resolution of the video feed outside of the area.

6. The method of claim 1 , wherein the motion of the subject in the video feed comprises a rhythmic breathing motion.

7. The method of claim 1 , wherein the motion of the subject in the video feed comprises a chest rising and falling with a heartbeat of the subject.

8. A system for monitoring physical characteristics of subjects in sleep environments, the system comprising: a video camera; one or more processors; and one or more memory devices comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: receiving, through a video camera, a video feed of a subject in a sleep environment; analyzing the video feed of the subject to identify motion of the subject in the video feed that is below a threshold amount of motion; generating a displacement map for pixels moving below the threshold amount of motion, wherein the displacement map comprises values indicating a distance by which the pixels in a previous frame have moved in relation to a current frame; and causing a mobile device to present a representation of the motion of the subject, wherein the motion of the subject that is below the threshold amount of motion is exaggerated by: scaling the values in the displacement map; altering pixel locations in the video feed based on the displacement map after scaling the values in the displacement map; and displaying the pixels with altered locations in an overlaid fashion in the video feed.

9. The system of claim 8 , wherein the mobile device comprises a smart phone.

10. The system of claim 8 , further comprising a monitor server, wherein the one or more processors are at least partially located at the monitor server.

11. The system of claim 8 , wherein the representation of the motion of the subject comprises a pulsating graphic to be displayed on the mobile device where the pulsating is based on a timing of the motion of the subject.

12. The system of claim 8 , wherein the representation of the motion of the subject comprises a rhythmic audio output that is based on a timing of the motion of the subject.

13. The system of claim 8 , wherein analyzing the video feed of the subject to identify motion of the subject in the video feed comprises identifying motions of the subject that are repeated.

14. The system of claim 8 , wherein analyzing the video feed of the subject to identify the motion of the subject in the video feed comprises filtering motions that are larger than a threshold amount of motion or which are not repeated.

15. The system of claim 8 , wherein analyzing the video feed further comprises identifying an area in a field-of-view of the camera that includes the motion of the subject.

16. The system of claim 15 , wherein analyzing the video feed further comprises reducing a resolution of the video feed outside of the area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2018
From: MATSUOKA, YOKY; PATEL, SHWETAK; DIXON, MICHAEL
To: GOOGLE LLC
Reel/Frame 045023/0688 →
Continuity (1)
Related Publication 20190206062A1 · Jul 4, 2019