IP Library Granted Patent US 9,978,290
Granted Patent B2
US 9,978,290 · App. 15/146,378 · Granted May 22, 2018

Identifying a change in a home environment

Inventors: Mark B. Stevens (Austin, TX); John D. Wilson (Houston, TX)
Assignee: International Business Machines Corporation
G09B21/006A61B5/024A61B5/0816A61B5/4806A61H3/06A61H3/061G01S15/523G01S15/89G08B21/02G09B21/00G09B21/001G09B21/008G09B29/004A61H2003/063A61H2201/501A61H2201/5043A61H2201/5046A61H2201/5048A61H2201/5058A61H2201/5082A61H2201/5092A61H2201/5097
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,978,290
App. No.
15/146,378
Granted
May 22, 2018
Kind
B2
Abstract

A system and computer implemented method for detecting a change in a home environment for a visually impaired user is disclosed. The method may include monitoring the home environment using a set of sensors configured to collect environment data for a set of areas of the home environment. The method may also include detecting an environmental change in an area of the home environment. The method may also include providing, in response to a triggering event, a notification of the environmental change.

Claims (27)

1. A computer implemented method for detecting a change in a home environment for a visually impaired user, the method comprising:

capturing, by an image capturing system, a first set of images for a set of areas of the home environment, the first set of images including one or more objects, each of the one or more objects having a respective first position in the first set of images;

while the visually impaired user is not located within the home environment, capturing a second set of images for the set of areas of the home environment in response to receiving a motion alert from a motion detection system coupled to the image capturing system, the second set of images including the one or more objects;

while the visually impaired user is not located within the home environment, comparing the first set of images with the second set of images to identify an object of the one or more objects having a respective second position in the second set of images, the respective second position of the identified object in the second set of images being different from the respective first position of the identified object in the first set of images such that the identified object meets an obstruction criterion; and

in response to detecting arrival of the visually impaired user at the home environment, providing a notification to the visually impaired user that the identified object meets the obstruction criterion.

2. The method of claim 1 , wherein the obstruction criterion includes an object displacement threshold based on an origin position and a subsequent position, and an object size threshold based on a first dimension, a second dimension, and a third dimension.

3. The method of claim 1 , wherein the home arrival is detected by a security system in response to a door unlock of a home.

4. The method of claim 1 , wherein detecting arrival of the visually impaired user at the home environment comprises monitoring, using a radio-frequency identification (RFID) tracking system, the location of a cane of the user, wherein the cane is equipped with a RFID bit communicatively connected to the RFID tracking system.

5. The method of claim 1 , wherein detecting arrival of the visually impaired user at the home environment comprises monitoring, using a thermal imaging system, a body heat signature; and detecting arrival of the visually impaired user based on the body heat signature.

6. The method of claim 1 , wherein providing the notification includes announcing, through a dog collar communicatively connected to the image capturing system and equipped with a speaker, a voice message notifying the user of the identified object meeting the obstruction criterion.

7. A system for detecting a change in a home environment for a visually impaired user, the system comprising:

an image capturing system configured to collect a first set of images for a set of areas of the home environment, the first set of images including one or more objects, each of the one or more objects having a respective first position in the first set of images;

a motion detection system coupled to the image capturing system and configured to detect motion in the home environment; and

a processor communicatively coupled to the image capturing system and the motion detection system;

wherein the image capturing system is configured to capture a second set of images for the set of areas of the home environment while the visually impaired user is not located within the home environment, in response to receiving a motion alert from the motion detection system, the second set of images including the one or more objects;

wherein the processor is configured to compare the first set of images with the second set of images while the visually impaired user is not located within the home environment to identify an object of the one or more objects having a respective second position in the second set of images, the respective second position of the identified object in the second set of images being different from the respective first position of the identified object in the first set of images such that the identified object meets an obstruction criterion; and

wherein the processor is configured to provide a notification to the visually impaired user that the identified object meets the obstruction criterion in response to detecting arrival of the visually impaired user at the home environment.

8. The system of claim 7 , wherein the obstruction criterion includes an object displacement threshold based on an origin position and a subsequent position, and an object size threshold based on a first dimension, a second dimension, and a third dimension.

9. The system of claim 7 , wherein the system further comprises a security system configured to detect the home arrival in response to a door unlock of a home.

10. The system of claim 7 , wherein the system further comprises a radio-frequency identification (RFID) tracking system configured to monitor the location of a cane of the user, wherein the cane is equipped with a RFID bit communicatively connected to the RFID tracking system.

11. The system of claim 7 , wherein the system further comprises a thermal imaging system configured to monitor for body heat signature of the visually impaired user to detect arrival of the visually impaired user at the home environment.

12. A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed on a first computing device, causes the first computing device to:

receive a first set of images for a set of areas of the home environment from an image capturing system, the first set of images including one or more objects, each of the one or more objects having a respective first position in the first set of images;

receive a second set of images for the set of areas of the home environment while the visually impaired user is not located within the home environment in response to receiving a motion alert from a motion detection system, the second set of images including the one or more objects;

compare the first set of images with the second set of images while the visually impaired user is not located within the home environment to identify an object of the one or more objects having a respective second position in the second set of images, the respective second position of the identified object in the second set of images being different from the respective first position of the identified object in the first set of images such that the identified object meets an obstruction criterion; and

in response to detecting arrival of the visually impaired user at the home environment, provide a notification to the visually impaired user that the identified object meets the obstruction criterion.

13. The computer program product of claim 12 , wherein the obstruction criterion includes an object displacement threshold based on an origin position and a subsequent position, and an object size threshold based on a first dimension, a second dimension, and a third dimension.

Assignments (20)
SECURITY INTEREST Recorded Sep 19, 2022
From: GENERAC POWER SYSTEMS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061476/0745 →
AMALGAMATION Recorded Jul 25, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 060907/0090 →
CONTINUED - CHANGE OF JURISDICTION Recorded Apr 26, 2022
From: ECOBEE INC.
To: ECOBEE TECHNOLOGIES INC.
Reel/Frame 059805/0101 →
CHANGE OF NAME Recorded Apr 26, 2022
From: 1339416 B.C. LTD.
To: ECOBEE TECHNOLOGIES ULC
Reel/Frame 059825/0668 →
AMALGAMATION Recorded Apr 26, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 059825/0888 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: ECOBEE TECHNOLOGIES ULC
To: GENERAC HOLDINGS INC.
Reel/Frame 059713/0780 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: GENERAC HOLDINGS INC.
To: GENERAC POWER SYSTEMS, INC.
Reel/Frame 059713/0799 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY FROM ECOBEE, INC. TO ECOBEE INC. PREVIOUSLY RECORDED AT REEL: 058568 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 8, 2022
From: AMERICAN STOCK TRANSFER & TRUST COMPANY, LLC D/B/A AST TRUST COMPANY (CANADA)
To: ECOBEE INC.
Reel/Frame 058965/0106 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME FROM ECOBEE, INC. TO ECOBEE INC. PREVIOUSLY RECORDED AT REEL: 058521 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 7, 2022
From: STRUCTURED ALPHA LP, BY ITS GENERAL PARTNER THOMVEST ASSET MANAGEMENT LTD.
To: ECOBEE INC.
Reel/Frame 059205/0822 →
CHANGE OF NAME Recorded Jan 31, 2022
From: 1339416 B.C. LTD.
To: ECOBEE TECHNOLOGIES ULC
Reel/Frame 058907/0363 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: ECOBEE TECHNOLOGIES ULC
To: GENERAC HOLDINGS INC.
Reel/Frame 058917/0069 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: GENERAC HOLDINGS INC.
To: GENERAC POWER SYSTEMS, INC.
Reel/Frame 058917/0161 →
MERGER AND CHANGE OF NAME Recorded Jan 31, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 061001/0949 →
CHANGE OF NAME Recorded Jan 31, 2022
From: ECOBEE INC.
To: ECOBEE TECHNOLOGIES INC.
Reel/Frame 058905/0211 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: AMERICAN STOCK TRANSFER & TRUST COMPANY, LLC D/B/A AST TRUST COMPANY (CANADA)
To: ECOBEE, INC.
Reel/Frame 058568/0001 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: STRUCTURED ALPHA LP, BY ITS GENERAL PARTNER THOMVEST ASSET MANAGEMENT LTD.
To: ECOBEE, INC.
Reel/Frame 058521/0001 →
SECURITY INTEREST Recorded May 19, 2020
From: ECOBEE INC.
To: AST TRUST COMPANY (CANADA)
Reel/Frame 052704/0656 →
SECURITY INTEREST Recorded May 15, 2020
From: INC., ECOBEE
To: STRUCTURED ALPHA LP
Reel/Frame 052678/0864 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: ECOBEE INC.
Reel/Frame 048753/0615 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2016
From: STEVENS, MARK B.; WILSON, JOHN D.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 038456/0953 →
Continuity (2)
Continuation 14284581 · May 22, 2014
Related Publication 20160242988A1 · Aug 25, 2016