IP Library Granted Patent US 9,270,940
Granted Patent B1
US 9,270,940 · App. 14/502,110 · Granted Feb 23, 2016

Remote object sensing in video

Inventors: Aleksandr Y. Aravkin (Bronx, NY); Anirban Basu (Elmsford, NY); Dimitri Kanevsky (Ossining, NY); Tara N. Sainath (Jersey City, NJ)
Assignee: International Business Machines Corporation
H04N7/15H04N7/147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,270,940
App. No.
14/502,110
Granted
Feb 23, 2016
Kind
B1
Abstract

A method comprises obtaining an input comprising audio and visual data for display on a first device, receiving data associated with one or more sensory properties of one or more objects in the input, and reconstructing the one or more sensory properties at the first device based on the data received.

Claims (42)

1. A method, comprising:

obtaining an input comprising audio and visual data for display on a first device;

receiving data associated with one or more sensory properties of one or more user-selected objects in the input; and

reconstructing the one or more sensory properties at the first device based on the data received.

2. The method of claim 1 , wherein the one or more sensory properties comprises at least one of a temperature, a texture and a movement associated with the one or more.

3. The method of claim 1 , wherein the data is captured by one or more sensors on the first device, the one or more sensors comprising at least one of an infrared sensor and a tactile sensor.

4. The method of claim 1 , wherein the data is captured by one or more sensors on a second device, the one or more sensors comprising at least one of an infrared sensor and a tactile sensor.

5. The method of claim 1 , wherein reconstructing the one or more sensory properties comprises translating the sensory data into metrics for reconstruction.

6. The method of claim 5 , wherein a controller regulates a gridded interface to produce the one or more sensory properties based on the metrics.

7. The method of claim 6 , wherein the gridded interface comprises at least one of an array of micro pipes, a hot air reservoir, a cold air reservoir and a tactile simulator.

8. The method of claim 7 , wherein the gridded interface is located on an enclosure of the first device.

9. The method of claim 1 , wherein the input is one of pre-recorded or live.

10. The method of claim 1 , further comprising segmenting the input based on user selection, wherein the input is at least one of segmented temporally and segmented spatially.

11. The method of claim 10 , wherein the one or more sensory properties are reconstructed based on the user selection for at least one of a given duration and a given region of the input.

12. A method, comprising:

obtaining an input comprising visual and audio data for display on a device;

detecting user selection of one or more objects in the visual input;

identifying the one or more selected objects and surroundings of the one or more objects;

obtaining data associated with one or more sensory properties of the identified one or more objects and the surroundings; and

reconstructing the one or more sensory properties associated with the identified one or more objects and the surroundings based on the data received.

13. The method of claim 12 , wherein identifying the one or more selected objects comprises one of an image recognition software and a user input.

14. The method of claim 12 , wherein the data is obtained from a database comprising objects indexed with sensory information.

15. The method of claim 14 , wherein the data is estimated based on historical information stored in the database.

16. The method of claim 12 , wherein the sensory properties comprises at least one of a temperature, a texture and a movement associated with the one or more objects and surroundings.

17. The method of claim 12 , wherein reconstructing the one or more sensory properties comprises translating the data into metrics.

18. The method of claim 17 , wherein a controller regulates a gridded interface to produce the one or more sensory properties based on the metrics.

19. A method, comprising:

obtaining an input comprising visual and audio data for display on a first device;

detecting sensory input from a user of the first device with respect to one or more user-selected objects in the input;

capturing data associated with the sensory input from the user of the first device; and

transmitting the captured data to a second device for reconstruction of one or more sensory properties associated with the user of the first device.

20. The method of claim 19 , wherein detecting sensory input from a user comprises detecting user contact with one or more sensors on the first device.

21. The method of claim 19 , wherein capturing data associated with the sensory input comprises recording and storing data generated by the one of more sensors on the first device.

22. An apparatus, comprising:

a memory; and

a processor operatively coupled to the memory and configured to:

obtain an input comprising audio and visual data for display on a first device;

receive data associated with one or more sensory properties of one or more user-selected objects in the input; and

reconstruct the one or more sensory properties at the first device based on the data received.

23. The apparatus of claim 22 , wherein a controller regulates a gridded interface to produce one or more sensory properties based on one or more metrics.

24. The apparatus of claim 23 , wherein the gridded interface comprises at least one of an array of micro pipes, a hot air reservoir, a cold air reservoir and a tactile simulator.

25. The apparatus of claim 24 , wherein the gridded interface is located on an enclosure of the first device.

Assignments (20)
SECURITY INTEREST Recorded Sep 19, 2022
From: GENERAC POWER SYSTEMS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061476/0745 →
AMALGAMATION Recorded Jul 25, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 060907/0090 →
CONTINUED - CHANGE OF JURISDICTION Recorded Apr 26, 2022
From: ECOBEE INC.
To: ECOBEE TECHNOLOGIES INC.
Reel/Frame 059805/0101 →
CHANGE OF NAME Recorded Apr 26, 2022
From: 1339416 B.C. LTD.
To: ECOBEE TECHNOLOGIES ULC
Reel/Frame 059825/0668 →
AMALGAMATION Recorded Apr 26, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 059825/0888 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: ECOBEE TECHNOLOGIES ULC
To: GENERAC HOLDINGS INC.
Reel/Frame 059713/0780 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: GENERAC HOLDINGS INC.
To: GENERAC POWER SYSTEMS, INC.
Reel/Frame 059713/0799 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY FROM ECOBEE, INC. TO ECOBEE INC. PREVIOUSLY RECORDED AT REEL: 058568 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 8, 2022
From: AMERICAN STOCK TRANSFER & TRUST COMPANY, LLC D/B/A AST TRUST COMPANY (CANADA)
To: ECOBEE INC.
Reel/Frame 058965/0106 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME FROM ECOBEE, INC. TO ECOBEE INC. PREVIOUSLY RECORDED AT REEL: 058521 FRAME: 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 7, 2022
From: STRUCTURED ALPHA LP, BY ITS GENERAL PARTNER THOMVEST ASSET MANAGEMENT LTD.
To: ECOBEE INC.
Reel/Frame 059205/0822 →
CHANGE OF NAME Recorded Jan 31, 2022
From: 1339416 B.C. LTD.
To: ECOBEE TECHNOLOGIES ULC
Reel/Frame 058907/0363 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: ECOBEE TECHNOLOGIES ULC
To: GENERAC HOLDINGS INC.
Reel/Frame 058917/0069 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2022
From: GENERAC HOLDINGS INC.
To: GENERAC POWER SYSTEMS, INC.
Reel/Frame 058917/0161 →
MERGER AND CHANGE OF NAME Recorded Jan 31, 2022
From: 1339416 B.C. LTD.; ECOBEE TECHNOLOGIES INC.
To: 1339416 B.C. LTD.
Reel/Frame 061001/0949 →
CHANGE OF NAME Recorded Jan 31, 2022
From: ECOBEE INC.
To: ECOBEE TECHNOLOGIES INC.
Reel/Frame 058905/0211 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: AMERICAN STOCK TRANSFER & TRUST COMPANY, LLC D/B/A AST TRUST COMPANY (CANADA)
To: ECOBEE, INC.
Reel/Frame 058568/0001 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: STRUCTURED ALPHA LP, BY ITS GENERAL PARTNER THOMVEST ASSET MANAGEMENT LTD.
To: ECOBEE, INC.
Reel/Frame 058521/0001 →
SECURITY INTEREST Recorded May 19, 2020
From: ECOBEE INC.
To: AST TRUST COMPANY (CANADA)
Reel/Frame 052704/0656 →
SECURITY INTEREST Recorded May 15, 2020
From: INC., ECOBEE
To: STRUCTURED ALPHA LP
Reel/Frame 052678/0864 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2019
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: ECOBEE INC.
Reel/Frame 048763/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2014
From: ARAVKIN, ALEKSANDR Y.; BASU, ANIRBAN; KANEVSKY, DIMITRI; SAINATH, TARA N.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 033883/0103 →