IP Library Granted Patent US 9,706,168
Granted Patent B1
US 9,706,168 · App. 14/882,430 · Granted Jul 11, 2017

Room conferencing system with heat map annotation of documents

Inventors: John Ludwig (Bellevue, WA); Richard Tong (Seattle, WA)
Assignee: Surround.IO
H04N7/15G06F17/241G06K9/18G06T7/20H04N7/147H04N7/183G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,706,168
App. No.
14/882,430
Filed
Oct 13, 2015
Granted
Jul 11, 2017
Kind
B1
Art Unit
2656
USPC
348/14.08
Abstract

A method includes capturing a first image at a first time using a camera; processing the first image to identify a representation of an object in the first image; storing the first image as an event forming a navigable marker in a conference room tracking system; measuring one or more of a room sound and a room activity level at a time associated with capture of the first image; generating a heat marker representing a level of the room sound or the room activity level; and storing the heat marker in association with the event.

Claims (44)

1. A method, comprising:

capturing a first image at a first time using a camera;

processing the first image to identify a representation of an object in the first image; storing the first image as an event forming a navigable marker in a conference room tracking system;

measuring room sound and determining from the room sound an emotion or contention level at a time associated with capture of the first image;

generating a heat marker representing the emotion or contention level;

and

storing the heat marker in association with the event.

2. The method of claim 1 , further comprising:

the first image an image of a display surface in the conference room; processing the first image to identify an object forming the display surface; capturing a second image of the display surface at a second time using the camera; and setting the object to be an object represented in the second image when a difference between the first image and the second image exceeds a change threshold.

3. The method of claim 2 , further comprising:

the change threshold is different for different types of the object forming the display surface.

4. The method of claim 2 , further comprising:

operating typing logic to identify a type of a physical change to the display surface as a change to text or a change to non-text annotations on the display surface; and

if the type of the physical change to the display surface is the change to text, communicating the change to text to OCR (optical character recognition) logic.

5. The method of claim 4 , further comprising:

if the type of the physical change to the display surface is the change to non-text annotations, operating object recognition logic to determine a type of the change to non-text annotations.

6. The method of claim 2 , further comprising:

if an interval between the first time and the second time is less than a configured threshold interval for the object forming the display surface, discarding the second image so that it is not processed to form the event forming the navigable marker.

7. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a device including a processor and memory, uniquely configure the memory and cause the device to: capture a first image at a first time using a camera;

process the first image to identify a representation of an object in the first image; store the first image as an event forming a navigable marker in a conference room tracking system;

measure room sound and determine from the room sound an emotion or contention level at a time associated with capture of the first image;

generate a heat marker representing the emotion or contention level;

and store the heat marker in association with the event.

8. The computer-readable storage medium of claim 7 , wherein the instructions further configure the computer to:

the first image an image of a display surface in the conference room; process the first image to identify an object forming the display surface; capture a second image of the display surface at a second time using the camera; and set the object to be an object represented in the second image when a difference between the first image and the second image exceeds a change threshold.

9. The computer-readable storage medium of claim 8 , wherein the instructions further configure the computer to:

operate typing logic to identify a type of a physical change to the display surface as a change to text or a change to non-text annotations on the display surface; and

if the type of the physical change to the display surface is the change to text, communicating the change to text to OCR (optical character recognition) logic.

10. The computer-readable storage medium of claim 9 , wherein the instructions further configure the computer to:

if the type of the physical change to the display surface is the change to non-text annotations, operating object recognition logic to determine a type of the change to non-text annotations.

11. A computing apparatus, the computing apparatus comprising: a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to:

capture a first image at a first time using a camera;

process the first image to identify a representation of an object in the first image; store the first image as an event forming a navigable marker in a conference room tracking system;

measure room sound and determine from the room sound an emotion or contention level at a time associated with capture of the first image;

generate a heat marker representing the emotion or contention level; and

store the heat marker in association with the event.

12. The computing apparatus of claim 11 , wherein the instructions further configure the apparatus to:

the first image an image of a display surface in the conference room; process the first image to identify an object forming the display surface; capture a second image of the display surface at a second time using the camera; and set the object to be an object represented in the second image when a difference between the first image and the second image exceeds a change threshold.

13. The computing apparatus of claim 12 , wherein the instructions further configure the apparatus to:

operate typing logic to identify a type of a physical change to the display surface as a change to text or a change to non-text annotations on the display surface; and

if the type of the physical change to the display surface is the change to text, communicating the change to text to OCR (optical character recognition) logic.

14. The computing apparatus of claim 13 , wherein the instructions further configure the apparatus to:

if the type of the physical change to the display surface is the change to non-text annotations, operating object recognition logic to determine a type of the change to non-text annotations.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2018
From: SURROUND.IO CORPORATION
To: XEVO INC.
Reel/Frame 045590/0011 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 14882430 FILED 10/13/2015 IN ASSIGNMENT DOCUMENT PREVIOUSLY RECORDED ON REEL 041697 FRAME 0761. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 7, 2017
From: LUDWIG, JOHN; TONG, RICHARD
To: SURROUND.IO
Reel/Frame 042192/0260 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2017
From: LUDWIG, JOHN; TONG, RICHARD
To: SURROUND.IO
Reel/Frame 041697/0761 →
Continuity (1)
Provisional Application 62063014 · Oct 13, 2014