IP Library Granted Patent US 8,692,768
Granted Patent B2
US 8,692,768 · App. 12/501,088 · Granted Apr 8, 2014

Interactive input system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,692,768
App. No.
12/501,088
Granted
Apr 8, 2014
Kind
B2
Abstract

A method for resolving ambiguities between at least two pointers in a plurality of input regions defining an input area of an interactive input system. The method includes capturing images of the plurality of input regions, the images captured by a plurality of imaging devices having a field of view of at least a portion of the input area, processing image data from the images to identify a plurality of targets for the at least two pointers within the input area, and analyzing the plurality of targets to resolve a real location associated with each pointer.

Claims (36)

1. An interactive input system comprising:

an input surface having at least two input areas;

a plurality of imaging devices having at least partially overlapping fields of view encompassing at least one input regions within the input area; and

a processing structure configured to process image data acquired by the imaging devices to track the position of at least two pointers within the input regions by:

identifying consistent candidates in the processed image data to facilitate resolving ambiguities between the pointers, each of the consistent candidates comprising observations located in image frames captured by all of the plurality of imaging devices having a field of view encompassing a target's input region;

determining the position of the consistent candidates by assigning a weight to the observations based on the clarity of the observations;

wherein the observations are clear when the imaging devices have a clear view of the observations and the consistent candidates are merged when the imaging devices have a merged view of a plurality of the observations, and

wherein a first weight is assigned to the clear observations, the first weight having predefined value, and a second weight is assigned to the merged observations, the second weight being less than the first weight.

2. The interactive input system of claim 1 , wherein the processing structure further comprises an association procedure module to associate the consistent candidates with target associated with the at least two pointers.

3. The interactive input system of claim 2 , wherein the processing structure further comprises a tracking procedure module for tracking the targets in the at least two input regions.

4. The interactive input system of claim 3 , wherein the processing structure further comprises a state estimation module for determining locations of the at least two pointers based on information from the association procedure module and the tracking procedure module and image data from the plurality of imaging devices.

5. The interactive input system of claim 4 , wherein the processing structure further comprises a disentanglement process module for, when the at least two pointers appears merged, determining locations for each of the pointers based on information from the state estimation module, the tracking procedure module and image data from the plurality of imaging devices.

6. The interactive input system of claim 1 , wherein the processing structure uses weighted triangulation for processing the image data.

7. The interactive input system of claim 6 , wherein weights are assigned to the image data from each of the plurality of imaging devices.

8. An interactive input system comprising:

an input surface defining an input area; and

at least three imaging devices having at least partially overlapping fields of view encompassing at least one input region within the input area;

a processing structure for processing images acquired by the imaging devices to determine the position of at least two pointers within the at least one input region by assigning a weight to observations in each image based on the clarity of the observation, the observations representative of the at least two pointers, and triangulate the positions of the at least two pointers based on each weighted observation;

wherein the observations are clear when the imaging devices have a clear view of the observations and the observations are merged when the imaging devices have a merged view of a plurality of the observations; and

wherein a first weight is assigned to the clear observations, the first weight having predefined value, and a second weight is assigned to the merged observations, the second weight being less than the first weight.

9. The interactive input system of claim 8 , wherein the weighted triangulation resolves ambiguities in the observations.

10. In an interactive input system, a method of resolving ambiguities between at least two pointers in a plurality of input regions defining an input area comprising:

capturing images of a plurality of input regions, the images captured by a plurality of imaging devices having a field of view of a portion of the plurality of input regions;

processing image data from the images to identify a plurality of targets for the at least two pointers within the input area;

determining a state for each target of each image, the state indicating whether the target is clear or merged, wherein the target is clear when the imaging devices have a clear view of the target and the target is merged when the imaging devices have a merged view of a plurality of the targets;

assigning a weight to each target of each image based on the determined state, wherein a first weight is assigned to the image data for the clear target, the first weight having predefined value, and a second weight is assigned to the image data for the merged target, the second weight being less than the first weight; and

calculating a pointer location for each of the at least two pointers based on the weighted target data.

11. The method of claim 10 , wherein the calculating is performed using weighted triangulation.

12. The method of claim 10 further comprising determining real and phantom targets associated with each pointer.

13. The method of claim 10 , wherein the second weight is selected from a range of values, wherein a top value of the range of values is less than the first weight.

14. A non-transitory computer readable medium embodying a computer program for resolving ambiguities between at least two pointers in a plurality of input regions defining an input area in an interactive input system, the computer program code operable to:

receive images of a plurality of input regions, the images captured by a plurality of imaging devices having a field of view of a portion of the plurality of input regions;

process image data from the images to identify a plurality of targets for the at least two pointers within the input area;

determine a state for each target of each image, the state indicating whether the target is clear or merged, wherein the target is clear when the imaging devices have a clear view of the target and the target is merged when the imaging devices have a merged view of a plurality of the targets;

assign a weight to each target of each image based on the determined state, wherein a first weight is assigned to the image data for the clear target, the first weight having predefined value, and a second weight is assigned to the image data for the merged target, the second weight being less than the first weight; and

calculate a pointer location for each of the at least two pointers based on the weighted target data.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Dec 2, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040819/0306 →
RELEASE OF SECURITY INTEREST Recorded Dec 2, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040798/0077 →
RELEASE OF ABL SECURITY INTEREST Recorded Nov 29, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040711/0956 →
RELEASE OF TERM LOAN SECURITY INTEREST Recorded Nov 29, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040713/0123 →
SECURITY AGREEMENT Recorded Aug 1, 2013
From: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING INC.
Reel/Frame 030935/0848 →
SECURITY AGREEMENT Recorded Aug 1, 2013
From: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 030935/0879 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2009
From: CHTCHETININE, ALEX; HOLMGREN, DAVID E.; KABADA, BRINDA; MCGIBNEY, GRANT; MCREYNOLDS, DANIEL; ZHANG, YUN; ZHOU, YE
To: SMART TECHNOLOGIES ULC
Reel/Frame 023290/0414 →