IP Library Granted Patent US 11,361,749
Granted Patent B2
US 11,361,749 · App. 17/077,965 · Granted Jun 14, 2022

Ambient cooperative intelligence system and method

Inventors: Dushyant Sharma (Woburn, MA); Patrick A. Naylor (Reading, GB); Joel Praveen Pinto (Aachen, DE); Daniel Paulino Almendro Barreda (London, GB)
Assignee: NUANCE COMMUNICATIONS, INC.
G10L13/02G06F3/165G06N5/02G06N20/00G10K15/08G10L13/033G10L15/02G10L15/063G10L15/065G10L21/0224G10L25/03H04S7/302H04S7/303
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,361,749
App. No.
17/077,965
Granted
Jun 14, 2022
Kind
B2
Abstract

A method, computer program product, and computing system for obtaining calibration information for a three-dimensional space incorporating an ACI system; and processing the calibration information to calibrate the ACI system.

Claims (45)

1. A computer-implemented method, executed on a computing device, comprising:

obtaining calibration information for a three-dimensional space incorporating an ambient cooperative intelligence (ACI) system, wherein the ACI system includes a video recording subsystem, wherein the calibration information from the video recording subsystem includes a three-dimensional model of at least a portion of the three-dimensional space, wherein the three-dimensional model is configured to define at least one of one or more stationary objects within the three-dimensional space and one or more interaction zones within the three-dimensional space, wherein the at least one of the one or more stationary objects within the three-dimensional space is defined by accessing an object datasource, wherein the at least one of the one or more stationary objects is tagged within the three-dimensional model to identify the one or more stationary objects, wherein the one or more interaction zones within the three-dimensional space includes an examination zone proximate the at least one of the one or more stationary objects within the three-dimensional space, wherein the examination zone is identified by the one or more stationary objects tagged within the three-dimensional model;

processing the calibration information to calibrate the ACI system based upon, at least in part, the video recording subsystem; and

steering one or more audio recording beams at the examination zone within the three-dimensional space based upon, at least in part, the examination zone being identified by tagging the at least one of the one or more stationary objects within the three-dimensional space of the three-dimensional model obtained from the calibration information by the video recording subsystem, wherein steering the one or more audio recording beams is disfavored outside of the examination zone regardless of conversations occurring outside of the examination zone.

2. The computer-implemented method of claim 1 wherein the calibration information is obtained from an ACI calibration platform.

3. The computer-implemented method of claim 1 wherein the calibration information includes one or more audio calibration signals.

4. The computer-implemented method of claim 3 wherein the one or more audio calibration signals includes one or more of:

a noise signal;

a sinusoid signal; and

a multi-frequency signal.

5. The computer-implemented method of claim 3 wherein the one or more audio calibration signals are utilized, in whole or in part, to calibrate one or more audio acquisition devices within the three-dimensional space.

6. The computer-implemented method of claim 1 wherein the three-dimensional model is further configured to define at least one of:

one or more subspaces within the three-dimensional space;

one or more features within the three-dimensional space; and

one or more noise sources within the three-dimensional space.

7. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

obtaining calibration information for a three-dimensional space incorporating an ambient cooperative intelligence (ACI) system, wherein the ACI system includes a video recording subsystem, wherein the calibration information from the video recording subsystem includes a three-dimensional model of at least a portion of the three-dimensional space, wherein the three-dimensional model is configured to define at least one of one or more stationary objects within the three-dimensional space and one or more interaction zones within the three-dimensional space, wherein the at least one of the one or more stationary objects within the three-dimensional space is defined by accessing an object datasource, wherein the at least one of the one or more stationary objects is tagged within the three-dimensional model to identify the one or more stationary objects, wherein the one or more interaction zones within the three-dimensional space includes an examination zone proximate the at least one of the one or more stationary objects within the three-dimensional space, wherein the examination zone is identified by the one or more stationary objects tagged within the three-dimensional model;

processing the calibration information to calibrate the ACI system based upon, at least in part, the video recording subsystem; and

steering one or more audio recording beams at the examination zone within the three-dimensional space based upon, at least in part, the examination zone being identified by tagging the at least one of the one or more stationary objects within the three-dimensional space of the three-dimensional model obtained from the calibration information by the video recording subsystem, wherein steering the one or more audio recording beams is disfavored outside of the examination zone regardless of conversations occurring outside of the examination zone.

8. The computer program product of claim 7 wherein the calibration information is obtained from an ACI calibration platform.

9. The computer program product of claim 7 wherein the calibration information includes one or more audio calibration signals.

10. The computer program product of claim 9 wherein the one or more audio calibration signals includes one or more of:

a noise signal;

a sinusoid signal; and

a multi-frequency signal.

11. The computer program product of claim 9 wherein the one or more audio calibration signals are utilized, in whole or in part, to calibrate one or more audio acquisition devices within the three-dimensional space.

12. The computer program product of claim 7 wherein the three-dimensional model is configured to define at least one of:

one or more subspaces within the three-dimensional space;

one or more features within the three-dimensional space; and

one or more noise sources within the three-dimensional space.

13. A computing system including a processor and memory configured to perform operations comprising:

obtaining calibration information for a three-dimensional space incorporating an ambient cooperative intelligence (ACI) system, wherein the ACI system includes a video recording subsystem, wherein the calibration information from the video recording subsystem includes a three-dimensional model of at least a portion of the three-dimensional space, wherein the three-dimensional model is configured to define at least one of one or more stationary objects within the three-dimensional space and one or more interaction zones within the three-dimensional space, wherein the at least one of the one or more stationary objects within the three-dimensional space is defined by accessing an object datasource, wherein the at least one of the one or more stationary objects is tagged within the three-dimensional model to identify the one or more stationary objects, wherein the one or more interaction zones within the three-dimensional space includes an examination zone proximate the at least one of the one or more stationary objects within the three-dimensional space, wherein the examination zone is identified by the one or more stationary objects tagged within the three-dimensional model;

processing the calibration information to calibrate the ACI system based upon, at least in part, the video recording subsystem; and

steering one or more audio recording beams at the examination zone within the three-dimensional space based upon, at least in part, the examination zone being identified by tagging the at least one of the one or more stationary objects within the three-dimensional space of the three-dimensional model obtained from the calibration information by the video recording subsystem, wherein steering the one or more audio recording beams is disfavored outside of the examination zone regardless of conversations occurring outside of the examination zone.

14. The computing system of claim 13 wherein the calibration information is obtained from an ACI calibration platform.

15. The computing system of claim 13 wherein the calibration information includes one or more audio calibration signals.

16. The computing system of claim 15 wherein the one or more audio calibration signals includes one or more of:

a noise signal;

a sinusoid signal; and

a multi-frequency signal.

17. The computing system of claim 15 wherein the one or more audio calibration signals are utilized, in whole or in part, to calibrate one or more audio acquisition devices within the three-dimensional space.

18. The computing system of claim 13 wherein the three-dimensional model is configured to define at least one of:

one or more subspaces within the three-dimensional space;

one or more features within the three-dimensional space; and

one or more noise sources within the three-dimensional space.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065530/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A.; PINTO, JOEL PRAVEEN; ALMENDRO BARREDA, DANIEL PAULINO
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 054144/0333 →