IP Library Granted Patent US 8,831,954
Granted Patent B2
US 8,831,954 · App. 12/990,792 · Granted Sep 9, 2014

Localizing the position of a source of a voice signal

Inventors: Alphons Antonius Maria Lambertus Bruekers (Eindhoven, NL); Bahaa Eddine Sarroukh (Eindhoven, NL); Thomas Andreas Maria Kevenaar (Sterksel, NL)
Assignee: Nuance Communications, Inc.
G06K9/3216G10L15/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,831,954
App. No.
12/990,792
Granted
Sep 9, 2014
Kind
B2
Abstract

The invention relates to localizing the position of a person speaking by using pictures of a pattern ( 21 ) on an object ( 20 ) worn by the person. The object ( 20 ) carries a complex pattern ( 21 ) that is optimized for determining the orientation of the object ( 20 ), the distance from the object to a microphone device ( 14 ) and/or to a camera ( 11 ). Moreover, the pattern ( 21 ) may be arranged for identifying the person carrying the object ( 20 ). The determination of the position of the person carrying the object ( 20 ) may be used to enhance speech recognition (SR) and/or to provide hands-free voice control of devices (DC), e.g. in hospitals or in industrial settings.

Claims (33)

1. A system for localizing a position of a source of a voice signal, comprising:

an object arranged to be worn by a person having speech organs arranged for being a source of a voice signal, said object comprising a visually detectable pattern, said pattern arranged to be placed a distance from the source of the voice signal;

a camera device arranged for recording at least one picture of at least part of said pattern;

at least one processor to determine a position and an orientation of said pattern in relation to the camera device on the basis of said at least one picture;

a compensator configured to compensate for a difference in position between said pattern of said object and the speech organs of said person wearing the object; and

a microphone device arranged for adapting to the position of said source of a voice signal based on the position and the orientation of said pattern and the difference in position between said pattern of said object and the speech organs of said person wearing the object;

wherein said at least one processor is configured to determine the position of said source of the voice signal based on image processing, where the image processing is performed on said at least one picture of the at least part of said pattern.

2. The system according to claim 1 , wherein said pattern is a complex pattern.

3. The system according to claim 1 , wherein said pattern comprises a barcode and/or a plurality of colors.

4. The system according to claim 1 , wherein said object comprises a display arranged for displaying said visually detectable pattern.

5. The system according to claim 1 , wherein said pattern is rotation symmetric.

6. The system according to claim 1 , wherein said pattern comprises information sufficient to determine the distance between said camera device and said object.

7. The system according to claim 1 , wherein said object is a protective mask arranged for covering at least part of a face of said person.

8. A method for localizing a position of a source of a voice signal, the source of the voice signal being speech organs of a person wearing an object, the object comprising a visually detectable pattern placed a distance from the source of the voice signal, the method comprising:

recording, using a camera device, at least one picture of at least part of said pattern;

determining a position and an orientation of said pattern in relation to the camera device on the basis of said at least one picture;

compensating for a difference in position between said pattern of said object and the speech organs of said person wearing the object; and

adapting a microphone device to the position of said source of a voice signal based on the position and the orientation of said pattern and the difference in position between said pattern of said object and the speech organs of said person wearing the object;

wherein said determination of the position of said source of the voice signal is based on image processing, where the image processing is performed on said at least one picture of the at least part of said pattern.

9. The method of claim 8 , wherein said pattern comprises a barcode and/or a plurality of colors.

10. The method of claim 8 , wherein said object is a protective mask arranged for covering at least part of a face of said person.

11. At least one non-transitory machine readable storage medium having instructions encoded thereon which, when executed by at least one processor cause the at least one processor to perform a method, the method comprising:

recording at least one picture of at least part of said pattern;

determining a position and an orientation of said pattern in relation to the camera device on the basis of said at least one picture;

compensating for a difference in position between said pattern of said object and the speech organs of said person wearing the object; and

adapting a microphone device to the position of said source of a voice signal based on the position and the orientation of said pattern and the difference in position distance between said pattern of said object and the source of the voice signal speech organs of said person wearing the object;

wherein said determination of the position of said source of the voice signal is based on image processing, where the image processing is performed on said at least one picture of the at least part of said pattern.

12. The at least one non-transitory machine readable storage medium of claim 11 , wherein said pattern is a complex pattern.

13. The at least one non-transitory machine readable storage medium of claim 11 , wherein said pattern comprises a barcode and/or a plurality of colors.

14. The at least one non-transitory machine readable storage medium of claim 11 , wherein said pattern comprises a display arranged for displaying said visually detectable pattern.

15. The at least one non-transitory machine readable storage medium of claim 11 , wherein said pattern is rotation symmetric.

16. The at least one non-transitory machine readable storage medium of claim 11 , wherein said pattern comprises a display arranged for displaying said visually detectable pattern.

17. The at least one non-transitory machine readable storage medium of claim 11 , wherein said object is a protective mask arranged for covering at least part of a face of said person.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065532/0152 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2012
From: KONINKLIJKE PHILIPS ELECTRONICS N.V.
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 028481/0354 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2010
From: BRUEKERS, ALPHONS ANTONIUS MARIA LAMBERTUS; SARROUKH, BAHAA EDDINE; KEVENAAR, THOMAS ANDREAS MARIA
To: KONINKLIJKE PHILIPS ELECTRONICS N V
Reel/Frame 025239/0847 →
Priority Claims (1)
EP 08155872 · May 8, 2008 · regional
Continuity (1)
Related Publication 20110054909A1 · Mar 3, 2011