IP Library Granted Patent US 10,306,360
Granted Patent B2
US 10,306,360 · App. 15/631,687 · Granted May 28, 2019

Method and device for processing received sound and memory medium, mobile terminal, robot having the same

Inventor: Lei Luo (Beijing, CN)
Assignee: CLOUDMINDS (SHENZHEN) TECHNOLOGIES CO., LTD.
H04R3/005H04M1/19H04M1/6008H04S3/006H04R2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,306,360
App. No.
15/631,687
Granted
May 28, 2019
Kind
B2
Abstract

Disclosed herein are method and device for processing received sound. The method includes receiving at least three sets of sound sent by at least three microphones of an apparatus; calculating a position of a sounding point in a three-dimensional space according to the at least three sets of sound; and adjusting a physical position of the apparatus according to the position of the sounding point in the three-dimensional space and an optimal sound receiving region of the apparatus, so as to approach or contain the position of the sounding point relative to the optimal sound receiving region of the apparatus. The physical position includes a spatial position and orientation of the apparatus. The embodiments can accurately determine the position of the sounding point, and then adjust state of the apparatus according to the position of the sounding point, to ensure the optimization of the sound reception effect.

Claims (44)

1. A method for processing received sound comprising:

receiving at least three sets of sound sent by at least three microphones of an apparatus;

calculating a position of a sounding point in a three-dimensional space according to the at least three sets of sound; and

adjusting a physical position of the apparatus according to the position of the sounding point in the three-dimensional space and an optimal sound receiving region of the apparatus, so as to approach or contain the position of the sounding point relative to the optimal sound receiving region of the apparatus,

wherein the physical position comprises a spatial position and orientation of the apparatus, and

wherein the calculating a position of a sounding point in a three-dimensional space according to the at least three sets of sound comprises:

calculating a difference in distance from the sounding point to every two microphones according to a phase difference in two sets of sound;

establishing a three-dimensional model, and figuring an intersection of at least three three-dimensional curved surfaces, wherein the three-dimensional curved surfaces are collections of points with difference in distance from which to every two microphones is equal to difference in distance from the sounding point to the every two microphones; and

determining the position of the sounding point according to the intersection of at least three three-dimensional curved surfaces.

2. The method of claim 1 , wherein the determining the position of the sounding point according to the intersection of at least three three-dimensional curved surfaces comprises:

determining, when the intersection figured out is two points, a space where the sounding point is located according to sound intensity of the microphones, and determining one of the two points to be the position of the sounding point according to the space where the sounding point is located; and

determining, when the intersection figured out is one point, the one point to be the position of the sounding point.

3. The method of claim 1 , wherein the apparatus is a robot, and the adjusting a physical position of the apparatus comprises:

adjusting orientation and position of the robot by controlling steering and walking of the robot.

4. The method of claim 1 , wherein the apparatus is a mobile terminal, and the adjusting a physical position of the apparatus comprises:

controlling a vibrating motor to vibrate to change directions of the mobile terminal.

5. A device for processing received sound, comprising:

at least three microphones, adapted to receive at least three sets of sound;

a processor adapted to calculate a position of a sounding point in a three-dimensional space according to the at least three sets of sound; and

a position adjusting component adapted to adjust a physical position of the device according to the position of the sounding point in the three-dimensional space and an optimal sound receiving region of the device, so as to approach or contain the position of the sounding point relative to the optimal sound receiving region of the device, wherein the physical position comprises spatial position and orientation of the device and

wherein the processor for calculating the position of the sounding point comprises:

a first calculating unit adapted to calculate a difference in distance from the sounding point to every two microphones according to a phase difference in two sets of sound;

a second calculating unit adapted to establish a three-dimensional model, and calculating an intersection of at least three three-dimensional curved surfaces; wherein the three-dimensional curved surfaces are collections of points with difference in distance from which to every two microphones is equal to difference in distance from the sounding point to the every two microphones; and

a determination unit adapted to determine the position of the sounding point according to the intersection of said at least three three-dimensional curved surfaces.

6. The device of claim 5 , wherein the determination unit is used for:

determining, when the intersection figured out is two points, a space where the sounding point is located according to sound intensity of the microphones, and determining one of the two points to be the position of the sounding point according to the space where the sounding point is located;

determining, when the intersection figured out is one point, the one point to be the position of the sounding point.

7. The device of claim 5 , wherein the device is a robot, and the position adjusting component is used for adjusting orientation and position of the robot by controlling steering and walking of the robot.

8. The device of claim 5 , wherein the device is a mobile terminal, and the position adjusting component a vibrating motor to vibrate to change directions of the mobile terminal.

9. A non-transitory memory medium, storing instructions for executing the steps comprising

receiving at least three sets of sound sent by at least three microphones of an apparatus with the non-transitory memory medium;

calculating a position of a sounding point in a three-dimensional space according to the at least three sets of sound; and

adjusting a physical position of the apparatus with the non-transitory memory medium according to the position of the sounding point in the three-dimensional space and an optimal sound receiving region of the apparatus, which is determined by the positions of the microphones, so as to approach or contain the position of the sounding point relative to the optimal sound receiving region of the apparatus,

wherein the physical position comprises a spatial position and orientation of the apparatus; and

wherein the calculating a position of a sounding point in a three-dimensional space according to the at least three sets of sound comprises:

calculating a difference in distance from the sounding point to every two microphones according to a phase difference in two sets of sound;

establishing a three-dimensional model, and figuring an intersection of at least three three-dimensional curved surfaces, wherein the three-dimensional curved surfaces are collections of points with difference in distance from which to every two microphones is equal to difference in distance from the sounding point to the every two microphones; and

determining the position of the sounding point according to the intersection of at least three three-dimensional curved surfaces.

10. The non-transitory memory medium of claim 9 , wherein the determining the position of the sounding point according to the intersection of at least three three-dimensional curved surfaces comprises:

determining, when the intersection figured out is two points, a space where the sounding point is located according to sound intensity of the microphones, and determining one of the two points to be the position of the sounding point according to the space where the sounding point is located; and determining, when the intersection figured out is one point, the one point to be the position of the sounding point.

11. The non-transitory memory medium of claim 9 , wherein the apparatus with the non-transitory memory medium is a robot, and the adjusting a physical position of the apparatus comprises:

adjusting orientation and position of the robot by controlling steering and walking of the robot.

12. The non-transitory memory medium of claim 9 , wherein the apparatus with the non-transitory memory medium is a mobile terminal, and the adjusting a physical position of the apparatus comprises:

controlling a vibrating motor to vibrate to change directions of the mobile terminal.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2026
From: DATAA NEW TECHNOLOGY CO., LTD.
To: CHONGQING XINGJIE SHUXING TECHNOLOGY PARTNERSHIP ENTERPRISE (LIMITED PARTNERSHIP)
Reel/Frame 074153/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2025
From: CLOUDMINDS ROBOTICS CO., LTD.
To: DATAA NEW TECHNOLOGY CO., LTD.
Reel/Frame 072052/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2021
From: CLOUDMINDS (SHENZHEN) TECHNOLOGIES CO., LTD.
To: CLOUDMINDS ROBOTICS CO., LTD.
Reel/Frame 055618/0543 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2017
From: LUO, LEI
To: CLOUDMINDS (SHENZHEN) TECHNOLOGIES CO., LTD.
Reel/Frame 042798/0964 →
Priority Claims (1)
CN 2015 1 0546558 · Aug 31, 2015 · national
Continuity (2)
Continuation PCTCN2016096361 · Aug 23, 2016
Related Publication 20170287468A1 · Oct 5, 2017