IP Library › Granted Patent US 11,722,763
Granted Patent B2
US 11,722,763 · App. 17/444,566 · Granted Aug 8, 2023

System and method for audio tagging of an object of interest

Inventors: Chew Yee Kee (Bayan Lepas, MY); Guo Dong Gan (Kuala Lumpur, MY); Guan Lip Soon (Georgetown, MY); Mun Yew Tham (Bayan Lepas, MY)
Assignee: MOTOROLA SOLUTIONS, INC.
H04N23/611G01S3/8083G06V20/20H04N23/635H04R3/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,722,763
App. No.
17/444,566
Granted
Aug 8, 2023
Kind
B2
Abstract

Techniques for audio tagging of an object of interest are provided. An object of interest within a field of view of a first video camera may be identified at a first time. At least one audio tag representing a first sound created by the object of interest may be generated and associated with the object of interest. At a second time later than the first and at a second video camera, a second sound generated by an unidentified object that is not in the field of view of the second video camera may be detected. An audio tag representing the second tag may be generated. It may be determined that the object of interest and the unidentified object of interest are the same when the audio tag representing the first sound and the second sound are the same.

Claims (64)

1. A method comprising:

identifying, at a first time, an object of interest within a field of view of a first video camera, the first video camera generating a first video stream including both video and audio;

generating at least one audio tag representing a first sound created by the object of interest, the first sound captured by a microphone associated with the first video camera, the generated audio tag associated with the object of interest;

detecting, at a second time, the second time later than the first time, at a second video camera, a second sound generated by an unidentified object that is not in a field of view of the second video camera;

generating an audio tag representing the second sound; and

determining that the object of interest and the unidentified object are the same when the audio tag representing the first sound and the audio tag representing the second sound are the same.

2. The method of claim 1 wherein the object of interest is a person.

3. The method of claim 1 wherein determining the object of interest and the unidentified object are the same further comprises:

determining if it is physically possible for the object of interest to have moved from a location covered by the first video camera to a location covered by the second video camera in a time period between the first time and the second time.

4. The method of claim 1 further comprising:

detecting a distance of the object of interest from the first video camera;

using a microphone array on the first video camera to determine a source location of the first sound; and

associating the first sound with the object of interest when the source location for the first sound matches a location of the object of interest.

5. The method of claim 1 wherein the first sound includes a temporal component.

6. The method of claim 1 further comprising:

associating the at least one audio tag with a second object of interest when it cannot be determined if the object of interest or the second object of interest created the first sound.

7. The method of claim 1 further comprising:

detecting a distance of the object of interest from the first video camera;

detecting a distance of a source location of the first sound from the first video camera based on a magnitude of the first sound; and

associating the first sound with the object of interest when the distance of the object of interest and the distance of the source location of the first sound are the same.

8. The method of claim 1 further comprising:

generating at least one visual tag describing a visible feature of the object of interest, the generated visual tag associated with the object of interest.

9. A system comprising:

a processor; and

a memory coupled to the processor, the memory containing thereon a set of instructions that when executed by the processor cause the processor to:

identify, at a first time, an object of interest within a field of view of a first video camera, the first video camera generating a first video stream including both video and audio;

generate at least one audio tag representing a first sound created by the object of interest, the first sound captured by a microphone associated with the first video camera, the generated audio tag associated with the object of interest;

detect, at a second time, the second time later than the first time, at a second video camera, a second sound generated by an unidentified object that is not in a field of view of the second video camera;

generate an audio tag representing the second sound; and

determine that the object of interest and the unidentified object are the same when the audio tag representing the first sound and the audio tag representing the second sound are the same.

10. The system of claim 9 wherein the instructions to determine the object of interest and the unidentified object are the same further comprises instructions to:

determine if it is physically possible for the object of interest to have moved from a location covered by the first video camera to a location covered by the second video camera in a time period between the first time and the second time.

11. The system of claim 9 further comprising instructions to:

detect a distance of the object of interest from the first video camera;

use a microphone array on the first video camera to determine a source location of the first sound; and

associate the first sound with the object of interest when the source location for the first sound matches a location of the object of interest.

12. The system of claim 9 further comprising instructions to:

associate the at least one audio tag with a second object of interest when it cannot be determined if the object of interest or the second object of interest created the first sound.

13. The system of claim 9 further comprising instructions to:

detect a distance of the object of interest from the first video camera;

detect a distance of a source location of the first sound from the first video camera based on a magnitude of the first sound; and

associate the first sound with the object of interest when the distance of the object of interest and the distance of the source location of the first sound are the same.

14. The system of claim 9 further comprising instructions to:

generate at least one visual tag describing a visible feature of the object of interest, the generated visual tag associated with the object of interest.

15. A non-transitory processor readable medium containing a set of instructions thereon that when executed by a processor cause the processor to:

identify, at a first time, an object of interest within a field of view of a first video camera, the first video camera generating a first video stream including both video and audio;

generate at least one audio tag representing a first sound created by the object of interest, the first sound captured by a microphone associated with the first video camera, the generated audio tag associated with the object of interest;

detect, at a second time, the second time later than the first time, at a second video camera, a second sound generated by an unidentified object that is not in a field of view of the second video camera;

generate an audio tag representing the second sound; and

determine that the object of interest and the unidentified object are the same when the audio tag representing the first sound and the audio tag representing the second sound are the same.

16. The medium of claim 15 wherein the instructions to determine the object of interest and the unidentified object are the same further comprises instructions to:

determine if it is physically possible for the object of interest to have moved from a location covered by the first video camera to a location covered by the second video camera in a time period between the first time and the second time.

17. The medium of claim 15 further comprising instructions to:

detect a distance of the object of interest from the first video camera;

use a microphone array on the first video camera to determine a source location of the first sound; and

associate the first sound with the object of interest when the source location for the first sound matches a location of the object of interest.

18. The medium of claim 15 further comprising instructions to:

associate the at least one audio tag with a second object of interest when it cannot be determined if the object of interest or the second object of interest created the first sound.

19. The medium of claim 15 further comprising instructions to:

detect a distance of the object of interest from the first video camera;

detect a distance of a source location of the first sound from the first video camera based on a magnitude of the first sound; and

associate the first sound with the object of interest when the distance of the object of interest and the distance of the source location of the first sound are the same.

20. The medium of claim 15 further comprising instructions to:

generate at least one visual tag describing a visible feature of the object of interest, the generated visual tag associated with the object of interest.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2021
From: KEE, CHEW YEE; GAN, GUO DONG; SOON, GUAN LIP; THAM, MUN YEW
To: MOTOROLA SOLUTIONS INC.
Reel/Frame 057099/0312 →
Continuity (1)
Related Publication 20230045536A1 · Feb 9, 2023
Cited By (1)
US 12,432,492