IP Library › Granted Patent US 11,450,303
Granted Patent B2
US 11,450,303 · App. 16/680,952 · Granted Sep 20, 2022

Unmanned aerial vehicle (UAV) based noise cancellation in physical area

Inventors: Hemant Sadhwani (Bangalore, IN); Madhvesh Sulibhavi (Bangalore, IN)
Assignee: SONY CORPORATION
G10K11/17823B64C39/024G05B13/0265G05D1/104G06T7/60G06V20/00G06V40/103G10K11/17873G10L25/51H04N5/247H04N7/181H04N7/188B64C2201/12G06T2207/30196G06T2207/30242G10K2210/1281G10K2210/3044
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,450,303
App. No.
16/680,952
Filed
Nov 12, 2019
Granted
Sep 20, 2022
Kind
B2
Art Unit
2481
USPC
701/3
Abstract

A control apparatus and method for noise cancellation in a physical area. The control apparatus receives a trigger input which includes information about a first physical area and further controls an image capturing device to capture at least one first image of the first physical area based on the received trigger input. The control apparatus further determines a number of occupants of a first set of occupants present in the first physical area and scene information corresponding to the first physical area based on the captured at least one first image. The control apparatus further controls a movement of a first plurality of unmanned aerial vehicles (UAVs) in a physical three-dimensional (3D) space to create a virtual noise cancellation boundary around the first physical area based on the determined number of occupants of the first set of occupants and the scene information.

Claims (65)

1. A control apparatus, comprising:

circuitry configured to:

receive a trigger input which includes information about a first physical area;

control an image capturing device to capture at least one first image of the first physical area based on the received trigger input;

determine a number of occupants of a first set of occupants present in the first physical area and scene information corresponding to the first physical area based on the captured at least one first image; and

control a movement of a first plurality of unmanned aerial vehicles (UAVs) in a physical three-dimensional (3D) space to create a virtual noise cancellation boundary around the first physical area based on the determined number of occupants of the first set of occupants and the scene information.

2. The control apparatus according to claim 1 , wherein the circuitry is further configured to receive the trigger input from an electronic device associated with a first occupant of the first set of occupants.

3. The control apparatus according to claim 2 ,

wherein the trigger input received from the electronic device includes the number of occupants of the first set of occupants and the scene information, and

wherein the circuitry is further configured to extract the number of occupants of the first set of occupants and the scene information from the received trigger input to control the movement of the first plurality of UAVs.

4. The control apparatus according to claim 1 , wherein the scene information indicate that the first physical area is an indoor area or an outdoor area.

5. The control apparatus according to claim 1 , wherein the circuitry is further configured to determine a number of UAVs in the first plurality of UAVs based on the number of occupants of the first set of occupants present in the first physical area and the scene information corresponding to the first physical area.

6. The control apparatus according to claim 1 , wherein the circuitry is further configured to:

determine a size of the first physical area based on the captured at least one first image; and

determine a number of UAVs in the first plurality of UAVs based on the determined size, the number of occupants of the first set of occupants present in the first physical area, and the scene information corresponding to the first physical area.

7. The control apparatus according to claim 1 , wherein the circuitry is further configured to:

determine a context of meeting based on one of the number of occupants of the first set of occupants, the scene information, or one or more objects present in the first physical area, wherein the one or more objects are associated with at least one occupant of the first set of occupants; and

determine a number of UAVs in the first plurality of UAVs based on the determined context of meeting.

8. The control apparatus according to claim 1 , wherein the circuitry is further configured to:

recognize one or more occupants of the first set of occupants present in the first physical area;

determine a context of meeting based on profile information associated with the recognized one or more occupants; and

determine a number of UAVs in the first plurality of UAVs based on the determined context of meeting.

9. The control apparatus according to claim 1 , wherein the circuitry is further configured to:

detect a presence of a second set of occupants, different from the first set of occupants, in the first physical area;

determine a number of UAVs in a second plurality of UAVs based on the detected presence of the second set of occupants in the first physical area; and

control a movement of the first plurality of UAVs and the second plurality of UAVs in the physical 3D space to create the virtual noise cancellation boundary around the first physical area.

10. The control apparatus according to claim 1 , wherein the circuitry is further configured to:

control a plurality of image capturing devices to capture a second plurality of images of a second physical space over a period of time, wherein the second physical space includes a first physical space; and

receive the trigger input from one of the plurality of image capturing devices based on the captured second plurality of images.

11. The control apparatus according to claim 1 , wherein the circuitry is further configured to select the image capturing device from a plurality of image capturing devices, and wherein the first physical area is included in a field-of-view (FOV) of the selected image capturing device.

12. The control apparatus according to claim 1 , wherein to control the movement of the first plurality of UAVs, the circuitry is further configured to control at least one of X-axis movement, Y-axis movement, Z-axis movement, or an orientation of the first plurality of UAVs.

13. The control apparatus according to claim 1 , wherein the circuitry is further configured to:

recognize a source of a first noise inside or outside the first physical area;

determine a level of the first noise inside or outside the first physical area; and

determine a number of UAVs in the first plurality of UAVs, a 3D position of each of the first plurality of UAVs, and an orientation of each of the first plurality of UAVs based on the recognized source and the level of the first noise.

14. The circuitry according to claim 13 , further comprising a learning engine which is configured to learn the number of UAVs in the first plurality of UAVs, the 3D position, and the orientation of each of the first plurality of UAVs based on at least one of the recognized source of the first noise, the level of the first noise, the number of occupants of the first set of occupants, the scene information, or a context of meeting associated with the first set of occupants.

15. A first unmanned aerial vehicle (UAV), comprising:

an image capturing device; and

circuitry configured to:

receive a trigger input which includes information about a first physical area;

control the image capturing device to capture at least one first image of the first physical area based on the received trigger input;

determine a number of occupants of a first set of occupants present in the first physical area and scene information corresponding to the first physical area based on the captured at least one first image; and

control a movement of a second plurality of UAVs and the first UAV in a physical three-dimensional (3D) space to create a virtual noise cancellation boundary around the first physical area based on the determined number of occupants of the first set of occupants and the scene information.

16. The first UAV according to claim 15 , wherein the circuitry is further configured to transmit control instructions to each of the second plurality of UAVs to further control a 3D position in the physical 3D space and an orientation of each of the second plurality of UAVs.

17. The first UAV according to claim 15 , wherein each of the first UAV and the second plurality of UAVs includes:

a first set of audio capturing devices disposed on an outer portion of each of the first UAV and the second plurality of UAVs;

a first set of sound rendering devices disposed on an inner portion of each of the first UAV and the second plurality of UAVs;

a second set of audio capturing devices disposed on the inner portion of each of the first UAV and the second plurality of UAVs, and

a second set of sound rendering devices disposed on the outer portion of each of the first UAV and the second plurality of UAVs.

18. The first UAV according to claim 17 ,

wherein the first set of sound rendering devices reproduce a first sound wave which is out-of-phase signal of a first audio signal captured by the first set of audio capturing devices; and

wherein the second set of sound rendering devices reproduce a second sound wave which is out-of-phase of a second audio signal captured by the second set of audio capturing devices.

19. The first UAV according to claim 17 ,

wherein a first combination of the first set of audio capturing devices and the first set of sound rendering devices of each of the first UAV and the second plurality of UAVs creates the virtual noise cancellation boundary for an inside area of the first physical area from a first noise associated with an outside area of the first physical area; and

wherein a second combination of the second set of audio capturing devices and the second set of sound rendering devices of each of the first UAV and the second plurality of UAVs creates the virtual noise cancellation boundary for the outside area of the first physical area from a second noise associated with the inside area of the first physical area.

20. The first UAV according to claim 17 , wherein, based on the created virtual noise cancellation boundary around the first physical area, the circuitry is further configured to:

determine a first noise in an outside area of the first physical area and a second noise in an inside area of the first physical area through the first set of audio capturing devices and the second set of audio capturing devices respectively;

determine a number of UAVs in a third plurality of UAVs based on the determined first noise in the outside area and the second noise in the inside area of the first physical area; and

control a movement of the first UAV, the second plurality of UAVs, and the third plurality of UAVs in the physical 3D space to update the virtual noise cancellation boundary around the first physical area.

21. A method, comprising:

in a control apparatus:

receiving a trigger input which includes information about a first physical area;

controlling an image capturing device to capture at least one first image of the first physical area based on the received trigger input;

determining a number of occupants of a first set of occupants present in the first physical area and scene information corresponding to the first physical area based on the captured at least one first image; and

controlling a movement of a first plurality of unmanned aerial vehicles (UAVs) in a physical three-dimensional (3D) space to create a virtual noise cancellation boundary around the first physical area based on the determined number of occupants of the first set of occupants and the scene information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2019
From: SADHWANI, HEMANT; SULIBHAVI, MADHVESH
To: SONY CORPORATION
Reel/Frame 050983/0067 →
Continuity (1)
Related Publication 20210142776A1 · May 13, 2021