IP Library › Granted Patent US 12,732,783
Granted Patent B2
US 12,732,783 · App. 18/568,080 · Granted Sep 8, 2026

Controlling electronic devices by aerial vehicles

Inventors: Peter Exner (Malmö, SE); Hannes Bergkvist (Rydeback, SE)
Assignee: Sony Group Corporation
H04W4/38B64U10/13H04W4/40B64U2201/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,732,783
App. No.
18/568,080
Granted
Sep 8, 2026
Kind
B2
Abstract

An electronic device comprises a sensor arrangement, a control system operable to obtain sensor data from the sensor arrangement, and a microphone configured to provide an audio signal representing sound waves received by the microphone. The control system processes ( 102 ) the audio signal for detection of an audio characteristic feature, ACF, representing an operating parameter of a propulsion system in an aerial vehicle, and, upon said detection, performs ( 104 ) a dedicated action related to the sensor data. The dedicated action may comprise obtaining and/or transmitting at least part of the sensor data. To control the electronic device, the aerial vehicle is configured to, intermittently while on a flight path, cause its propulsion system ( 22 ) to impart a predefined and audible modification of an operating parameter of the propulsion system ( 22 ) to thereby generate sound waves that include the ACF.

Claims (28)

1 . An electronic device, comprising:

a sensor arrangement,

a control system circuitry operable to obtain sensor data from the sensor arrangement, and

a microphone configured to provide an audio signal representing sound waves received by the microphone,

wherein the control system circuitry is configured to process the audio signal for detection of an audio characteristic feature representing an operating parameter of a propulsion system of an aerial vehicle, and, upon said detection, perform a dedicated action related to the sensor data, wherein the audio characteristic feature is a predefined modulation of an operating frequency of the propulsion system of the aerial vehicle, and the control system circuitry is configured to perform different dedicated actions depending on a property of the audio characteristic feature.

2 . The electronic device of claim 1 , wherein the operating frequency is a blade passing frequency of a rotor driven by the propulsion system.

3 . The electronic device of claim 1 , wherein the control system circuitry, to detect the audio characteristic feature, is configured to process the audio signal for detection of the modulation, determine a frequency of the modulation, and evaluate the frequency in relation to one or more predefined frequencies.

4 . The electronic device of claim 1 , wherein the property is a frequency of the modulation.

5 . The electronic device of claim 1 , which further comprises a communication unit for wireless data transmission, wherein the dedicated action comprises transmitting, by the communication unit, a wireless signal to represent one or more sensor data readings by the sensor arrangement.

6 . The electronic device of claim 5 , wherein the control system circuitry is configured to obtain sensor data from the sensor arrangement in accordance with a predefined schedule and store the sensor data in a memory, and wherein the dedicated action comprises retrieving at least a subset of stored sensor data in the memory and transmitting, by the communication unit, the wireless signal to represent said at least a subset of the stored sensor data.

7 . The electronic device of claim 6 , wherein control system circuitry is configured to select said at least a subset based on the audio characteristic feature.

8 . The electronic device of claim 6 , wherein the subset represents at least one sensor parameter among a plurality of sensor parameters that are detectable by the sensor arrangement.

9 . The electronic device of claim 6 , wherein the control system circuitry is configured to, if said at least a subset of stored sensor data is unavailable in the memory, transmit the wireless signal to indicate a lack of measurement data.

10 . The electronic device of claim 5 , wherein the control system circuitry is configured to start processing the audio signal for detection of the audio characteristic feature when a magnitude of the audio signal corresponds to sound waves received by the microphone from the propulsion system when the aerial vehicle is spaced from the electronic device by a predefined distance, wherein the predefined distance is less than a range of the wireless signal.

11 . The electronic device of claim 1 , wherein the dedicated action comprises obtaining a sensor data reading from the sensor arrangement.

12 . The electronic device of claim 1 , which is operable in at least a low-power state and a high-power state, wherein the control system circuitry is configured to set the electronic device in the high-power state upon said detection of the audio characteristic feature, and wherein the control system circuitry comprises a detector, which is operable to process the audio signal for detection of the audio characteristic feature while the electronic device is in the low-power state.

13 . The electronic device of claim 12 , wherein the detector comprises a pipeline of sub-units which are operated in sequence to detect the audio characteristic feature in the audio signal, wherein the pipeline comprises a first sub-unit, which is configured to process the audio signal for determination of a magnitude value and to selectively activate, based on the magnitude value, one or more further sub-units in the pipeline.

14 . The electronic device of claim 13 , wherein the one or more further sub-units comprise a second sub-unit, a third sub-unit, and a fourth sub unit, wherein the second sub-unit is configured to operate a bandpass filter on the audio signal to generate a filtered audio signal, the bandpass filter being configured to transmit the operating frequency, wherein the third sub-unit is configured to process the filtered audio signal to generate a time sequence of frequency values of a dominating frequency in the filtered audio signal, and wherein the fourth sub-unit is configured to process the time sequence of frequency values to determine a frequency of the modulation of the operating frequency.

15 . An aerial vehicle, comprising:

a propulsion system;

a positioning system; and

a control system circuitry, which is configured to operate the propulsion system to move the aerial vehicle along a flight path based on position data from the positioning system,

wherein the control system circuitry is further configured to intermittently cause the propulsion system to impart a predefined and audible modification of an operating frequency of the propulsion system, wherein the predefined and audible modification is a predefined modulation of the operating frequency by a predefined modulation frequency, and wherein the control system circuitry is configured to cause the propulsion system to impart different modulations of the operating frequency to perform different dedicated actions at an electronic device depending on a property of an audio characteristic feature resulting from the predefined modulations.

16 . The aerial vehicle of claim 15 , further comprising a communication unit for wireless data communication, wherein the control system circuitry is configured to, after causing the propulsion system to impart the predefined and audible modification, operate the communication unit to listen for one or more data transmissions containing sensor data.

17 . The aerial vehicle of claim 16 , wherein the control system circuitry is configured to, if the one or more data transmissions are not received, modify the flight path.

18 . A method of operating an electronic device, said method comprising:

processing an audio signal representing sound waves received by a microphone in the electronic device, to detect an audio characteristic feature originating from a propulsion system of an aerial vehicle; and

performing, upon said detection, a dedicated action related to sensor data detectable by a sensor arrangement associated with the electronic device, wherein the audio characteristic feature is a predefined modulation of an operating frequency of the propulsion system of the aerial vehicle, and wherein different dedicated actions are performed depending on a property of the audio characteristic feature.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2024
From: BERGKVIST, HANNES; EXNER, PETER
To: SONY EUROPE BV
Reel/Frame 066019/0036 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2024
From: SONY EUROPE BV
To: SONY GROUP CORPORATION
Reel/Frame 066019/0090 →
Priority Claims (1)
SE 2150904-7 · Jul 7, 2021 · national
Continuity (1)
Related Publication 20240276186A1 · Aug 15, 2024
References Cited (14)
US 9275645B2 · Hearing · 2016 [cited by applicant]
US 9949450B2 · Richings, Sr. · 2018 [cited by applicant]
US 10181332B1 · Laag · 2019 [cited by applicant]
US 10659144B1 · Tofighbakhsh · 2020 [cited by applicant]
US 10728336B2 · Akhtar · 2020 [cited by applicant]
US 20140024313A1 · Campbell · 2014 [cited by applicant]
US 20150302858A1 · Hearing · 2015 [cited by applicant]
US 20170234724A1 · Naguib · 2017 [cited by applicant]
US 20180091908A1 · Goel · 2018 [cited by applicant]
US 20190035288A1 · Beltman · 2019 [cited by applicant]
US 20200354056A1 · Borras · 2020 [cited by examiner]
WO 2020109440A1 · 2020 [cited by applicant]
International Search Report and Written Opinion from corresponding International Application No. PCT/EP2022/062862, mailed on Sep. 8, 2022, 10 pages. [cited by applicant]
Office Action and Swedish Search Report from corresponding Swedish Application No. 2150904-7, mailed on Mar. 11, 2022, 7 pages. [cited by applicant]