IP Library Granted Patent US 10,248,205
Granted Patent B2
US 10,248,205 · App. 14/780,675 · Granted Apr 2, 2019

Apparatus for recording audio and vibration content of event

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,248,205
App. No.
14/780,675
Granted
Apr 2, 2019
Kind
B2
Abstract

An apparatus comprising: at least one first input configured to receive at least one first sensor signal, the at least one first sensor signal having a first modality; at least one second input configured to receive at least one second sensor signal, the at least one second sensor signal having a second modality different from the first modality; and a codec configured to generate at least one meta signal comprising and stored using separate resources the at least one first sensor signal and the at least one second sensor signal.

Claims (54)

1. A method comprising:

receiving, at an electronic device, at a first input at least one first sensor signal from a first type of sensor, wherein the first type of sensor is outputting the at least one first sensor signal during capturing a physical event, the at least one first sensor signal having a first modality comprising an audio portion of the physical event having a first frequency response;

receiving, at the electronic device, at a second sensor input from a second type of sensor at least one second sensor signal, wherein the second type of sensor is outputting the at least one second sensor signal during capturing the physical event, the at least one second sensor signal having a second modality comprising a vibration portion of the physical event having a second frequency response wherein the second frequency response is different than the first frequency response; and

generating, at the electronic device, at least one meta signal comprising the at least one first sensor signal and the at least one second sensor signal, comprising providing the audio portion and the vibration portion of the physical event in the at least one meta signal as a plurality of channels based on the first type of sensor and the second type of sensor of the electronic device so as to reproduce the audio portion and the vibration portion of the physical event synchronously.

2. The method as claimed in claim 1 , wherein the plurality of channels being assigned such that at least one channel comprises the at least one first sensor signal and at least one different channel comprises the at least one second sensor signal.

3. The method as claimed in claim 1 , further comprising at least one of:

storing the at least one meta signal in a memory; and

transmitting the at least one meta signal to at least one apparatus separate from the electronic device.

4. The method as claimed in claim 1 , further comprising:

processing the at least one first sensor signal and the at least one second sensor signal prior to generating the at least one meta signal such that each of the at processed least one first sensor signal and the at least one second sensor signal comprises a respective range of values for each of the at least one first sensor signal and the at least one second sensor signal that is suitable for the generating of the at least one meta signal.

5. The method as claimed in claim 4 , wherein processing the at least one first sensor signal and the at least one second sensor signal comprises equalizing one of the at least one first sensor signal and the at least one second sensor signal based on a another one of the at least one first sensor signal and the at least one second sensor signal to compensate for at least one of a first and second sensor type response, surrounding acoustics, or a vibration path of the electronic device.

6. The method as claimed in claim 1 , further comprising:

receiving at least one further sensor signal, the at least one further sensor signal having a modality different from the at least one first sensor signal and the at least one second sensor signal; and

wherein generating the at least one meta signal comprising the at least one first sensor signal and the at least one second sensor signal comprises generating the at least one meta signal comprising the at least one first sensor signal, the at least one second sensor signal and the at least one further sensor signal.

7. The method as claimed in claim 1 , wherein the audio portion comprises at least one audio signal, and receiving the at least one first sensor signal comprises receiving the at least one audio signal from at least one of: at least one microphone of the electronic device, at least one memory of the electronic device, and at least one microphone that is separate from the electronic device.

8. The method as claimed in claim 1 , wherein at least one of the at least one first sensor signal and the at least one second sensor signal is received based on receiving at least one touch sensor signal, and wherein receiving the at least one touch sensor signal is from at least one of:

at least one touch sensor associated with a display of the electronic device, at least one memory of the electronic device, and at least one touch sensor that is separate from the electronic device.

9. The method as claimed in claim 1 , wherein at least one of the at least one first sensor signal and the at least one second sensor signal comprises at least one accelerometer signal, and receiving the at least one of the at least one first sensor signal and the at least one second sensor signal comprises receiving the at least one accelerometer signal from at least one of;

at least one accelerometer associated with the electronic device, at least one memory of the electronic device, and at least one accelerometer that is separate from the electronic device.

10. The method as claimed in claim 1 , wherein there is:

wherein the first type of sensor has a first directional sensitivity to an input and the second type of sensor has a second different directional sensitivity to the input.

11. The method as claimed in claim 1 , further comprising:

storing the at least one meta signal, the at least one first sensor signal and the at least one second sensor signal with separate resources, wherein the separate resources are at least one of channels; frequency; and time periods.

12. The method as claimed in claim 1 , wherein generating the at least one meta signal comprises the plurality of channels are grouped according to a location of their origin at the electronic device.

13. A method comprising:

receiving, at an apparatus, at least one meta signal, comprising:

at least one first sensor signal from a first type of sensor output during capturing a physical event, the at least one first sensor signal having a first modality comprising an audio portion of the physical event having a first frequency response; and

at least one second sensor signal from a second type of sensor, wherein the at least one second sensor signal is received during capturing the physical event, the at least one second sensor signal having a second modality comprising a vibration portion of the physical event having a second frequency response wherein the second frequency response is different than the first frequency response,

wherein the audio portion and the vibration portion of the physical event are provided in the at least one meta signal as a plurality of channels based on the first type of sensor and the second type of sensor so as to reproduce the audio portion and the vibration portion of the physical event synchronously; and

wherein the at least one first sensor signal and the at least one second sensor signal are stored within the at least one meta signal; and

separating, at the apparatus, the at least one meta signal to generate the at least one first sensor signal and the at least one second sensor signal.

14. The method as claimed in claim 13 , wherein receiving the at least one meta signal comprises at least one of: receiving the at least one meta signal from a memory of the apparatus; and receiving the at least one meta signal from another apparatus separate from the apparatus.

15. The method as claimed in claim 13 , wherein the audio portion comprises at least one audio signal, the method further comprising:

outputting the at least one audio signal to at least one of at least one audio transducer of the apparatus, at least one memory of the apparatus, and at least one other apparatus that is separate from the apparatus.

16. The method as claimed in claim 13 , wherein at least one of the at least one first sensor signal and the at least one second sensor signal is received based on receiving at least one touch sensor signal,

wherein receiving the at least one touch sensor signal is from at least one of: at least one tactile effect transducer associated with a display of the apparatus, at least one memory of the apparatus, and another apparatus that is separate from the apparatus.

17. The method as claimed in claim 13 , wherein at least one of the at least one first sensor signal and the at least one second sensor signal comprises at least one accelerometer signal from at least one accelerometer, and the method further comprises: outputting the at least one accelerometer signal from the at least one accelerometer to at least one other apparatus that is separate from the apparatus.

18. The method as claimed in claim 13 , further comprising:

separating the at least one meta signal using separate resources to generate the at least one first sensor signal and the at least one second sensor signal, wherein the separate resources are at least one of: channels; frequency; and time periods.

19. The method as claimed in claim 13 , wherein the first sensor has a first directional sensitivity to an input and the second type of sensor has a second different directional sensitivity to the input.

20. An apparatus comprising:

at least one processor and

at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to at least:

receive at a first input at least one first sensor signal from a first type of sensor, wherein the first type of sensor is outputting the at least one first sensor signal during capturing a physical event, the at least one first sensor signal having a first modality comprising an audio portion of the physical event having a first frequency response;

receive at a second input at least one second sensor signal from a second type of sensor, wherein the second type of sensor is outputting the at least one second sensor signal during capturing the physical event, the at least one second sensor signal having a second modality comprising a vibration portion of the physical event having a second frequency response wherein the second frequency response is different than the first frequency response; and

generate at least one meta signal comprising the at least one first sensor signal and the at least one second sensor signal, comprising providing the audio portion and the vibration portion of the physical event in the at least one meta signal as a plurality of channels based on the first type of sensor and the second type of sensor so as to reproduce the audio portion and the vibration portion of the physical event synchronously.

21. An apparatus comprising:

at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to at least:

receive at least one meta signal, comprising:

at least one first sensor signal from a first type of sensor, wherein the first type of sensor is outputting the at least one first sensor signal during capturing a physical event, the at least one first sensor signal having a first modality comprising an audio portion of the physical event having a first frequency response, and

at least one second sensor signal from a second type of sensor, wherein the at least one second sensor signal is received during capturing the physical event, the at least one second sensor signal having a second modality comprising a vibration portion of the physical event having a second frequency response wherein the second frequency response is different than the first frequency response,

wherein the audio portion and the vibration portion, are provided in the at least one meta signal as a plurality of channels based on the first type of sensor and the second type of sensor so as to reproduce the audio portion and the vibration portion of the physical event synchronously; and

wherein the at least one first sensor signal and the at least one second sensor signal are stored within the at least one meta signal using separate resources; and

separate the at least one meta signal to generate the at least one first sensor signal and the at least one second sensor signal.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2024
From: PIECE FUTURE PTE. LTD.
To: MUXIC LIMITED
Reel/Frame 069311/0873 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2022
From: NOKIA TECHNOLOGIES OY
To: PIECE FUTURE PTE LTD
Reel/Frame 058673/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2015
From: BRODKIN, PANU PETRI
To: NOKIA CORPORATION
Reel/Frame 036668/0446 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 036668/0507 →