IP Library Granted Patent US 9,612,311
Granted Patent B2
US 9,612,311 · App. 14/797,820 · Granted Apr 4, 2017

Method and apparatus for associating audio objects with content and geo-location

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,612,311
App. No.
14/797,820
Granted
Apr 4, 2017
Kind
B2
Abstract

An approach is provided for efficiently capturing, processing, presenting, and/or associating audio objects with content items and geo-locations. A processing platform may determine a viewpoint of a viewer of at least one content item associated with a geo-location. Further, the processing platform and/or a content provider may determine at least one audio object associated with the at least one content item, the geo-location, or a combination thereof. Furthermore, the processing platform may process the at least one audio object for rendering one or more elements of the at least one audio object based, at least in part, on the viewpoint.

Claims (58)

1. A method comprising:

determining, by an apparatus, a perspective of a recipient of at least one content item associated with a geo-location, the perspective representative of the recipient consuming the content item at the geo-location;

determining, by an apparatus, at least one ambient audio object associated with the at least one content item and recorded at the geo-location for a plurality of perspectives that include the perspective; and

processing, by the apparatus, the at least one ambient audio object for rendering some elements of the at least one ambient audio object corresponding to the perspective.

2. A method of claim 1 , further comprising

processing the at least one content item for determining at least one physical object, a plurality of audio sources associated with the at least one physical object; and

determining positions of the audio sources relative to the geo-location,

wherein the perspective indicates a distance, an angle, and an elevation of each of the audio sources that are audible at the geo-location.

3. A method of claim 2 , further comprising:

determining a change of the perspective of the recipient, a physical movement of the recipient with respect to the geo-location, a moving speed of the physical movement, or the combination thereof; and

initiating a synthesis of one or more segments of the at least one ambient audio object, the one or more elements, or a combination thereof, based, at least in part, on the change, the movement, the moving speed, or a combination thereof.

4. A method of claim 3 , further comprising:

initiating rendering of the one or more segments of the at least one ambient audio object based, at least in part, on the synthesis.

5. A method of claim 1 , further comprising

searching for one or more other geo-locations sharing one or more aural characteristics of the at least one ambient audio object, the one or more elements, or a combination thereof, associated with the geo-location.

6. A method of claim 5 , further comprising

receiving a user selection of the geo-location on a digital map,

wherein the at least one search is based, at least in part, on a predetermined distance from the geo-location.

7. A method of claim 1 , further comprising

initiating a recordation of the at least one ambient audio object concurrently with a capture of a street view presentation of the geo-location.

8. A method of claim 1 , further comprising:

searching for the geo-location, one or more physical objects included in the at least one content item, or a combination thereof based, at least in part, on the at least one ambient audio object.

9. A method of claim 1 , further comprising:

modifying the at least one ambient audio object to protect privacy, copyright, or a combination thereof.

10. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine a perspective of a recipient of at least one content item associated with a geo-location, the perspective representative of the recipient consuming the content item at the geo-location;

determine at least one ambient audio object associated with the at least one content item and recorded at the geo-location for a plurality of perspectives that include the perspective; and

process the at least one ambient audio object for rendering some elements of the at least one ambient audio object corresponding to the perspective.

11. An apparatus of claim 10 , wherein the apparatus is further caused to:

process the at least one content item for determining at least one physical object, a plurality of audio sources associated with the at least one physical object; and

determine positions of the audio sources relative to the geo-location.

12. An apparatus of claim 11 , wherein the apparatus is further caused to:

determine a change of the perspective of the recipient, a physical movement of the recipient with respect to the geo-location, or the combination thereof; and

initiate a synthesis of one or more segments of the at least one ambient audio object, the one or more elements, or a combination thereof, based, at least in part, on the change, the movement, or a combination thereof.

13. An apparatus of claim 12 , wherein the apparatus is further caused to:

initiate rendering of the one or more segments of the at least one audio ambient object based, at least in part, on the synthesis.

14. An apparatus of claim 10 , wherein the apparatus is further caused to:

search for one or more other geo-locations sharing one or more aural characteristics of the at least one ambient audio object, the one or more elements, or a combination thereof, associated with the geo-location.

15. An apparatus of claim 14 , wherein the apparatus is further caused to:

receive a user selection of the geo-location on a digital map,

wherein the at least one search is based, at least in part, on a predetermined distance from geo-location.

16. An apparatus of claim 10 , wherein the apparatus is further caused to:

initiate a recordation of the at least one ambient audio object concurrently with a capture of a street view presentation of the geo-location.

17. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

determining a perspective of a recipient of at least one content item associated with a geo-location, the perspective representative of the recipient consuming the content item at the geo-location;

determining at least one ambient audio object associated with the at least one content item and recorded at the geo-location for a plurality of perspectives that include the perspective; and

processing the at least one ambient audio object for rendering some elements of the at least one ambient audio object corresponding to the perspective.

18. A non-transitory computer-readable storage medium of claim 17 , wherein the apparatus is caused to further perform:

processing the at least one content item for determining at least one physical object, a plurality of audio sources associated with the at least one physical object; and

determining positions of the audio sources relative to the geo-location.

19. A non-transitory computer-readable storage medium of claim 18 , wherein the apparatus is caused to further perform:

determining a change of the perspective of the recipient, a physical movement of the recipient with respect to the geo-location, or the combination thereof; and

initiating a synthesis of one or more segments of the at least one ambient audio object, the one or more elements, or a combination thereof, based, at least in part, on the change, the movement, or a combination thereof.

20. A non-transitory computer-readable storage medium of claim 19 , wherein the apparatus is caused to further perform:

initiating rendering of the one or more segments of the at least one ambient audio object based, at least in part, on the synthesis.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: PIECE FUTURE PTE LTD
To: TECHNOCORP PTE LTD
Reel/Frame 063944/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2019
From: NOKIA TECHNOLOGIES OY
To: PIECE FUTURE PTE LTD
Reel/Frame 049178/0456 →
CHANGE OF NAME Recorded Feb 19, 2019
From: NOKIA TECHNOLOGIES OY
To: PIECE FUTURE PTE LTD
Reel/Frame 048376/0576 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2015
From: JARSKE, PETRI; ARRASVUORI, JUHA HENRIK; RAMO, ANSSI; VASILACHE, ADRIANA; LYNCH, JAMES
To: NOKIA TECHNOLOGIES OY
Reel/Frame 036669/0940 →