IP Library › Granted Patent US 11,792,512
Granted Patent B2
US 11,792,512 · App. 17/286,281 · Granted Oct 17, 2023

Panoramas

Inventors: Miikka Tapani Vilermo (Siuro, FI); Arto Juhani Lehtiniemi (Lempäälä, FI); Lasse Juhani Laaksonen (Tampere, FI); Tapani Pihlajakuja (Kellokoski, FI)
Assignee: Nokia Technologies Oy
H04N23/67H04N23/6812H04N23/698H04S7/30H04S2400/11H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,792,512
App. No.
17/286,281
Granted
Oct 17, 2023
Kind
B2
Abstract

An apparatus, method and computer program is described comprising: capturing a plurality of visual images from an image capturing start time to an image capturing end time, for use in generating a panorama image; and capturing audio data relating to said visual images from an audio capturing start time to an audio capturing end time.

Claims (50)

1. An apparatus comprising:

at least one processor; and

at least one non-transitory memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

determining a smooth trajectory period for the apparatus;

receiving a plurality of visual images from an image capturing start time to an image capturing end time, for use in generating a panorama image;

receiving audio data relating to said plurality of visual images from an audio capturing start time to an audio capturing end time, for use in generating output audio, wherein at least one of:

the audio capturing start time is defined with a start of the smooth trajectory period, or

the audio capturing end time is defined with an end of the smooth trajectory period; and

presenting the generated panorama image with the generated output audio.

2. The apparatus as claimed in claim 1 , further caused to perform defining one or more focus elements within the audio data.

3. The apparatus as claimed in claim 2 , wherein said one or more focus elements comprise at least one of:

one or more time periods; or

one or more zones.

4. The apparatusas claimed in claim 2 , wherein the one or more focus elements are user defined.

5. The apparatus as claimed in claim 2 , further caused to perform determining said one or more focus elements.

6. The apparatus as claimed in claim 1 , further caused to perform defining at least one of the audio capturing start time or the audio capturing end time.

7. The apparatus as claimed in claim 1 , wherein at least one of:

the image capturing start time or the image capturing end time is user defined; or

the audio capturing start time or the audio capturing end time is user defined.

8. The apparatus as claimed in claim 1 , further caused to perform defining a field-of-view of the audio data, wherein the output audio is generated for presentation with panorama image based, at least partially, on the field-of-view.

9. The apparatus as claimed in claim 8 , wherein the field-of-view of the audio data is scaled based on a relative size of a first arc, between the image capturing start time and the image capturing end time, with respect to a second arc, between the audio capturing start time and the audio capturing end time.

10. The apparatus as claimed in claim 1 , further caused to perform:

defining a reference direction of the panorama image; and

modifying the audio data in a range of directions generally opposite to said reference direction, wherein the audio data in the range of directions generally opposite to said reference direction is modified such that, when presented with the panorama image, said modified audio data appears to originate from a single direction.

11. The apparatus as claimed in claim 1 , wherein the generated output audio comprises spatial audio that is spatially presented with respect to the generated panorama image.

12. The apparatus as claimed in claim 1 , wherein the image capturing start time is at least partially different from the audio capturing start time, and wherein the image capturing end time is at least partially different from the audio capturing end time.

13. A method comprising:

determining a smooth trajectory period for visual capture;

receiving a plurality of visual images from an image capturing start time to an image capturing end time, for use in generating a panorama image;

receiving audio data relating to said plurality of visual images from an audio capturing start time to an audio capturing end time, for use in generating output audio, wherein at least one of:

the audio capturing start time is defined with a start of the smooth trajectory period, or

the audio capturing end time is defined with an end of the smooth trajectory period; and

presenting the generated panorama image with the generated output audio.

14. The method as claimed in claim 13 , further comprising defining one or more focus elements within the audio data.

15. The method as claimed in claim 14 , wherein said one or more focus elements comprise at least one of:

one or more time periods; or

one or more zones.

16. The method as claimed in claim 14 , wherein the one or more focus elements are user defined.

17. The method as claimed in claim 14 , further comprising determining said one or more focus elements.

18. The method as claimed in claim 13 , further comprising defining at least one of the audio capturing start time or the audio capturing end time.

19. The method as claimed in claim 13 , wherein at least one of:

the image capturing start time or the image capturing end time is user defined; or

the audio capturing start time or the audio capturing end time is user defined.

20. A non-transitory computer readable medium comprising program instructions stored thereon for performing at least the following:

determining a smooth trajectory period for visual capture;

receiving a plurality of visual images from an image capturing start time to an image capturing end time, for use in generating a panorama image;

receiving audio data relating to said plurality of visual images from an audio capturing start time to an audio capturing end time, for use in generating output audio, wherein at least one of:

the audio capturing start time is defined with a start of the smooth trajectory period, or

the audio capturing end time is defined with an end of the smooth trajectory period; and

presenting the generated panorama image with the generated output audio.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2021
From: VILERMO, MIIKKA TAPANI; LEHTINIEMI, ARTO JUHANI; LAAKSONEN, LASSE JUHANI; PIHLAJAKUJA, TAPANI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 055946/0047 →
Priority Claims (1)
EP 18205015 · Nov 7, 2018 · regional
Continuity (1)
Related Publication 20210344831A1 · Nov 4, 2021