IP Library › Granted Patent US 10,659,684
Granted Patent B2
US 10,659,684 · App. 15/431,210 · Granted May 19, 2020

Apparatus and method for providing dynamic panorama function

Inventors: Si Hyoung Lee (Yongin-si, KR); Jae Hyun Kim (Suwon-si, KR); In Sun Song (Gwangmyeong-si, KR); Hoo Hyoung Lee (Suwon-si, KR); Ji Hwan Choe (Bucheon-si, KR); Ki Woong Kim (Damyang-gun, KR); Dong Jun Seo (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23238G06T7/33H04N5/04H04N5/23293G06T2207/10016H04N5/23258H04N7/0127
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,659,684
App. No.
15/431,210
Granted
May 19, 2020
Kind
B2
Abstract

An electronic device and a method of operating a panorama function in the electronic device are provided. The electronic device includes at least one processor, a memory, a camera configured to sequentially obtain a plurality of images if an image capture is started, and a sensor configured to sense motion of the electronic device. The at least one processor is configured to store in the memory a panorama content file comprising panorama image data and dynamic panorama data generated based on the plurality of images and the motion of the electronic device sensed during the image capture.

Claims (56)

1. An electronic device comprising:

at least one processor;

a memory;

a display;

a camera configured to sequentially obtain a plurality of images if-based on an image capture starting; and

a sensor configured to sense motion of the electronic device,

wherein the at least one processor is configured to:

store in the memory a panorama content file comprising panorama image data and dynamic panorama data generated based on the plurality of images and the motion of the electronic device sensed during the image capture,

reproduce a panorama video rendered in a first order on the display, based on the dynamic panorama data, and

reproduce the panorama video rendered in a second order opposite to the first order on the display, based on an event occurring during reproduction of the panorama video rendered in the first order.

2. The electronic device of claim 1 , wherein the dynamic panorama data is generated based on images and analysis information used to generate the panorama image data.

3. The electronic device of claim 1 , further comprising:

a dynamic panorama generator configured to be implemented with hardware,

wherein the memory is configured to store a first instruction set for implementing a panorama image generator and a second instruction set for implementing a last file generator.

4. The electronic device of claim 3 ,

wherein the panorama image generator is configured to:

generate the panorama image data during the image capture in progress, and

provide analysis information, used to generate the panorama image data, to the dynamic panorama generator, and

wherein the dynamic panorama generator is further configured to generate the dynamic panorama data during the image capture.

5. The electronic device of claim 4 , wherein the last file generator is configured to generate the panorama content file based on the panorama image data obtained from the panorama image generator and the dynamic panorama data obtained from the dynamic panorama generator, based on the image capture stopping.

6. The electronic device of claim 1 ,

wherein the panorama image data is generated to have a resolution of a first height and a first width, and

wherein the dynamic panorama data is generated to output a virtual field of view (FOV) corresponding to the first height and the first width during a time, when reproduced by the at least one processor.

7. The electronic device of claim 6 , wherein the dynamic panorama data is configured to be rendered at a variable frame rate, when reproduced by the at least one processor.

8. The electronic device of claim 6 , wherein the dynamic panorama data is configured to be rendered at a constant frame rate, when reproduced by the at least one processor.

9. The electronic device of claim 2 , further comprising:

a microphone configured to obtain audio data during the image capture,

wherein the dynamic panorama data is generated based on the plurality of images, the analysis information, and the audio data.

10. The electronic device of claim 9 , wherein the dynamic panorama data is generated to synchronize a time when each of the plurality of images is obtained with a time when the audio data is obtained.

11. The electronic device of claim 1 ,

wherein the memory is further configured to store an application associated with the panorama content file, and

wherein the at least one processor is further configured to display an item corresponding to the dynamic panorama data, based on the panorama image data being displayed by the application.

12. The electronic device of claim 11 , wherein the at least one processor is further configured to reproduce the dynamic panorama data, based on selection of the item.

13. The electronic device of claim 1 , wherein the dynamic panorama data comprises video data in which images used to generate the panorama image data are encoded.

14. An electronic device comprising:

a memory;

a camera configured to sequentially obtain a plurality of images when an image capture is started;

a display;

a sensor configured to sense motion of the electronic device; and

at least one processor configured to:

generate panorama image data based on the plurality of images and the motion of the electronic device sensed during the image capture,

store a panorama content file, comprising the panorama image data and dynamic panorama data corresponding to the panorama image data, and metadata, comprising information about the plurality of images and analysis information used to generate the panorama image data, in the memory,

reproduce a panorama video rendered in a first order on the display, based on the dynamic panorama data and the metadata, and

reproduce a panorama video rendered in a second order opposite to the first order on the display, based on an event occurring during reproduction of the panorama video rendered in the first order.

15. The electronic device of claim 14 , wherein the at least one processor is further configured to display an item corresponding to the dynamic panorama data when a panorama image is displayed on the display.

16. The electronic device of claim 15 , wherein the at least one processor is further configured to reproduce the panorama video rendered in the first order on the display, based on selection of the item.

17. The electronic device of claim 14 , wherein the event comprises at least one of an occurrence of a previously defined user input or a sensing of a previously defined motion by the sensor.

18. The electronic device of claim 14 , wherein the event comprises a reproduction of a last frame of the panorama video rendered in the first order.

19. A method of operating a panorama function of an electronic device, the method comprising:

obtaining a plurality of images via a camera of the electronic device;

sensing motion of the electronic device, while obtaining the plurality of images;

generating panorama image data based on the plurality of images and the motion;

generating dynamic panorama data based on the plurality of images and analysis information used to generate the panorama image data;

generating a panorama content file comprising the panorama image data and the dynamic panorama data;

reproducing a panorama video rendered in a first order on a display, based on the dynamic panorama data, based on selection of an item corresponding to the dynamic panorama data; and

reproducing a panorama video rendered in a second order opposite to the first order on the display, based on an event occurring during reproduction of the panorama video rendered in the first order.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2017
From: LEE, SI HYOUNG; KIM, JAE HYUN; SONG, IN SUN; LEE, HOO HYOUNG; CHOE, JI HWAN; KIM, KI WOONG; SEO, DONG JUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 041241/0435 →
Priority Claims (1)
KR 10-2016-0017863 · Feb 16, 2016 · national
Continuity (1)
Related Publication 20170237901A1 · Aug 17, 2017