IP Library › Granted Patent US 11,006,048
Granted Patent B2
US 11,006,048 · App. 16/345,678 · Granted May 11, 2021

Method and apparatus for acquiring omnidirectional video

Inventors: Yongsang Yun (Suwon-si, KR); Dongil Son (Hwaseong-si, KR); Jongchul Choi (Suwon-si, KR); Seungnyun Kim (Incheon, KR); Changryong Heo (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23299G06T7/20G06T7/50G06T7/70H04N5/23203H04N5/23216H04N5/23238H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,006,048
App. No.
16/345,678
Granted
May 11, 2021
Kind
B2
Abstract

An electronic apparatus according to a variety of embodiments comprises: a rotation part for rotating a plurality of cameras; a memory for storing instructions; and a processor electrically connected to the rotation part and memory, wherein the memory can store, when being executed, instructions for the processor to: acquire at least one item of image data by means of the cameras; check in the image data whether at least a portion of an object is located in an overlap area; and, if at least a portion of an object is located in the overlap area, then modify the filming direction of the cameras by means of the rotation part.

Claims (80)

1. An electronic device comprising:

a plurality of cameras;

a rotation part configured to rotate the plurality of cameras;

a memory; and

a processor electrically connected to the rotation part and the memory,

wherein the memory stores instructions causing, upon execution, the processor to:

acquire at least one image data by using the cameras,

determine, from the image data, whether an object is located at least in part in a superposition area,

change a capture view of the cameras by using the rotation part when the object is located at least in part in the superposition area, so that the object is located outside the superposition area,

track a movement direction of the object from the image data,

determine a rotation direction of the cameras, based on the movement direction of the object, when the object is located at least in part in the superposition area,

change the capture view of the cameras by using the rotation part in accordance with the determined rotation direction, and

determine the rotation direction of the cameras in a direction opposite to the movement direction of the object when the object is located at least in part in the superposition area.

2. The electronic device of claim 1 , wherein the memory stores instructions causing, upon execution, the processor to:

calculate a distance between the electronic device and the object from the image data, and

change the capture view of the cameras by using the rotation part when the object is located at least in part in the superposition area and when the calculated distance is within a predetermined threshold.

3. The electronic device of claim 2 , further comprising:

a sensor module,

wherein the memory stores instructions causing, upon execution, the processor to:

acquire sensor data on the object by using the sensor module,

determine, from the image data or the sensor data, whether the object is located at least in part in the superposition area, and

calculate the distance between the electronic device and the object from the image data or the sensor data.

4. The electronic device of claim 2 , wherein the memory stores instructions causing, upon execution, the processor to:

generate an omnidirectional image, based on the image data, and

perform a rotation correction for the omnidirectional image, based on a changing degree of the capture view when the capture view of the cameras is changed.

5. The electronic device of claim 1 , further comprising:

a communication module,

wherein the memory stores instructions causing, upon execution, the processor to:

receive an instruction for a main object designation from an external device via the communication module,

designate a main object based on the instruction for the main object designation, and

change the capture view of the cameras by using the rotation part when the main object is located at least in part in the superposition area.

6. The electronic device of claim 5 , further comprising:

a sensor module,

wherein the memory stores instructions causing, upon execution, the processor to:

acquire sensor data on the object by using the sensor module,

calculate a distance between the electronic device and the main object by using at least one of the image data and the sensor data, and

change the capture view of the cameras by using the rotation part when the main object is located at least in part in the superposition area and when the calculated distance is within a predetermined threshold.

7. The electronic device of claim 1 , further comprising:

a communication module,

wherein the memory stores instructions causing, upon execution, the processor to:

generate an omnidirectional image, based on the image data, and

transmit the omnidirectional image to an external device by using the communication module.

8. The electronic device of claim 1 , wherein the superposition area is determined based on an angle of view and a capture view of the plurality of cameras, and is at least a portion of an omnidirectional image generated by the plurality of cameras.

9. The electronic device of claim 1 , wherein the processor is configured to:

recognize at least one object from the image data,

determine a rotation direction of the cameras so as to minimize the objects located in the superposition area when more than two objects are recognized, and

changes the capture view of the cameras by using the rotation part according to the determined direction.

10. A method for preventing image distortion of an object contained in an omnidirectional image, the method comprising:

acquiring at least one image data from a plurality of cameras;

determining, from the image data, whether an object is located at least in part in a superposition area;

changing a capture view of the cameras when the object is located at least in part in the superposition area, so that the object is located outside the superposition area;

tracking a movement direction of the object from the image data;

determining a rotation direction of the cameras, based on the movement direction of the object, when the object is located at least in part in the superposition area;

changing the capture view of the cameras by using a rotation part in accordance with the determined rotation direction; and

determining the rotation direction of the cameras in a direction opposite to the movement direction of the object when the object is located at least in part in the superposition area.

11. The method of claim 10 , further comprising:

calculating a distance between the plurality of cameras and the object, based on the image data; and

changing the capture view of the cameras when the object is located at least in part in the superposition area and when the calculated distance is within a predetermined threshold.

12. The method of claim 10 , further comprising:

receiving an input for a main object designation; and

designating a main object based on the received input for the main object designation,

wherein the changing the capture view of the cameras is performed when the main object is located at least in part in the superposition area.

13. An electronic device capable of outputting an omnidirectional image, the electronic device comprising:

a display;

an input device;

a communication module configured to communicate with a plurality of cameras;

a memory; and

a processor electrically connected to the display, the input device, the communication module, and the memory,

wherein the memory stores instructions causing, upon execution, the processor to:

receive image data from the plurality of cameras through the communication module,

generate the omnidirectional image from the image data,

display the omnidirectional image through the display,

receive, through the input device, an input of selecting a main object from among objects contained in the omnidirectional image,

designate the main object, based on the received input of selecting the main object,

determine whether the main object is located in a superposition area,

transmit a control command for changing a capture view of the plurality of cameras to the plurality of cameras through the communication module when the main object is located at least in part in the superposition area, so that the object is located outside the superposition area,

track a movement direction of the object from the image data,

determine a rotation direction of the cameras, based on the movement direction of the object, when the object is located at least in part in the superposition area,

change the capture view of the cameras by using a rotation part in accordance with the determined rotation direction, and

determine the rotation direction of the cameras in a direction opposite to the movement direction of the object when the object is located at least in part in the superposition area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: YUN, YONGSANG; SON, DONGIL; CHOI, JONGCHUL; KIM, SEUNGNYUN; HEO, CHANGRYONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 049011/0801 →
Priority Claims (1)
KR 10-2016-0141788 · Oct 28, 2016 · national
Continuity (1)
Related Publication 20190342501A1 · Nov 7, 2019
Cited By (1)
US 12,470,680