IP Library Granted Patent US 11,651,471
Granted Patent B2
US 11,651,471 · App. 16/750,697 · Granted May 16, 2023

Display device, computer program, and computer-implemented method

Inventors: Akihiro Suzuki (Kanagawa, JP); Ryoji Ogino (Fukuoka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
G06T3/0018G06F3/041G09G5/37H04N5/23238H04N5/232945H04N5/2628G06T2207/20021G06T2207/20112H04N5/23235
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,471
App. No.
16/750,697
Granted
May 16, 2023
Kind
B2
Abstract

A method for processing an image is provided in which an omnidirectional image is received. The omnidirectional image is displayed on a display. Two panoramic images are generated based on the omnidirectional image by correcting distortion of the omnidirectional image. The two panoramic images are displayed on the display in response to a user input. Both of the two panoramic images are scrolled in response to a user input conducted on one of the two panoramic images displayed on the display.

Claims (68)

1. A method for processing an image, the method comprising:

receiving an omnidirectional image;

displaying the omnidirectional image on a display;

generating two panoramic images from the omnidirectional image by correcting distortion of the omnidirectional image;

displaying the two panoramic images on the display in response to a first user input, a first panoramic image of the two panoramic images representing a first portion of the omnidirectional image, a second panoramic image of the two panoramic images representing a second portion of the omnidirectional image, the first panoramic image of the two panoramic images being adjacent the second panoramic image of the two panoramic images on the display with a boundary line being between the first panoramic image and the second panoramic image, the first panoramic image not being continuous with the second panoramic image across the boundary line for displaying the first portion of the omnidirectional image and the second portion of the omnidirectional image on the display at a same time; and

scrolling both of the two panoramic images in response to a second user input conducted on one of the two panoramic images displayed on the display,

wherein a field of view of each of the two panoramic images extends in a first direction, and

in response to the first user input, the two panoramic images are aligned across the boundary line on the display in a second direction, the second direction being perpendicular to the first direction.

2. The method for processing an image according to claim 1 , wherein

the first panoramic image of the two panoramic images represents a first half of the omnidirectional image and the second panoramic image of the two panoramic images represents a second half of the omnidirectional image.

3. The method for processing an image according to claim 2 , wherein

the first panoramic image is scrolled in a direction designated by the second user input conducted on the first panoramic image, and the second panoramic image is scrolled in a same direction as the first panoramic image.

4. The method for processing an image according to claim 2 , wherein

the first panoramic image is scrolled at a speed in response to the second user input conducted on the first panoramic image, and the second panoramic image is scrolled at a same speed as the first panoramic image.

5. The method for processing an image according to claim 4 , wherein

the speed at which the first panoramic image and the second panoramic image are scrolled is changed according to the second user input.

6. The method for processing an image according to claim 4 , wherein

the speed at which the first panoramic image and the second panoramic image are scrolled is not changed according to the second user input.

7. The method for processing an image according to claim 1 , further comprising:

in response to a third user input when displaying the two panoramic images on the display, displaying the first panoramic image of the two panoramic images and non-displaying the second panoramic image of the two panoramic images.

8. The method for processing an image according to claim 7 , further comprising:

moving the first panoramic image to a center of the display when non-displaying the second panoramic image of the two panoramic images displayed on the display.

9. The method for processing an image according to claim 7 , wherein

redisplaying, on the display, both of the two panoramic images in response to a fourth user input when displaying only the first panoramic image.

10. The method for processing an image according to claim 9 , further comprising:

moving the first panoramic image upward when redisplaying both of the two panoramic images.

11. The method for processing an image according to claim 1 , further comprising:

generating a single panoramic image based on the omnidirectional image by correcting distortion of the omnidirectional image; and

displaying the single panoramic image in response to receiving a pinch-in operation conducted on the two panoramic images displayed on the display.

12. The method for processing an image according to claim 1 , further comprising:

generating a single panoramic image based on the omnidirectional image by correcting distortion of the omnidirectional image;

displaying the single panoramic image on the display; and

displaying the two panoramic images in response to receiving a pinch-out operation conducted on the single panoramic image displayed on the display.

13. The method for processing an image according to claim 1 , further comprising:

generating a single panoramic image based on the omnidirectional image by correcting distortion of the omnidirectional image;

displaying the single panoramic image on the display;

receiving a pinch-out operation conducted on the single panoramic image displayed on the display; and

splitting the single panoramic image into the two panoramic images based on a place where the pinch-out operation is conducted on the single panoramic image.

14. The method for processing an image according to claim 13 , further comprising:

displaying the first panoramic image of the two panoramic images split from the single panoramic image at an upper area of the display; and

displaying the second panoramic image of the two panoramic images split from the single panoramic image at a lower area of the display.

15. The method for processing an image according to claim 13 , further comprising:

moving upward one of the two panoramic images split from the single panoramic image and

moving downward an other of two panoramic images split from the single panoramic image.

16. An apparatus for processing an image, the apparatus comprising:

a processor that performs operations including:

receiving an omnidirectional image;

displaying the omnidirectional image on a display;

generating two panoramic images from the omnidirectional image by correcting distortion of the omnidirectional image;

displaying the two panoramic images on the display in response to a first user input, a first panoramic image of the two panoramic images representing a first portion of the omnidirectional image, a second panoramic image of the two panoramic images representing a second portion of the omnidirectional image, the first panoramic image of the two panoramic images being adjacent the second panoramic image of the two panoramic images on the display with a boundary line being between the first panoramic image and the second panoramic image, the first panoramic image not being continuous with the second panoramic image across the boundary line for displaying the first portion of the omnidirectional image and the second portion of the omnidirectional image on the display at a same time; and

scrolling both of the two panoramic images in response to a second user input conducted on one of the two panoramic images displayed on the display,

wherein a field of view of each of the two panoramic images extends in a first direction, and

in response to the first user input, the two panoramic images are aligned across the boundary line on the display in a second direction, the second direction being perpendicular to the first direction.

17. A method for processing an image, the method comprising:

receiving an omnidirectional image;

generating, with a processor, a first instruction to generate two panoramic images from the omnidirectional image by correcting distortion of the omnidirectional image, the first instruction instructing a first panoramic image of the two panoramic images to represent a first portion of the omnidirectional image and a second panoramic image of the two panoramic images to represent a second portion of the omnidirectional image;

generating, with the processor, a second instruction to display the two panoramic images on a display in response to a first user input, the second instruction instructing the first panoramic image of the two panoramic images to be adjacent the second panoramic image of the two panoramic images on the display with a boundary line being between the first panoramic image and the second panoramic image, the second instruction further instructing the first panoramic image to not be continuous with the second panoramic image across the boundary line for displaying the first portion of the omnidirectional image and the second portion of the omnidirectional image on the display at a same time; and

generating, with the processor, a third instruction to scroll both of the two panoramic images in response to a second user input conducted on one of the two panoramic images displayed on the display,

wherein a field of view of each of the two panoramic images extends in a first direction, and

the second instruction instructs the display to align the two panoramic images across the boundary line on the display in a second direction, the second direction being perpendicular to the first direction.

18. The method for processing an image according to claim 17 , wherein

the first panoramic image of the two panoramic images is scrolled in a direction designated by the second user input conducted on the first panoramic image, and the second panoramic image of the two panoramic images is scrolled in a same direction as the first panoramic image.

19. The method for processing an image according to claim 17 , wherein

the first panoramic image of the two panoramic images is scrolled at a speed in response to the second user input conducted on the first panoramic image, and the second panoramic image of the two panoramic images is scrolled at a same speed as the first panoramic image.

20. The method for processing an image according to claim 1 , wherein

a combined width of the two panoramic images in the first direction is greater than a width of the display in the first direction, the first direction being parallel to the boundary line,

a combined height of the two panoramic images in the second direction across the boundary line, along which the first panoramic image is not continuous with the second panoramic, is less than a height of the display in the second direction, and

in response to the first user input, the two panoramic images are scrolled at a same speed in the first direction parallel to the boundary line.

Cited By (1)
US 12,501,114