IP Library Granted Patent US 12663951
Granted Patent B2
US 12663951 · App. 17/904,428 · Granted Jun 23, 2026

Image processing apparatus, display system and image processing method

Inventors: Maho Hayashi (Tokyo, JP); Sachiko Nishide (Tokyo, JP); Miyuki Shirakawa (Tokyo, JP); Tomonari Murakami (Tokyo, JP); Akio Suzuki (Tokyo, JP); Asami Yamagishi (Tokyo, JP); Koji Nagata (Tokyo, JP); Seishi Tomonaga (Tokyo, JP); Tetsuo Ikeda (Tokyo, JP); Toru Nagara (Tokyo, JP); Hiroshi Takeuchi (Tokyo, JP); Takashi Takamatsu (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06F3/1423B60R1/22B60W50/14G09G3/001H04N7/181H04N23/90B60W2050/146G09G2354/00G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12663951
App. No.
17/904,428
Granted
Jun 23, 2026
Kind
B2
Abstract

Provided is an image processing apparatus to optimize a mode of a screen for watching content. The image processing apparatus includes a shape determination unit that determines a screen shape suitable for displaying content on the basis of an automated driving state of a vehicle and information regarding the content to be displayed on a screen provided in the vehicle, and an image creation unit that creates an image of the content to be displayed on the screen according to the shape determined to be suitable for displaying the content by the shape determination unit.

Claims (48)

1 . An image processing apparatus, comprising:

a determination unit configured to:

calculate a degree of inclination of a backrest of a seat in a vehicle;

determine, based on the calculated degree of inclination that is equal to or more than a specific degree of inclination, the calculated degree of inclination is unsuitable for a manual driving operation of the vehicle; and

determine a screen shape of a first screen of a plurality of screens of the vehicle to display content in which the first screen and the displayed content overlap with a windshield of the vehicle, wherein the determination of the screen shape is based on an automated driving state of the vehicle, information regarding the content, and the determination that the calculated degree of inclination is unsuitable for the manual driving operation of the vehicle; and

a creation unit configured to:

create, based on the determined screen shape, a first image of the content to be displayed on the first screen, wherein the first image of the content includes an application launcher to be displayed on the first screen on the windshield of the vehicle; and

create a second image to be displayed on a second screen of the plurality of screens on a ceiling of the vehicle, wherein the second image includes an image of an active application.

2 . The image processing apparatus according to claim 1 , wherein the determination unit is further configured to determine the screen shape, based on whether the vehicle is driven in an automated manner and an automated driving level.

3 . The image processing apparatus according to claim 1 , wherein the determination unit is further configured to determine, based on the automated driving state in which the vehicle is driven in an automated manner, that the screen shape in which the first screen is on the windshield of the vehicle is suitable to display the content.

4 . The image processing apparatus according to claim 3 , further comprising a shape output unit configured to:

control movement of the first screen of the plurality of screens between a housed state and a taken-out state to change an arrangement of the plurality of screens; and

change the screen shape based on the change of the arrangement of the plurality of screens.

5 . The image processing apparatus according to claim 1 , wherein

the determination unit is further configured to determine, based on the calculated degree of inclination of the backrest that is unsuitable for the manual driving operation of the vehicle, a specific shape as the screen shape suitable to display the content, and

in the specific shape, the first screen partially overlaps the windshield of the vehicle.

6 . The image processing apparatus according to claim 1 , further comprising a seat setting unit configured to set the degree of inclination of the backrest of the seat.

7 . The image processing apparatus according to claim 1 , wherein the first image further includes information for driving assistance.

8 . The image processing apparatus according to claim 1 , wherein the creation unit is further configured to:

create an image of an upward side of the vehicle as the second image to be displayed on the second screen; and

create an image of a rearward side of the vehicle as the first image to be displayed on the first screen.

9 . The image processing apparatus according to claim 1 , wherein the creation unit is further configured to create an image of a back seat as an image to be displayed on a specific screen of the plurality of screens on the windshield of the vehicle.

10 . The image processing apparatus according to claim 1 , wherein the

first image further includes text that explains the first image.

11 . A display system, comprising:

a first screen and a second screen in a vehicle;

a projector; and

an image processing apparatus that includes:

a determination unit configured to:

calculate a degree of inclination of a backrest of a seat in the vehicle;

determine, based on the calculated degree of inclination that is equal to or more than a specific degree of inclination, the calculated degree of inclination is unsuitable for a manual driving operation of the vehicle; and

determine a screen shape of the first screen to display content in which the first screen and the displayed content overlap with a windshield of the vehicle, wherein the determination of the screen shape is based on an automated driving state of the vehicle, information regarding the content, and the determination that the calculated degree of inclination is unsuitable for the manual driving operation of the vehicle; and

a creation unit configured to:

create, based on the determined screen shape, a first image of the content to be displayed on the first screen, wherein the first image of the content includes an application launcher to be displayed on the first screen on the windshield of the vehicle; and

create a second image to be displayed on the second screen of the plurality of screens on a ceiling of the vehicle, wherein the second image includes an image of an active application.

12 . The display system according to claim 11 , further comprising a seat setting apparatus configured to set the degree of inclination of the backrest of the seat.

13 . An image processing method, comprising:

calculating a degree of inclination of a backrest of a seat in a vehicle;

determining, based on the calculated degree of inclination is equal to or more than a specific degree of inclination, the calculated degree of inclination is unsuitable for manually driving the vehicle;

determining a screen shape of a first screen of the vehicle to display content in which the first screen and the displayed content overlap with a windshield of the vehicle, wherein the determination of the screen shape is based on an automated driving state of the vehicle, information regarding the content, and the determination that the calculated degree of inclination is unsuitable for manually driving the vehicle;

creating, based on the determined screen shape, a first image of the content to be displayed on the first screen, wherein the first image of the content includes an application launcher to be displayed on the first screen on the windshield of the vehicle; and

creating a second image to be displayed on a second screen of the plurality of screens on a ceiling of the vehicle, wherein the second image includes an image of an active application.

14 . A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

calculating a degree of inclination of a backrest of a seat in a vehicle;

determining, based on the calculated degree of inclination is equal to or more than a specific degree of inclination, the calculated degree of inclination is unsuitable for manually driving the vehicle;

determining a screen shape of a first screen of the vehicle to display content in which the first screen and the displayed content overlap with a windshield of the vehicle, wherein the determination of the screen shape is based on an automated driving state of the vehicle, information regarding the content, and the determination that the calculated degree of inclination is unsuitable for manually driving the vehicle;

creating, based on the determined screen shape, a first image of the content to be displayed on the first screen, wherein the first image of the content includes an application launcher to be displayed on the first screen on the windshield of the vehicle; and

creating a second image to be displayed on a second screen of the plurality of screens on a ceiling of the vehicle, wherein the second image includes an image of an active application.