IP Library › Granted Patent US 12,552,317
Granted Patent B2
US 12,552,317 · App. 17/439,248 · Granted Feb 17, 2026

Information processing device and information processing method

Inventors: Yohei Fukuma (Tokyo, JP); Ken Otsuka (Tokyo, JP); Naomasa Takahashi (Tokyo, JP); Toru Nagara (Tokyo, JP); Hiroshi Takeuchi (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
B60R1/20B60K35/10B60K35/23B60K35/28B60K35/53B60K35/81G06F3/013B60K2360/149B60K2360/27B60K2360/334
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,552,317
App. No.
17/439,248
Granted
Feb 17, 2026
Kind
B2
Abstract

An information processing device includes an acquisition unit that acquires a detection result on light outside a mobile object, an analyzer that determines a position of projection of content in the mobile object based on the detection result on the light outside the mobile object, and a display controller that performs control on projection of the content onto the determined position of projection.

Claims (99)

1 . An information processing-device system, comprising:

a sensor unit configured to detect a state of a mobile object, wherein

the state of the mobile object corresponds to an environment of the mobile object,

the sensor unit includes an illuminance sensor, and

the illuminance sensor is configured to:

detect light outside the mobile object; and

capture a first image associated with the detected light;

an acquisition unit configured to acquire a first detection result based on the detected light and the captured first image;

an analyzer configured to:

determine a first position of projection of content in the mobile object, based on the first detection result; and

determine a specific position of a screen in the mobile object based on the first position of the projection, wherein

the screen is movable in the mobile object; and

a display controller configured to:

move the screen to the determined specific position;

control the projection of the content onto the determined first position;

control the projection of the content onto the screen in the mobile object; and

change a transmittance of the screen that includes a light control film.

2 . The information processing system according to claim 1 , wherein

the acquisition unit is further configured to acquire a second detection result associated with a person in the mobile object, and

the analyzer is further configured to determine the first position of the projection of the content in the mobile object, based on the first detection result and the second detection result.

3 . The information processing system according to claim 2 , wherein the analyzer is further configured to determine the first position of the projection of the content in the mobile object, based on a direction of incidence of the detected light and a position of the person in the mobile object.

4 . An information processing method, comprising:

detecting a state of a mobile object, wherein the state of the mobile object corresponds to an environment of the mobile object;

detecting light outside the mobile object;

capturing an image associated with the detected light;

acquiring a detection result based on the detected light and the captured image;

determining a position of projection of content in the mobile object, based on the detection result;

determining a specific position of a screen in the mobile object based on the position of the projection, wherein

the screen is movable in the mobile object;

moving the screen to the determined specific position;

controlling the projection of the content onto the determined position;

controlling the projection of the content onto the screen in the mobile object; and

changing a transmittance of the screen that includes a light control film.

5 . The information processing system according to claim 1 , wherein the analyzer is further configured to determine a second position of the projection of the content on the screen based on the first detection result.

6 . The information processing system according to claim 5 , wherein

the screen includes a plurality of sub-screens, and

the analyzer is further configured to determine, as the second position of the projection of the content, a sub-screen of the plurality of sub-screens based on the first detection result.

7 . A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

detecting a state of a mobile object, wherein the state of the mobile object corresponds to an environment of the mobile object;

detecting light outside the mobile object;

capturing an image associated with the detected light;

acquiring a detection result based on the detected light and the captured image;

determining a position of projection of content in the mobile object, based on the detection result;

determining a specific position of a screen in the mobile object based on the position of the projection, wherein

the screen is movable in the mobile object;

moving the screen to the determined specific position;

controlling the projection of the content onto the determined position;

controlling the projection of the content onto the screen in the mobile object; and

changing a transmittance of the screen that includes a light control film.

8 . The information processing system according to claim 1 , wherein

the acquisition unit is further configured to acquire information on the specific position of the screen, and

the analyzer is further configured to shift the first position of the projection, based on a shift in the specific position of the screen.

9 . The information processing system according to claim 1 , wherein

the screen is a transparent screen,

the sensor unit further includes a specific sensor,

the acquisition unit is further configured to acquire a result of detection by the specific sensor in one of the mobile object or on the screen, and

the display controller is further configured to stop the projection of the content onto the transparent screen based on the result of detection by specific sensor.

10 . The information processing system according to claim 9 , wherein

the mobile object is a car,

the screen is between a front seat of the car and a rear seat of the car,

the specific sensor is an impact sensing sensor,

the impact sensing sensor is configured to sense an impact applied to one of the car or the screen, and

the display controller is further configured to stop the projection of the content onto the transparent screen, based on the sensed impact.

11 . The information processing system according to claim 9 , wherein

the mobile object is a car,

the screen is between a front seat of the car and a rear seat of the car,

the specific sensor is a camera,

the camera is configured to:

capture a second image associated with a driver on a driver seat; and

sense a not-gazing state of the driver, and

the display controller is further configured to stop the projection of the content onto the transparent screen, based on the not-gazing state of the driver.

12 . The information processing system according to claim 1 , wherein

the screen is a transparent screen,

the sensor unit further includes a specific sensor,

the acquisition unit is further configured to acquire a result of detection by the specific sensor in one of the mobile object or on the screen, and

the display controller is further configured to change the transmittance of the screen based on the result of detection by the specific sensor.

13 . The information processing system according to claim 12 , wherein

the mobile object is a car,

the screen is set between a front seat of the car and a rear seat of the car,

the specific sensor is an impact sensing sensor,

the impact sensing sensor is configured to sense an impact applied to one of the car or the screen, and

the display controller is further configured to increase the transmittance of the screen, based on the sensed impact.

14 . The information processing system according to claim 12 , wherein

the mobile object is a car,

the screen is between a front seat of the car and a rear seat of the car,

the specific sensor is a camera,

the camera is configured to:

capture an image associated with a driver on a driver seat; and

sense a not-gazing state of the driver, and

the display controller is further configured to increase the transmittance of the screen, based on the not-gazing state of the driver.

15 . The information processing system according to claim 1 , wherein

the mobile object is a car,

the screen is between a front seat of the car and a rear seat of the car,

the sensor unit further includes a specific sensor,

the specific sensor is configured to sense a not-gazing state of a driver,

the acquisition unit is further configured to:

acquire a result of detection by the specific sensor in one of the mobile object or on the screen; and

acquire a video see-through image on a side of the front seat, and

the display controller is further configured to project the video see-through image on an area outside a display area onto which the content is projected on the screen, based on the not-gazing state of the driver during the projection of the content onto the screen.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: FUKUMA, YOHEI; OTSUKA, KEN; TAKAHASHI, NAOMASA; NAGARA, TORU; TAKEUCHI, HIROSHI
To: SONY GROUP CORPORATION
Reel/Frame 057781/0084 →
Priority Claims (1)
JP 2019-057468 · Mar 25, 2019 · national
Continuity (1)
Related Publication 20220144172A1 · May 12, 2022
References Cited (33)
US 9513744B2 · Pryor · 2016 [cited by examiner]
US 10059238B1 · Salter et al. · 2018 [cited by applicant]
US 11731512B2 · Helot · 2023 [cited by examiner]
US 20050046584A1 · Breed · 2005 [cited by examiner]
US 20150281418A1 · Aizawa · 2015 [cited by applicant]
US 20160170487A1 · Saisho · 2016 [cited by examiner]
US 20160193921A1 · Suzuki · 2016 [cited by examiner]
US 20180147985A1 · Brown · 2018 [cited by examiner]
US 20190025580A1 · Nagano et al. · 2019 [cited by applicant]
CN 107848419A · 2018 [cited by applicant]
CN 108473054A · 2018 [cited by applicant]
CN 108473055A · 2018 [cited by applicant]
CN 108803877A · 2018 [cited by examiner]
CN 107107759B · 2019 [cited by examiner]
CN 208896962U · 2019 [cited by applicant]
DE 112014004359T5 · 2016 [cited by examiner]
DE 202018103005U1 · 2018 [cited by applicant]
EP 3031655A1 · 2016 [cited by examiner]
JP 2013067209A · 2013 [cited by examiner]
JP 2015184642A · 2015 [cited by applicant]
JP 2017193190A · 2017 [cited by applicant]
JP 2018526258A · 2018 [cited by applicant]
KR 1020180015669A · 2018 [cited by applicant]
TW 201710113A · 2017 [cited by applicant]
WO 2016196544A1 · 2016 [cited by applicant]
WO 2017134865A1 · 2017 [cited by applicant]
WO WO2019211039A1 · 2019 [cited by examiner]
WO WO2020195625A1 · 2020 [cited by examiner]
Minoru Fukuda et al (an English-translated version of JP2013067209A (Year: 2013 ). [cited by examiner]
He Z, CN-108803877-A (an English-translated version) (Year: 2018). [cited by examiner]
Rao, Qing, et al. “AR-IVI—Implementation of in-vehicle augmented reality.” 2014 IEEE international symposium on mixed and augmented reality (ISMAR). IEEE, (Year: 2014). [cited by examiner]
Omerustaoglu, Furkan, C. Okan Sakar, and Gorkem Kar. “Distracted driver detection by combining in-vehicle and image data using deep learning.” Applied Soft Computing 96: 106657. (Year: 2020). [cited by examiner]
International Search Report and Written Opinion of PCT Application No. PCT/JP2020/009042, issued on Jun. 2, 2020, 09 pages of ISRWO. [cited by applicant]