IP Library › Granted Patent US 10,308,164
Granted Patent B2
US 10,308,164 · App. 14/023,755 · Granted Jun 4, 2019

Mobile object and storage medium

Inventors: Yoichiro Sako (Tokyo, JP); Hiroshi Okada (Kanagawa, JP); Kazuhiro Watanabe (Tokyo, JP); Kazuyuki Sakoda (Chiba, JP); Hirofumi Yuchi (Kanagawa, JP); Kohei Asada (Kanagawa, JP)
Assignee: SONY CORPORATION
B60Q1/0023B60Q1/0017B60Q1/04B60Q5/008F21S41/645F21S41/675G03B21/006G03B21/2066G08G1/166H04N7/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,308,164
App. No.
14/023,755
Granted
Jun 4, 2019
Kind
B2
Abstract

There is provided a mobile object including an imaging unit configured to capture a perimeter of the mobile object, a speaker configured to be capable of controlling directivity, a determination unit configured to determine whether the mobile object is in a driving mode, and a speaker control unit configured to control the speaker in the driving mode in a manner that predetermined audio is output toward a warning target that is recognized based on a captured image captured by the imaging unit, and to control the speaker in a non-driving mode in a manner that the predetermined audio is output in a non-directional way.

Claims (41)

1. A mobile object, comprising:

an image sensor configured to capture an image of a perimeter of the mobile object;

a speaker;

a headlight configured to project a video; and

a central processing unit (CPU) configured to:

determine the mobile object is in one of a non-driving mode or a driving mode;

control the headlight to project the video based on the determination that the mobile object is in the non-driving mode;

detect a viewer position based on the captured image of the perimeter of the mobile object and the determination that the mobile object is in the non-driving mode;

control, based on the detected viewer position, the headlight to change a direction of the projection of the video;

switch the speaker to an omni-directivity mode from a directivity mode based on the determination that the mobile object is in the non-driving mode;

recognize a warning target based on the captured image and the determination that the mobile object is in the driving mode; and

switch the speaker to the directivity mode from the omni-directivity mode based on the determination that the mobile object is in the driving mode, wherein

in the directivity mode, the speaker is configured to output audio towards the recognized warning target, and

in the omni-directivity mode, the speaker is further configured to omni-directionally output the audio.

2. The mobile object according to claim 1 , wherein the CPU is further configured to:

reproduce input content data; and

control the reproduction of the input content data in the non-driving mode such that the headlight is further configured to project the video and the speaker is further configured to omni-directionally output the audio.

3. The mobile object according to claim 2 , wherein the CPU is further configured to control, in the non-driving mode, a shape of the projected video based on the detected viewer position.

4. The mobile object according to claim 3 , wherein the headlight includes a physical mechanism configured to change the direction of the projection of the video.

5. The mobile object according to claim 2 , wherein the CPU is further configured to control color information of the projected video, based on the captured image.

6. The mobile object according to claim 2 , wherein the headlight is further configured to:

emit light in the driving mode; and

project the video in the non-driving mode.

7. The mobile object according to claim 2 , wherein the headlight is further configured to:

project white light in the driving mode; and

project a content video in the non-driving mode.

8. The mobile object according to claim 1 , wherein the CPU is further configured to recognize, based on a distance between a person detected from the captured image and the mobile object and based on a relative speed of the person with respect to the mobile object, the person as the warning target in the driving mode.

9. The mobile object according to claim 1 , wherein the CPU is further configured to control a position for localization of a sound image of the audio output from the speaker in the non-driving mode, based on the detected viewer position.

10. The mobile object according to claim 1 , wherein the CPU is further configured to determine the mobile object is in one of the driving mode or the non-driving mode, based on at least one of an odometer value, a vibration measurement value, position information, or a driving sound measurement value.

11. The mobile object according to claim 1 , wherein the CPU is further configured to control, in the driving mode, the speaker to output a warning sound toward the recognized warning target.

12. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:

controlling an image sensor of a mobile object for capturing an image of a perimeter of the mobile object;

determining the mobile object is in one of a non-driving mode or a driving mode;

controlling a headlight of the mobile object for projecting a video, based on the determination that the mobile object is in the non-driving mode;

detecting a viewer position based on the captured image of the perimeter of the mobile object and the determination that the mobile object is in the non-driving mode;

controlling, based on the detected viewer position, the headlight to change a direction of the projection of the video;

switching a speaker of the mobile object to an omni-directivity mode from a directivity mode based on the determination that the mobile object is in the non-driving mode;

recognizing a warning target based on the captured image and the determination that the mobile object is in the driving mode; and

switching the speaker to the directivity mode from the omni-directivity mode based on the determination that the mobile object is in the driving mode, wherein

in the directivity mode, the speaker is configured to output audio towards the recognized warning target, and

in the omni-directivity mode, the speaker is further configured to omni-directionally output the audio.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2013
From: SAKO, YOICHIRO
To: SONY CORPORATION
Reel/Frame 031346/0654 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2013
From: OKADA, HIROSHI; WATANABE, KAZUHIRO; SAKODA, KAZUYUKI; YUCHI, HIROFUMI; ASADA, KOHEI
To: SONY CORPORATION
Reel/Frame 031183/0032 →
Priority Claims (1)
JP 2012-208028 · Sep 21, 2012 · national
Continuity (1)
Related Publication 20140085470A1 · Mar 27, 2014