IP Library Granted Patent US 9,319,860
Granted Patent B2
US 9,319,860 · App. 14/278,614 · Granted Apr 19, 2016

Mobile terminal that determine whether the user is walking while watching the mobile terminal

Inventors: Shinichi Tanaka (Kobe, JP); Hironori Ichioka (Kobe, JP)
Assignee: FUJITSU TEN LIMITED
H04W4/22H04W4/027
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,319,860
App. No.
14/278,614
Granted
Apr 19, 2016
Kind
B2
Abstract

A mobile terminal includes a display screen, a first camera that is installed on a side of the mobile terminal having the display screen, a velocity sensor that derives moving velocity of the mobile terminal, and a controller configured to (i) determine a starting state of the display screen, (ii) determine a direction of a face of a user based on a shot image obtained from the first camera, and (iii) determine whether the user is walking while watching the mobile terminal based on the moving velocity, the starting state and the direction of the face of the user.

Claims (51)

1. A mobile terminal comprising:

a display screen;

a first camera that is installed on a side of the mobile terminal having the display screen;

a velocity sensor that derives moving velocity of the mobile terminal; and

a controller configured to

determine a starting state of the display screen,

determine a direction of a face of a user based on a shot image obtained from the first camera, and

determine whether the user is walking while watching the mobile terminal based on the moving velocity, the starting state and the direction of the face of the user.

2. The mobile terminal of claim 1 , wherein

the controller determines a direction of a visual line of the user based on the shot image obtained from the first camera, and

the controller determines whether the user is walking while watching the mobile terminal based on the moving velocity, the starting state, the direction of the face of the user and the direction of the visual line of the user.

3. The mobile terminal of claim 2 , further comprising

a second camera that is installed on an opposite side of the mobile terminal from the side having the display screen, wherein

the controller determines whether the user is walking while watching the mobile terminal based on the moving velocity, the starting state, the direction of the face of the user, the direction of the visual line of the user, and a change in a shot image obtained from the second camera.

4. The mobile terminal of claim 1 , further comprising

a second camera that is installed on an opposite side of the mobile terminal from the side having the display screen, wherein

the controller determines whether the user is walking while watching the mobile terminal based on the moving velocity, the starting state, the direction of the face of the user, and a change in a shot image obtained from the second camera.

5. The mobile terminal of claim 1 , wherein

the controller determines that the user is walking while watching the mobile terminal when the direction of the face of the user is toward the display screen.

6. The mobile terminal of claim 5 , further comprising

a timer that measures a time during which the direction of the face of the user is toward the display screen, wherein

the controller determines that the user is walking while watching the mobile terminal when the time during which the direction of the face of the user is toward the display screen exceeds a prescribed period of time.

7. The mobile terminal of claim 2 , wherein

the controller determines that the user is walking while watching the mobile terminal when the direction of the visual line of the user is toward the display screen.

8. The mobile terminal of claim 7 , further comprising

a timer that measures a time during which the direction of the visual line of the user is toward the display screen, wherein

the controller determines that the user is walking while watching the mobile terminal when the time during which the direction of the visual line of the user is toward the display screen exceeds a prescribed period of time.

9. The mobile terminal of claim 1 , further comprising:

a sound collector that collects external sound, wherein

the controller determines whether the user is in danger based on a frequency or sound volume of the collected external sound when the user is walking while watching the mobile terminal.

10. The mobile terminal of claim 9 , wherein

the collected external sound is sound output by an external vehicle, and the controller determines whether the user is in danger based on a change in the frequency or in the sound volume of the collected external sound.

11. The mobile terminal of claim 10 , wherein

the controller determines that the user is in danger when the frequency of the collected external sound changes toward a high frequency side, or when the sound volume of the collected external sound increases.

12. The mobile terminal of claim 9 , wherein

the controller determines a danger degree in accordance with an external status of the mobile terminal or a use status on the mobile terminal when the user is in danger.

13. The mobile terminal of claim 12 , wherein

the controller determines the danger degree based on relative velocity of the mobile terminal to an external vehicle or a distance from the mobile terminal to the external vehicle.

14. The mobile terminal of claim 12 , wherein

the controller determines the danger degree based on a type of an application that runs on the mobile terminal or based on whether there is sound output from a sound output part that is installed in the mobile terminal.

15. The mobile terminal of claim 9 , further comprising

a notifying part that, when the user is in danger, performs notification of the danger.

16. The mobile terminal of claim 15 , wherein

the notifying part notifies the user that the user is in danger by one or a plurality of: (i) indication of a letter, (ii) indication of a mark, (iii) outputting of sound and (iv) vibration.

17. A danger notifying system that notifies a driver of a vehicle that a user of a mobile terminal is in danger, the system comprising the mobile terminal and the vehicle, wherein

the mobile terminal includes is the mobile terminal of claim 1 :

wherein the controller of the mobile terminal further determines whether the user is in danger when the user is walking while watching the mobile terminal; the mobile terminal further comprising:

a location information receiver that obtains location information of the mobile terminal; and

a transmitter that transmits the location information of the mobile terminal to the vehicle when the user is in danger, and

the vehicle includes:

a display that displays the location information obtained from the mobile terminal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2014
From: TANAKA, SHINICHI; ICHIOKA, HIRONORI
To: FUJITSU TEN LIMITED
Reel/Frame 032904/0020 →
Priority Claims (1)
JP 2013-112651 · May 29, 2013 · national
Continuity (1)
Related Publication 20140357213A1 · Dec 4, 2014