IP Library Granted Patent US 11,627,007
Granted Patent B2
US 11,627,007 · App. 15/734,246 · Granted Apr 11, 2023

Mobile information terminal

Inventors: Hiroshi Shimizu (Kyoto, JP); Hiroaki Ono (Kyoto, JP); Yasunobu Hashimoto (Kyoto, JP); Kazuhiko Yoshizawa (Kyoto, JP); Naohisa Takamizawa (Kyoto, JP); Nobuo Masuoka (Kyoto, JP)
Assignee: MAXELL, LTD.
H04L12/1822G06T3/0018G06T5/006G06T7/70G06T7/73H04N5/23219H04N5/23296H04N5/23299H04N7/141G06T2207/10016G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,007
App. No.
15/734,246
Granted
Apr 11, 2023
Kind
B2
Abstract

When a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of an angle of view AV 1 of the front camera C 1 . In the first state, the mobile information terminal 1 detects a first region including the face of the first user from a wide angle image that is captured by the front camera C 1 , trims a first image corresponding to the first region, creates a transmission image to be transmitted to a terminal of the other side on the basis of the first image, and transmits the transmission image to the terminal of the other side.

Claims (51)

1. A mobile information terminal having a video call function comprising:

a first camera including a wide angle lens at a predetermined position on a front surface having a display screen in an enclosure having a flat plate shape,

when a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of a first angle of view of the first camera, and

in the first state, a first region including the face of the first user is detected from a wide angle image that is captured by the first camera, a first image corresponding to the first region is trimmed, a transmission image to be transmitted to a terminal of the other side that is a mobile information terminal of the second user is created on the basis of the first image, and the transmission image is transmitted to the terminal of the other side,

wherein an image including the face of the first user or an optional image representing the first user is previously registered as a registration image, and

wherein when the transmission of the transmission image is denied, an image as a replacement of the transmission image is created by using the registration.

2. The mobile information terminal according to claim 1 ,

wherein the first angle of view of the first camera has an angular range from a first angle that is equal to or smaller than 30 degrees to a second angle that is equal to or larger than 150 degrees with respect to the first surface, and,

in the first state, a second angle of view including the face of the first user is included within an angular range of the first angle of view from the first angle to 90 degrees.

3. The mobile information terminal according to claim 1 ,

wherein a monitor image having an image content corresponding to the transmission image is created,

the monitor image is displayed in a region inside the display screen, and

it is determined whether the transmission of the transmission image is allowed or not on the basis of confirmation as to the monitor image by the first user and a predetermined operation.

4. The mobile information terminal according to claim 1 ,

wherein, when a state of the enclosure is recognized to be the first state by using sensors including an acceleration sensor and a gyroscope sensor, or when a predetermined operation is received from the first user, a mode is switched from a first mode in a non handsfree state to a second mode in a handsfree state, and the transmission image is created.

5. The mobile information terminal according to claim 1 ,

wherein, in accordance with a position of the first region including the face of the first user inside the wide angle image, a mode is switched from a first mode in a non handsfree state to a second mode in a handsfree state, and the transmission image is created.

6. The mobile information terminal according to claim 1 ,

wherein a second region including certain specific object inside a range around the face of the first user is detected from the wide angle image, a second image corresponding to the second region is trimmed, and the transmission image is created on the basis of the second image.

7. The mobile information terminal according to claim 1 ,

wherein a plurality of faces of a plurality of people are detected as the first user from the wide angle image, and the transmission image including the plurality of faces is created, or the transmission image for each face of the plurality of faces is created.

8. The mobile information terminal according to claim 1 ,

wherein a distortion correcting processing is performed to at least the first image of the wide angle image so that distortion due to the wide angle lens is removed or reduced, and the transmission image is created on the basis of a corrected image.

9. The mobile information terminal according to claim 8 ,

wherein, in the first state, the first region including the face of the first user is detected from the wide angle image, the first image corresponding to the first region is trimmed, and the distortion correcting processing is performed to the first image.

10. The mobile information terminal according to claim 8 ,

wherein, in the first state, the distortion correcting processing is performed to the wide angle image, the first region including the face of the first user is detected from the distortion-corrected image, and the first image corresponding to the first region is trimmed.

11. The mobile information terminal according to claim 8 ,

wherein a trapezoid correcting processing for correcting a trapezoidal image content due to a positional relation in the first state is performed to an image that has been subjected to the distortion correcting processing.

12. A mobile information terminal having a video call function comprising:

a first camera including a wide angle lens at a predetermined position on a front surface having a display screen in an enclosure having a flat plate shape,

when a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of a first angle of view of the first camera, and,

in the first state, a first region including the face of the first user is detected from a wide angle image that is captured by the first camera, a first image corresponding to the first region is trimmed, a transmission image to be transmitted to a terminal of the other side that is a mobile information terminal of the second user is created on the basis of the first image, and the transmission image is transmitted to the terminal of the other side,

wherein an image including the face of the first user or an optional image representing the first user is previously registered as a registration image, and

wherein when the first region including the face of the first user cannot be detected from the wide angle image, an image as a replacement of the transmission image is created by using the registration image.

13. A mobile information terminal having a video call function comprising:

a first camera including a wide angle lens at a predetermined position on a front surface having a display screen in an enclosure having a flat plate shape,

when a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of a first angle of view of the first camera, and

in the first state, a first region including the face of the first user is detected from a wide angle image that is captured by the first camera, a first image corresponding to the first region is trimmed, a transmission image to be transmitted to a terminal of the other side that is a mobile information terminal of the second user is created on the basis of the first image, and the transmission image is transmitted to the terminal of the other side,

wherein an image including the face of the first user is previously registered as a registration image, and

wherein the transmission image is created when the first user is recognized to be a specific person on the basis of comparison between the registration image and an image of the first region detected from the wide angle image, or the transmission image is not created when the first user cannot be recognized to be the specific person.

14. A mobile information terminal having a video call function comprising:

a first camera including a wide angle lens at a predetermined position on a front surface having a display screen in an enclosure having a flat plate shape,

when a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of a first angle of view of the first camera, and

in the first state, a first region including the face of the first user is detected from a wide angle image that is captured by the first camera, a first image corresponding to the first region is trimmed, a transmission image to be transmitted to a terminal of the other side that is a mobile information terminal of the second user is created on the basis of the first image, and the transmission image is transmitted to the terminal of the other side,

wherein, when an image of the other side that the mobile information terminal receives from the terminal of the other side is displayed in a region inside the display screen, the image of the other side is subjected to a reverse trapezoid correcting processing, and then, is displayed.

15. A mobile information terminal having a video call function comprising:

a first camera including a wide angle lens at a predetermined position on a front surface having a display screen in an enclosure having a flat plate shape,

when a first user makes a video call with a second user of the other side by using the video call function, a first state is set as a state in which the enclosure is flatly placed on a first surface of an object, and in which a face of the first user is included within a range of a first angle of view of the first camera, and

in the first state, a first region including the face of the first user is detected from a wide angle image that is captured by the first camera, a first image corresponding to the first region is trimmed, a transmission image to be transmitted to a terminal of the other side that is a mobile information terminal of the second user is created on the basis of the first image, and the transmission image is transmitted to the terminal of the other side,

wherein a positional relation including a direction of the face of the first user with respect to the enclosure and is estimated on the basis of the wide angle image or a sensor, and a direction of voice/sound input to a microphone or a direction of voice/sound output from a speaker is controlled in accordance with the estimated direction.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2021
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 058666/0407 →
MERGER Recorded Nov 29, 2021
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 058255/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2021
From: SHIMIZU, HIROSHI; ONO, HIROAKI; HASHIMOTO, YASUNOBU; YOSHIZAWA, KAZUHIKO; TAKAMIZAWA, NAOHISA; MASUOKA, NOBUO
To: MAXELL, LTD.
Reel/Frame 055617/0603 →
Continuity (1)
Related Publication 20210218589A1 · Jul 15, 2021