IP Library Granted Patent US 9,692,961
Granted Patent B2
US 9,692,961 · App. 14/695,529 · Granted Jun 27, 2017

Electronic device and virtual image rotation method

Inventor: San-Hsin Kuo (New Taipei, TW)
Assignee: FIH (HONG KONG) LIMITED
H04N5/23219H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,692,961
App. No.
14/695,529
Granted
Jun 27, 2017
Kind
B2
Abstract

A virtual image rotation method activates a camera to capture an image on a first side of an electronic device, analyzes the captured image to identify one or more facial images from the captured image, and identifies one of the one or more facial images from the captured image as a primary facial image. The method further calculates a directional value of the primary facial image in the captured image, and rotates a virtual image displayed on a display screen based on a preset rotational value associated with a preset directional value range in which the directional value of the primary facial image falls. A related electronic device and a related non-transitory storage medium are provided.

Claims (75)

1. An electronic device comprising:

a processor;

a camera configured to capture images from a first side of the electronic device;

a display screen configured to display a virtual image; and

a non-transitory computer readable medium;

wherein, the non-transitory computer readable medium stores one or more preset rotational values, with each rotational value associated with a preset directional value range; and

wherein, the non-transitory computer readable medium stores instructions for the processor to:

activate the camera to capture an image on the first side of the electronic device;

analyze the captured image to identify one or more facial images in the captured image;

identify one of the one or more facial images in the captured image as a primary facial image;

calculate a directional value of the primary facial image in the captured image;

establish a virtual coordinate system: where an origin of the virtual coordinate system is a center of a mouth of the primary facial image; an X axis of the virtual coordinate system is parallel with and in a same direction with an X axis of a window coordinate system; and a Y axis of the virtual coordinate system is parallel with and in an opposite direction with a Y axis of the window coordinate system;

map a position between two eyes of the primary facial image into the virtual coordinate system to be a target point;

form a straight line between the target point and the origin and determine an angle between the straight line and the X axis of the virtual coordinate system;

determine the directional value of the primary facial image to be the angle between the straight line and the X axis of the virtual coordinate system; and

rotate the virtual image displayed on the display screen based on the preset rotational value associated with the preset directional value range in which the calculated directional value of the primary facial image falls.

2. The electronic device as described in claim 1 , wherein the non-transitory computer readable medium stores instructions for the processor to employ an open source computer vision to analyze the image to identify the one or more facial images from the captured image.

3. The electronic device as described in claim 1 , wherein the non-transitory computer readable medium stores instructions for the processor to:

identify that the facial image uniquely appearing in the captured image is the primary facial image when the number of the facial images is one; and

identify the facial image which is most similar to face images of a face database of an open source computer vision from all the facial images to be the primary facial image when the number of the facial images is more than one.

4. The electronic device as described in claim 1 , wherein the non-transitory computer readable medium stores instructions for the processor to:

determine which preset directional value range that the calculated directional value of the primary facial image falls into, determine the preset rotational value associated with the determined preset directional value range, and rotate the virtual image displayed on the display screen with the determined rotational value.

5. The electronic device as described in claim 4 , wherein the non-transitory computer readable medium stores instructions for the processor to:

prevent a rotation of the virtual image when the directional value of the primary facial image falls into a preset directional value range [45°, 135°);

rotate the virtual image 90 degrees counterclockwise when the directional value of the primary facial image falls into a preset directional value range [135°, 225°);

rotate the virtual image 180 degrees clockwise when the directional value of the primary facial image falls into a preset directional value range [225°, 315°); and

rotate the virtual image 90 degrees clockwise when the directional value of the primary facial image falls into a preset directional value range [0°, 45°) or a preset directional value range [315°, 360°).

6. A virtual image rotation method comprising:

activating a camera to capture an image on a first side of an electronic device;

analyzing the captured image to identify one or more facial images in the captured image;

identifying one of one or more facial images as a primary facial image;

calculating a directional value of the primary facial image in the captured image;

establishing a virtual coordinate system: where an origin of the virtual coordinate system is a center of a mouth of the primary facial image; an X axis of the virtual coordinate system is parallel with and in a same direction with an X axis of the window coordinate system; and a Y axis of the virtual coordinate system is parallel with and in an opposite direction with a Y axis of the window coordinate system;

mapping a position between two eyes of the primary facial image into the virtual coordinate system to be a target point;

forming a straight line between the target point and the origin and determining an angle between the straight line and the X axis of the virtual coordinate system;

determining the directional value of the primary facial image to be the angle between the straight line and the X axis of the virtual coordinate system; and

rotating a virtual image displayed on a display screen based on a preset rotational value associated with a preset directional value range in which the calculated directional value of the primary facial image falls.

7. The virtual image rotation method as described in claim 6 , wherein the method further comprises:

employing an open source computer vision to analyze the captured image to identify the one or more facial images in the captured image.

8. The virtual image rotation method as described in claim 6 , wherein the method further comprises:

identifying that the facial image uniquely appearing in the captured image is the primary facial image when the number of the facial images is one; and

identifying the facial image which is most similar to face images of a face database of an open source computer vision from all the facial images to be the primary facial image when the number of the facial images is more than one.

9. The virtual image rotation method as described in claim 6 , wherein the method further comprises:

determining which preset directional value range that the directional value of the primary facial image falls into;

determining the rotational value associated with the determined preset directional value range; and

rotating the virtual image displayed on the display screen with the determined rotational value.

10. The virtual image rotation method as described in claim 9 , wherein the method further comprises:

preventing a rotation of the virtual image when the directional value of the primary facial image falls into a preset directional value range [45°, 135°);

rotating the virtual image 90 degrees counterclockwise when the directional value of the primary facial image falls into a preset directional value range [135°, 225°);

rotating the virtual image 180 degrees clockwise when the directional value of the primary facial image falls into a preset directional value range [225°, 315°); and

rotating the virtual image 90 degrees clockwise when the directional value of the primary facial image falls into a preset directional value range [0°, 45°) or a preset directional value range [315°, 360°).

11. A non-transitory storage medium storing a set of instructions, the set of instructions capable of being executed by a processor of an electronic device, causing the electronic device to perform a virtual image rotation method, the method comprising:

activating a camera to capture an image on a first side of an electronic device;

analyzing the captured image to identify one or more facial images in the captured image;

identifying one of one or more facial images as a primary facial image;

calculating a directional value of the primary facial image in the captured image;

establishing a virtual coordinate system: where an origin of the virtual coordinate system is a center of a mouth of the primary facial image; an X axis of the virtual coordinate system is parallel with and in a same direction with an X axis of the window coordinate system; and a Y axis of the virtual coordinate system is parallel with and in an opposite direction with a Y axis of the window coordinate system;

mapping a position between two eyes of the primary facial image into the virtual coordinate system to be a target point;

forming a straight line between the target point and the origin and determining an angle between the straight line and the X axis of the virtual coordinate system;

determining the directional value of the primary facial image to be the angle between the straight line and the X axis of the virtual coordinate system; and

rotating a virtual image displayed on a display screen based on a preset rotational value associated with a preset directional value range in which the calculated directional value of the primary facial image falls.

12. The non-transitory storage medium as described in claim 11 , wherein the method further comprises:

employing an open source computer vision to analyze the captured image to identify the one or more facial images in the captured image.

13. The non-transitory storage medium as described in claim 11 , wherein the method further comprises:

identifying that the facial image uniquely appearing in the captured image is the primary facial image when the number of the facial images is one; and

identifying the facial image which is most similar to face images of a face database of an open source computer vision from all the facial images to be the primary facial image when the number of the facial images is more than one.

14. The non-transitory storage medium as described in claim 11 , wherein the method further comprises:

determining which preset directional value range that the directional value of the primary facial image falls into;

determining the rotational value associated with the determined preset directional value range; and

rotating the virtual image displayed on the display screen with the determined rotational value.

15. The non-transitory storage medium as described in claim 14 , wherein the method further comprises:

preventing a rotation of the virtual image when the directional value of the primary facial image falls into a preset directional value range [45°, 135°);

rotating the virtual image 90 degrees counterclockwise when the directional value of the primary facial image falls into a preset directional value range [135°, 225°);

rotating the virtual image 180 degrees clockwise when the directional value of the primary facial image falls into a preset directional value range [225°, 315°); and

rotating the virtual image 90 degrees clockwise when the directional value of the primary facial image falls into a preset directional value range [0°, 45°) or a preset directional value range [315°, 360°).

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: MOBILE DRIVE TECHNOLOGY CO., LTD.
To: MOBILE DRIVE NETHERLANDS B.V.
Reel/Frame 057391/0564 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: FIH (HONG KONG) LIMITED
To: MOBILE DRIVE TECHNOLOGY CO.,LTD.
Reel/Frame 051442/0362 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2015
From: KUO, SAN-HSIN
To: FIH (HONG KONG) LIMITED
Reel/Frame 035490/0316 →
Priority Claims (1)
TW 103137538 A · Oct 30, 2014 · national
Continuity (1)
Related Publication 20160127639A1 · May 5, 2016