IP Library Granted Patent US 8,970,490
Granted Patent B2
US 8,970,490 · App. 11/658,047 · Granted Mar 3, 2015

Electronic device and a method for controlling the functions of the electronic device as well as program product for implementing the method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,970,490
App. No.
11/658,047
Granted
Mar 3, 2015
Kind
B2
Abstract

The invention relates to an electronic device, which includes a display component, in which at least one controllable element is arranged to be visualized in its entirety, the control of which element is arranged to be based on determining a change (M) relating to the attitude or position of the device and camera means arranged to form image frames (IMAGE 1 , IMAGE 2 ), and in which, in order to control the functions of the device, such as, for example, to control the element, the change is arranged to be determined, using optical data-flow algorithms, from the image frames formed by the camera means, which image frames are arranged to be compared to each other in a set manner, and on the basis of which comparison the said change is arranged to be determined. The image frames are arranged to be segmented in a selected manner, from which at least one movement vector (S R , S L , S Up , S Down ) determining the said change is arranged to be determined from at least some of the segments (SEGMENT 1 , SEGMENT 2 ).

Claims (51)

1. A portable apparatus comprising: a display configured to show a visual controllable element;

a camera unit configured to capture a plurality of consecutive images;

memory including program code; a processor; and

the memory and the program code being configured with the processor to cause the portable apparatus, in one of a plurality of operating situations, wherein one of the plurality of operating situation is defined based on a movement speed of the portable apparatus, to perform:

dividing a first image of the plurality of consecutive images into a plurality of segments;

selecting a fixed point from the first image;

determining a location coordinate of the selected fixed point;

dividing a second image of the plurality of consecutive images into a plurality of segments, the second image being the next image following the first image of the plurality of consecutive images;

determining a location coordinate of the selected fixed point from the second image;

calculating a movement vector of the selected fixed point between the determined location coordinate of the first image and the determined location coordinate of the second image;

determining a three-dimensional change relative to at least the movement vector; and

controlling the visual controllable element on the display based on the three-dimensional change; and

adjusting an image frequency of the camera unit to at least the portable apparatus movement speed.

2. The portable apparatus of claim 1 , wherein the camera unit includes at least two cameras on opposite sides of the portable apparatus.

3. The portable apparatus of claim 1 , wherein the memory and the program code being further configured with the processor to cause the portable apparatus to perform:

defining a mean value for at least the movement vector.

4. The portable apparatus of claim 1 , wherein the memory and the program code being configured with the processor to cause the portable apparatus to perform:

adjusting a determination frequency of the three-dimensional change according to at least the portable apparatus movement speed.

5. A method comprising: controlling of a visual controllable element in a portable apparatus comprising a camera unit and a display,

the portable apparatus being operable in a plurality of operating situations, wherein one of the plurality of operating situation is defined based on a movement speed of the portable apparatus;

capturing, via the camera unit, a plurality of consecutive images;

dividing a first image of the plurality of consecutive images into a plurality of segments;

selecting a fixed point from the first image;

determining a location coordinate of the selected fixed point;

dividing a second image of the plurality of consecutive images into a plurality of segments, the second image being the next image following the first image of the plurality of consecutive images;

determining a location coordinate of the selected fixed point from the second image;

calculating a movement vector of the selected fixed point between the determined location coordinate of the first image and the determined location coordinate of the second image;

determining a three-dimensional change relative to at least the movement vector; and

controlling the visual controllable element on the display based on the three-dimensional change; and

adjusting an image frequency of the camera unit to at least the portable apparatus movement speed.

6. The method of claim 5 , wherein the camera unit includes at least two cameras on opposite sides of the portable apparatus.

7. The method of claim 5 , comprising defining a mean value for at least the movement vector.

8. The method of claim 5 , comprising adjusting a determination frequency of the three-dimensional change according to an operating situation of the portable apparatus.

9. A non-transitory computer readable medium embodying a computer program comprising computer executable program code which, when executed by a processor of a portable apparatus comprising a camera unit and a display, the portable apparatus being operable in a plurality of operating situations, wherein one of the plurality of operating situation is defined based on a movement speed of the portable apparatus and causes the portable apparatus to perform:

capturing, via the camera unit, a plurality of consecutive images;

dividing a first image of the plurality of consecutive images into a plurality of segments;

selecting a fixed point from the first image;

determining a location coordinate of the selected fixed point;

dividing a second image of the plurality of consecutive images into a plurality of segments, the second image being the next image following the first image of the plurality of consecutive images;

determining a location coordinate of the selected fixed point from the second image;

calculating a movement vector of the selected fixed point between the determined location coordinate of the first image and the determined location coordinate of the second image;

determining a three-dimensional change relative to at least the movement vector; and

controlling a visual controllable element on the display based on the three-dimensional change; and

adjusting an image frequency of the camera unit to at least the portable apparatus movement speed.

10. The non-transitory computer readable medium of claim 9 , wherein the computer executable program code causes the portable apparatus to perform defining a mean value for at least the movement vector.

11. The non-transitory computer readable medium of claim 9 , wherein the computer executable program code causes the portable apparatus to perform:

adjusting a determination frequency of the three-dimensional change according to at least the portable apparatus movement speed.

12. The portable apparatus of claim 1 , wherein the memory and the program code are further configured to, with the processor, cause the apparatus to further perform:

determining an additional fixed point;

defining an additional movement vector for the determined additional fixed point; and

wherein the determining of the three-dimensional change is further relative to the additional fixed point based on the additional movement vector.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Mar 30, 2021
From: CPPIB CREDIT INVESTMENTS INC.
To: CONVERSANT WIRELESS LICENSING S.A R.L.
Reel/Frame 057204/0857 →
AMENDED AND RESTATED U.S. PATENT SECURITY AGREEMENT (FOR NON-U.S. GRANTORS) Recorded Aug 22, 2018
From: CONVERSANT WIRELESS LICENSING S.A R.L.
To: CPPIB CREDIT INVESTMENTS, INC.
Reel/Frame 046897/0001 →
CHANGE OF NAME Recorded Oct 20, 2017
From: CORE WIRELESS LICENSING S.A.R.L.
To: CONVERSANT WIRELESS LICENSING S.A R.L.
Reel/Frame 044516/0772 →
UCC FINANCING STATEMENT AMENDMENT - DELETION OF SECURED PARTY Recorded Aug 30, 2016
From: NOKIA CORPORATION
To: MICROSOFT CORPORATION
Reel/Frame 039872/0112 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2011
From: 2011 INTELLECTUAL PROPERTY ASSET TRUST
To: CORE WIRELESS LICENSING S.A.R.L
Reel/Frame 027442/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2011
From: NOKIA CORPORATION
To: NOKIA 2011 PATENT TRUST
Reel/Frame 027120/0608 →
CHANGE OF NAME Recorded Oct 26, 2011
From: NOKIA 2011 PATENT TRUST
To: 2011 INTELLECTUAL PROPERTY ASSET TRUST
Reel/Frame 027121/0353 →
SHORT FORM PATENT SECURITY AGREEMENT Recorded Sep 13, 2011
From: CORE WIRELESS LICENSING S.A.R.L.
To: NOKIA CORPORATION; MICROSOFT CORPORATION
Reel/Frame 026894/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2007
From: ONKALO, MIIA
To: NOKIA CORPORATION
Reel/Frame 018828/0528 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2007
From: BLOMQVIST, MIKKO; LAINE, TOMMI
To: NOKIA CORPORATION
Reel/Frame 018828/0555 →