IP Library Granted Patent US 10,656,705
Granted Patent B2
US 10,656,705 · App. 15/756,248 · Granted May 19, 2020

Assisted item selection for see through glasses

Inventors: Vincent Alleaume (Pace, FR); Pierrick Jouet (Rennes, FR); Philippe Robert (Rennes, FR)
Assignee: InterDigital CE Patent Holdings, SAS
G06F3/013G02B27/017G02B27/0172G02B27/0179G06F1/163G06F3/011G06F3/012G06F3/0482G06F3/0488G06F3/04815G06F3/04817G06F3/04842G06T11/60G02B2027/014G02B2027/0123G02B2027/0138G02B2027/0141G02B2027/0178G02B2027/0181G02B2027/0187G06F3/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,656,705
App. No.
15/756,248
Granted
May 19, 2020
Kind
B2
Abstract

An augmented reality (AR) interactive system and method is provided. In one embodiment the systems comprises a head mounted user interface configured to receive user input, a processor configured to manage data based on user input, a camera and a display. The camera and the display are in processing communication with one another and the head mounted user interface via the processor. The processor is configured to determine a user's field of view and a center of the user's field of view based on output of a sensor and rendering images for output to the display. Each of the images include one or more objects and a plurality of signs each corresponding to a selectable object in the user's field of view. The rendering of images include altering a first display attribute of a given sign of the plurality of displayed signs based on determining that the user's field of view is centered on the given sign. The processor is also configured to select the given sign based on determining that the user's field of view remains centered on the given sign for an amount of time exceeding a threshold.

Claims (29)

1. A head mounted device comprising a display, wherein the device comprises or is configured to be connected to a processor operative to perform:

determining a user's field of view and a center of the user's field of view based on output of a sensor;

rendering images for output to the display, each said image including at least one object, a plurality of signs that are selectable and a non-selectable object, each of said signs corresponding to an object in the user's field of view, the rendering of images including switching positions of the non-selectable object and a given sign and altering a first display attribute of the given sign of the plurality of displayed signs based on determining that the user's field of view is centered on the given sign; and

selecting the given sign based on determining that the user's field of view remains centered on the given sign for an amount of time exceeding a threshold.

2. The device of claim 1 , wherein the rendering includes rendering the image to display objects in the user's field of view simultaneously with the plurality of signs corresponding to the selectable objects.

3. The device of claim 1 , wherein said signs are converging around the central object without overlapping.

4. The device of claim 1 , wherein the rendering of images further comprises, altering a second display attribute of the given sign other than the first display attribute based on the selecting the given sign.

5. The device of claim 1 , wherein said processor is further configured to perform:

deselecting the given sign after selecting the given sign based on determining that a center of the user's field of view has shifted away from the selected given sign.

6. The device of claim 1 , wherein the device includes a microphone and a motion sensor configured to register a user selection through at least one movement, voice or movement and voice.

7. The device of claim 1 , wherein the device includes an interaction area configured to register said user selection through touch.

8. The device of claim 4 , wherein the device further includes a touch interaction area configured to register said user selection through touch.

9. The device of claim 1 , wherein said display is configured to display graphical images on at least one rendering screen in proximity to an eye of the user, said rending screen mechanically coupled to an eyeglass frame wearable by the user.

10. The device of claim 1 , wherein the device has a motion sensor, a microphone and a touch interaction area configured to capture user input through movement, voice or touch, respectively.

11. The device of claim 1 , wherein said signs are thumbnails having at least one object names and images of objects.

12. A head mounted device comprising:

user interface means for receiving user in form a of voice, movement or touch; and

means for displaying images in processing communication with said user interface means, wherein the device comprises or configured to be connected to a processor operative to perform:

determining a user's field of view and a center of the user's field of view based on output of a sensor;

rendering images for output to the means for displaying, each said image including at least one object, a plurality of signs that are selectable and a non-selectable object, each of said signs corresponding to an object in the user's field of view, the rendering of images including switching positions of the non-selectable object and a given sign and altering a first display attribute of the given sign of the plurality of displayed signs based on determining that the user's field of view is centered on the given sign; and

selecting the given sign based on determining that the user's field of view remains centered on the given sign for an amount of time exceeding a threshold.

13. The device of claim 12 , wherein said means for displaying is configured to display graphical images on at least one rendering screen in proximity to an eye of the user, said rending screen mechanically coupled to an eyeglass frame.

14. A method of item selection using a head mounted device, comprising:

determining a user's field of view and a center of the user's field of view;

rendering images for display, each said image including one or more objects, a plurality of signs each corresponding to a selectable object in the user's field of view and a non-selectable object, the rendering of images including switching positions of the non-selectable object and a given sign and altering a first display attribute of the given sign of the plurality of displayed signs based on determining that the user's field of view is centered on the given sign; and

selecting the given sign based on determining that the user's field of view remains centered on the given sign for an amount of time exceeding a threshold.

15. The method of claim 14 , wherein said signs are thumbnails having at least one object names and images of objects.

16. The device of claim 1 , wherein said non-selectable object has a central position in the user's field of view and is following, with a delay, the center of the user's field of view when said user's field of view is moving.

17. The device of claim 1 , wherein said non-selectable object is an empty region or a pointer.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME FROM INTERDIGITAL CE PATENT HOLDINGS TO INTERDIGITAL CE PATENT HOLDINGS, SAS. PREVIOUSLY RECORDED AT REEL: 47332 FRAME: 511. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 28, 2024
From: THOMSON LICENSING
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 066703/0509 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2018
From: THOMSON LICENSING
To: INTERDIGITAL CE PATENT HOLDINGS
Reel/Frame 047332/0511 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2018
From: ALLEAUME, VINCENT; JOUET, PIERRICK; ROBERT, PHILIPPE
To: THOMSON LICENSING
Reel/Frame 046312/0501 →
Priority Claims (1)
EP 15306326 · Aug 28, 2015 · regional
Continuity (1)
Related Publication 20180253144A1 · Sep 6, 2018