IP Library Granted Patent US 11,556,211
Granted Patent B2
US 11,556,211 · App. 16/598,156 · Granted Jan 17, 2023

Displays and information input devices

Inventors: Sarah Michelle Lipman (Santa Monica, CA); Eran Kali (Jerusalem, IL); Boris Gutin (Jerusalem, IL); Moti Margalit (Zichron Yaaqov, IL); Robert Michael Lipman (Santa Monica, CA); Ken Zwiebel (Mazkeret Batya, IL)
Assignee: Power2b, Inc.
G06F3/0428G06F1/169G06F1/1626G06F1/1637G06F3/0386G06F3/03542G06F3/03545G06F3/042G06F3/0412G06F3/0488G06F2203/04104G06F2203/04108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,556,211
App. No.
16/598,156
Granted
Jan 17, 2023
Kind
B2
Abstract

An integrated display and input device including a pixel array operative to provide a visually sensible output, at least one sensor operative to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array and circuitry receiving an output from the at least one sensor and providing a non-imagewise input representing the position of the at least one object relative to the pixel array to utilization circuitry.

Claims (70)

1. A device, comprising:

a housing;

a plurality of sensors disposed in the housing, the plurality of sensors configured to detect, within respective fields of view, electromagnetic radiation corresponding to an object in proximity to the device and provide an output signal;

a cover layer disposed in the housing proximate to the plurality of sensors, the cover layer including one or more lenses that define the respective fields of view based on at least an arrangement of the one or more lenses relative to plurality of sensors; and

processing circuitry disposed in the housing, the processing circuitry configured to:

communicate with a display that visually presents digital content;

determine a trajectory of the object in three-dimensional (3D) space based on the output signal over time;

determine the trajectory of the object corresponds to an interaction with at least a portion of the digital content presented by the display;

execute a function corresponding to the interaction with the at least said portion of the digital content;

determine over time the trajectory of the object corresponds to a quality of the interaction; and

cause execution of the function dynamically as it corresponds dynamically to the quality.

2. The device of claim 1 , wherein the plurality of sensors from a linear array of sensors mounted to the support base.

3. The device of claim 2 , wherein the plurality of sensors form a linear array of sensors mounted to the support substrate.

4. The device of claim 1 ,

wherein the display defines a viewing plane,

wherein the plurality of sensors define a sensor plane, and

wherein the sensor plane is positioned parallel to the viewing plane.

5. The device of claim 1 , wherein the display is disposed in the housing.

6. The device of claim 1 , wherein the display includes at least one of a mobile phone or a television.

7. The device of claim 1 ,

wherein the processing circuitry is further configured to determine a baseline level of electromagnetic radiation based on the output signal, and

wherein, when the processing circuitry determines the trajectory of the object, the processing circuitry further determines the trajectory of the object based on changes in the electromagnetic radiation relative to the baseline level of electromagnetic radiation.

8. The device of claim 1 ,

wherein the object includes a hand, and

wherein, when the processing circuitry determines the trajectory of the object, the processing circuitry further determines a trajectory of at least one finger of the hand.

9. The device of claim 1 , wherein the electromagnetic radiation corresponding to the object in proximity to the device includes at least one of reflected electromagnetic radiation or emitted electromagnetic radiation.

10. The device of claim 1 ,

wherein the digital content includes one or more icons that represent one or more applications,

wherein the trajectory of the object corresponds to one application of the one or more applications, and

wherein the function corresponds to an application function.

11. The device of claim 1 , wherein the function includes at least one of a selection function, a zoom function, an application launch function, a keyboard input function, a web-browsing function, a content-browsing function, a scroll function, a bookmark function, a sub-menu function, a call contact function, a page turning function, or an email function.

12. The device of claim 1 , wherein the processing circuitry is further configured to:

receive a word entry as a first input;

present, at the display, a plurality of identifiers associated with the first input including a street identifier and a business identifier;

receive a selection of the street identifier as a second input; and

present, at the display and in response to the second input, a map of a region associated with the street identifier.

13. The device of claim 1 , wherein the function includes at least one of a scroll function and a page turning function.

14. The device of claim 13 , wherein the quality is speed.

15. An interactive system comprising:

a housing;

a substrate disposed in the housing;

a controller configured to emit or reflect electromagnetic radiation;

a plurality of sensors mounted to the substrate to form a linear array of sensors, the linear array of sensors configured to detect, within respective fields of view, the electromagnetic radiation emitted or reflected from the controller and provide an output signal;

a cover layer disposed in the housing proximate to the plurality of sensors, the cover layer including one or more lenses that define the respective fields of view based on at least an arrangement of the one or more lenses relative to plurality of sensors; and

processing circuitry disposed in the housing, the processing circuitry configured to:

communicate with a display that visually presents digital content;

determine a trajectory of the controller in three-dimensional (3D) space based on the output signal over time;

determine the trajectory of the controller corresponds to an interaction with at least a portion of the digital content presented by the display;

execute a function corresponding to the interaction with the at least said portion of the digital content;

determine over time the trajectory of the object corresponds to a quality of the interaction; and

cause execution the function dynamically as it corresponds dynamically to the quality.

16. The interactive system of claim 15 ,

wherein the display defines a viewing plane,

wherein the plurality of sensors define a sensor plane, and wherein sensor plane is positioned parallel to the viewing plane.

17. The interactive system of claim 15 , wherein the display includes at least one of a mobile phone or a television.

18. The interactive system of claim 15 ,

wherein the processing circuitry is further configured to determine a baseline level of electromagnetic radiation based on the output signal, and

wherein, when the processing circuitry determines the trajectory of the controller, the processing circuitry further determines the trajectory of the controller based on changes in the electromagnetic radiation relative to the baseline level of electromagnetic radiation.

19. The interactive system of claim 15 ,

wherein the digital content includes one or more icons that represent one or more applications,

wherein the trajectory of the controller corresponds to one application of the one or more applications, and

wherein the function corresponds to an application function.

20. The interactive system of claim 15 , wherein the function includes at least one of a selection function, a zoom function, an application launch function, a keyboard input function, a web-browsing function, a content-browsing function, a scroll function, a bookmark function, a sub-menu function, a call contact function, a page turning function, or an email function.

21. The interactive system of claim 15 , wherein the processing circuitry is further configured to:

receive a word entry as a first input;

present, at the display, a plurality of identifiers associated with the first input including a street identifier and a business identifier;

receive a selection of the street identifier as a second input; and

present, at the display and in response to the second input, a map of a region associated with the street identifier.

22. The device of claim 15 , wherein the function includes at least one of a scroll function and a page turning function.

23. The device of claim 22 , wherein the quality is speed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2021
From: LIPMAN, SARAH MICHELLE; KALI, ERAN; GUTIN, BORIS; MARGALIT, MOTI; LIPMAN, ROBERT MICHAEL; ZWIEBEL, KEN
To: POWER2B, INC.
Reel/Frame 057328/0894 →
Continuity (5)
Continuation 15391553 · Dec 27, 2016
Continuation 14148309 · Jan 6, 2014
Continuation 12531031
Provisional Application 60789188 · Apr 3, 2006
Related Publication 20200150825A1 · May 14, 2020