IP Library Granted Patent US 9,268,413
Granted Patent B2
US 9,268,413 · App. 12/168,678 · Granted Feb 23, 2016

Multi-touch touchscreen incorporating pen tracking

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,268,413
App. No.
12/168,678
Granted
Feb 23, 2016
Kind
B2
Abstract

The present invention relates to a multi-touch display system that supports both multi-touch human input as well as input from a digital pen. The display system has a display panel that is configured to allow human touches along a front surface to be detected and tracked. The display panel also includes a location pattern that preferably covers the viewable areas of the display panel. The location pattern is configured to allow any location within the location pattern to be detected by analyzing a portion of the display pattern that is associated with the particular location. The digital pen is used to “write” on the display panel, wherein such a writing function involves detecting the location where writing occurs and controlling display content that is displayed on the display panel to reflect what is being written.

Claims (42)

1. A multi-touch display system comprising:

a display panel comprising a front surface to receive human touches and a location pattern provided in association with the front surface, the location pattern readable by a digital pen from the front surface and providing unique location indicia for the front surface wherein unique locations in the location pattern are identifiable from corresponding portions of the unique location indicia, and wherein a unique identifier of the display panel is encoded in the location pattern;

touch sensing circuitry adapted to detect the human touches on the front surface of the display panel and provide corresponding touch input;

a communication interface adapted to receive pen data bearing on writing information derived in response to the digital pen capturing images of those portions of the unique location indicia where the digital pen is being used to write; and

processing circuitry associated with the touch sensing circuitry and the communication interface and adapted to control display content being displayed on the display panel in response to the touch input and the pen data.

2. The multi-touch display system of claim 1 wherein the location indicia of the location pattern is continuously variable across the entire front surface of the display panel such that the location indicia is unique at any point within the location pattern.

3. The multi-touch display system of claim 1 wherein the location indicia comprises a plurality of dots.

4. The multi-touch display system of claim 1 wherein the location pattern is an Anoto pattern.

5. The multi-touch display system of claim 1 wherein the location indicia at any point within the location pattern correspond to a unique location coordinate for the point in relation to the front surface of the display panel.

6. The multi-touch display system of claim 1 wherein the processing circuitry is adapted to control the display content by including writing substantially directly corresponding to what is being written on the display panel by the digital pen.

7. The multi-touch display system of claim 1 wherein the display panel comprises a rear surface further comprising a projector that is associated with the processing circuitry and configured to project the display content toward the rear surface of the display panel under control of the processing circuitry, the display panel configured to allow the display content being projected toward the rear surface to be viewable on the front surface.

8. The multi-touch display system of claim 1 wherein to detect the human touches on the front surface of the display panel, the touch sensing circuitry is adapted to detect reflected light that is reflected from a rear surface of the display panel in response to the human touches.

9. The multi-touch display system of claim 8 wherein reflected light is infrared light.

10. The multi-touch display system of claim 8 wherein the display panel comprises a waveguide panel and a light source adapted to inject light into the waveguide panel such that a state of total internal reflection is achieved within the waveguide panel when the front surface of the display panel is not being touched by a human and frustrated total internal reflections occur when the front surface of the display panel receives the human touches, certain of the frustrated total internal reflections being reflected light that is detectable by the touch sensing circuitry.

11. The multi-touch display system of claim 10 wherein the waveguide panel comprises a beveled perimeter edge that has a substantially flat edge surface on which the light source is mounted, the light source injecting the light into the waveguide panel through the substantially flat edge surface.

12. The multi-touch display system of claim 11 wherein the light source comprises a plurality of light emitting diodes that are mounted along the substantially flat edge surface of the beveled perimeter edge.

13. The multi-touch display system of claim 1 wherein the communication interface is a wireless communication interface that is adapted to receive the pen data via wireless communications.

14. The multi-touch display system of claim 13 wherein the wireless communication interface is adapted to communicate directly with the digital pen.

15. The multi-touch display system of claim 1 wherein the communication interface is adapted to communicate with a device or system that is capable of communicating with the digital pen.

16. The multi-touch display system of claim 1 wherein the display panel comprises a waveguide panel, a compliant layer adjacent to the waveguide panel, and a projection layer over the compliant layer, the projection layer comprising the location pattern and providing a projection surface on which an image of the display content is projected.

17. The multi-touch display system of claim 16 wherein the projection layer comprises a translucent screen layer and a pattern layer above the translucent screen layer wherein the translucent screen layer provides the projection surface and the pattern layer comprises the location pattern.

18. The multi-touch display system of claim 16 wherein the display panel further comprises a filter layer adapted to filter at least certain wavelengths of ambient light.

19. The multi-touch display system of claim 18 wherein the filter layer is provided between the compliant layer and the projection layer.

20. The multi-touch display system of claim 19 wherein the filter layer comprises:

a filtering layer to filter the at least certain wavelengths of ambient light; and

an anti-stick layer between the filtering layer and the compliant layer and configured to prevent the filtering layer from adhering to the compliant layer in response to the human touches.

21. The multi-touch display system of claim 16 wherein the waveguide panel comprises a beveled perimeter edge that has a substantially flat edge surface on which a light source is mounted, the light source injecting light into the waveguide panel through the substantially flat edge surface.

22. The multi-touch display system of claim 21 wherein an angle formed between the substantially flat edge surface and the front surface is between about 30 degrees and 60 degrees.

23. The multi-touch display system of claim 22 wherein the angle formed between the substantially flat edge surface and the front surface is around about 45 degrees.

24. The multi-touch display system of claim 16 wherein the projection layer further provides a reflection surface from which light that is provided from a light source of the digital pen and that is not absorbed by the location pattern is reflected back toward a light sensor of the digital pen.

25. The multi-touch display system of claim 1 wherein the touch sensing circuitry is adapted to detect frustrated total internal reflections.

26. The multi-touch display system of claim 1 further comprising the digital pen, which comprises a body, a stylus at one end of the body, a pressure sensor associated with the stylus, an image sensor, a light source, and a processor associated with the pressure sensor and the image sensor, wherein the processor is adapted to capture successive images of those portions of the unique location indicia where the digital pen is being used to write in response to the pressure sensor indicating that the stylus is in contact with the front surface of the display panel, the light source illuminating those portions of the unique location indicia to facilitate image capture.

27. A multi-touch display system comprising:

a display panel comprising a front surface to receive human touches and a location pattern provided in association with the front surface, the location pattern readable by a digital pen from the front surface and providing unique location indicia for the front surface wherein unique locations in the location pattern are identifiable from corresponding portions of the unique location indicia;

touch sensing circuitry adapted to detect the human touches on the front surface of the display panel and provide corresponding touch input;

a communication interface adapted to receive pen data bearing on writing information derived in response to the digital pen capturing images of those portions of the unique location indicia where the digital pen is being used to write; and

processing circuitry associated with the touch sensing circuitry and the communication interface and adapted to control display content being displayed on the display panel in response to the touch input and the pen data,

wherein to detect the human touches on the front surface of the display panel, the touch sensing circuitry is adapted to detect reflected light that is reflected from a rear surface of the display panel in response to the human touches:

wherein the display panel comprises a waveguide panel and a light source adapted to inject light into the waveguide panel such that a state of total internal reflection is achieved within the waveguide panel when the front surface of the display panel is not being touched by a human and frustrated total internal reflections occur when the front surface of the display panel receives the human touches, certain of the frustrated total internal reflections being reflected light that is detectable by the touch sensing circuitry;

wherein the waveguide panel comprises a beveled perimeter edge that has a substantially flat edge surface on which the light source is mounted, the light source injecting the light into the waveguide panel through the substantially flat edge surface; and

wherein an angle formed between the substantially flat edge surface and the front surface is between about 30 degrees and 60 degrees.

28. The multi-touch display system of claim 27 wherein the angle formed between the substantially flat edge surface and the front surface is around about 45 degrees.

Assignments (9)
RELEASE OF SECURITY INTEREST Recorded Jul 29, 2022
From: CITIZENS BANK, N.A.
To: GROTH CORPORATION, LLC (F/K/A GROTH CORPORATION); DEXTER MAGNETIC TECHNOLOGIES, INC.; CONTINENTAL DISC CORPORATION, LLC (F/K/A CONTINENTAL DISC CORPORATION)
Reel/Frame 060668/0268 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CLEARINGHOUSE LLC
Reel/Frame 054305/0505 →
SECURITY INTEREST Recorded Jun 29, 2018
From: RPX CLEARINGHOUSE LLC
To: JEFFERIES FINANCE LLC
Reel/Frame 046485/0644 →
RELEASE (REEL 038041 / FRAME 0001) Recorded Jan 2, 2018
From: JPMORGAN CHASE BANK, N.A.
To: RPX CORPORATION; RPX CLEARINGHOUSE LLC
Reel/Frame 044970/0030 →
SECURITY AGREEMENT Recorded Mar 9, 2016
From: RPX CORPORATION; RPX CLEARINGHOUSE LLC
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 038041/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2015
From: ROCKSTAR CONSORTIUM US LP; ROCKSTAR CONSORTIUM LLC; BOCKSTAR TECHNOLOGIES LLC; CONSTELLATION TECHNOLOGIES LLC; MOBILESTAR TECHNOLOGIES LLC; NETSTAR TECHNOLOGIES LLC
To: RPX CLEARINGHOUSE LLC
Reel/Frame 034924/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2014
From: ROCKSTAR BIDCO, LP
To: ROCKSTAR CONSORTIUM US LP
Reel/Frame 032436/0804 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2011
From: NORTEL NETWORKS LIMITED
To: ROCKSTAR BIDCO, LP
Reel/Frame 027143/0717 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2008
From: DORAY, BERNARD; TO, PAUL; HALLER, MICHAEL; POWELL, JAMES ROBERT; BRANDL, PETER; LEITNER, JAKOB; SEIFRIED, THOMAS JOSEF; MA, MOSES TAO-LING
To: NORTEL NETWORKS LIMITED
Reel/Frame 021862/0542 →