IP Library Granted Patent US 11,868,544
Granted Patent B2
US 11,868,544 · App. 17/527,860 · Granted Jan 9, 2024

Information processing device, information processing method, program, display system, display method, and electronic writing tool

Inventor: Takahiro Asano (Tokyo, JP)
Assignee: SHARP NEC DISPLAY SOLUTIONS, LTD.
G06F3/0325G06F3/03542G06F3/03545
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,868,544
App. No.
17/527,860
Granted
Jan 9, 2024
Kind
B2
Abstract

An information processing device includes an acquisition unit and an association unit. The acquisition unit is configured to acquire first information which is generated by processing a detection result output from a first sensor provided outside of a plurality of electronic writing tools with which a plurality of objects are drawn on a display image and includes positions at which the plurality of electronic writing tools are detected on the display image and acquiring second information which is generated by processing a detection result output from a second sensor provided in each of the plurality of electronic writing tools and includes relative positions of the other electronic writing tools relative to each electronic writing tool. The association unit is configured to associate the plurality of electronic writing tools with positions of the plurality of electronic writing tools on the display image, respectively, using the first information and the second information.

Claims (45)

1. An information processing device comprising:

a memory that stores a program module;

a hardware processor configured to execute the program module to cause the hardware processor to:

acquire first information which is generated by processing a detection result output from a first sensor provided outside of a plurality of electronic writing tools with which a plurality of objects are drawn on a display image wherein the first information includes a plurality of respectively detected positions at which the plurality of electronic writing tools are detected on the display image respectively;

acquire second information which is generated by processing a respective detection result output from each second sensor of a plurality of second sensors respectively provided in the plurality of electronic writing tools the second information includes a respective set of relative positions of the other electronic writing tools relative to each electronic writing tool of the plurality of electronic writing tool; and

associate the plurality of electronic writing tools with the plurality of respectively detected positions of the plurality of electronic writing tools on the display image, respectively, based at least on the plurality of respectively detected positions and the respective sets of relative positions of the other electronic writing tools relative to each electronic writing tool of the plurality of electronic writing tools.

2. The information processing device according to claim 1 , wherein the hardware processor is configured to execute the program module to cause the hardware processor to further:

allocate a respective identification information to each of the plurality of electronic writing tools, and

associate the plurality of pieces of identification information with the plurality of respectively detected positions of the plurality of electronic writing tools on the display image, respectively.

3. The information processing device according to claim 1 , wherein the first sensor is configured to detect light emitted from a light-emitting unit provided in each of the plurality of electronic writing tools.

4. The information processing device according to claim 3 , wherein the light emitted from the light-emitting unit is detected from an image including the display image on which the plurality of objects are drawn.

5. The information processing device according to claim 1 , wherein the first sensor is configured to detect a touch or an approach of each of the plurality of electronic writing tools to the display image.

6. The information processing device according to claim 1 , wherein each second sensor of the plurality of second sensors includes at least one of an optical sensor and an ultrasonic sensor.

7. The information processing device according to claim 1 , wherein the hardware processor is configured to execute the program module to cause the hardware processor to further acquire the first information and the second information when the plurality of electronic writing tools are pushed against the display image.

8. The information processing device according to claim 1 , further comprising:

a control unit configured to display the plurality of objects on the display image in different aspects in accordance with the plurality of electronic writing tools.

9. The information processing device according to claim 8 , wherein the aspect of each of the plurality of objects includes at least one of a line color and a line shape of each of the plurality of objects.

10. The information processing device according to claim 1 , wherein the display image is an image projected to a projection surface by a projector or an image displayed on a display surface by a display.

11. The information processing device according to claim 1 , wherein the plurality of objects are overlapped and displayed on the display image based on a plurality of trajectories along which the plurality of electronic writing tools are traced.

12. The information processing device according to claim 1 , wherein the hardware processor is configured to execute the program module to cause the hardware processor to further acquires the first information via one interface and acquires the second information via another interface different from the one interface.

13. An information processing method comprising:

acquiring first information which is generated by processing a detection result output from a first sensor provided outside of a plurality of electronic writing tools with which a plurality of objects are drawn on a display image and includes a plurality of respectively detected positions at which the plurality of electronic writing tools are detected on the display image respectively;

acquiring second information which is generated by processing a respective detection result output from each second sensor of a plurality of second sensors respectively provided in the plurality of electronic writing tools the second information includes a respective set of relative positions of the other electronic writing tools relative to each electronic writing tool of the plurality of electronic writing tool; and

associating the plurality of electronic writing tools with the plurality of respectively detected positions of the plurality of electronic writing tools on the display image, respectively, based at least on the plurality of respectively detected positions and the respective sets of relative positions of the other electronic writing tools relative to each electronic writing tool of the plurality of electronic writing tools.

14. A system comprising:

a plurality of electronic writing tools, each of the plurality of electronic writing tools being configured to write a respective object on a display image;

a first sensor provided outside of the plurality of electronic writing tools, the first sensor being configured to detect a plurality of respective positions of the plurality of electronic writing tools on the display image; and

an information processing device provided outside the plurality of electronic writing tools, and provided outside the first sensor, wherein each of the plurality of electronic writing tools further comprises:

a second sensor configured to detect a respective set of relative positions to other electronic writing tools of the plurality of electronic writing tool, the relative positions are relative to the electronic writing tools in the writing of the object on the display image, and

wherein the information processing device comprising:

a memory that stores a program module;

a hardware processor configured to execute the program module to cause the hardware processor to:

acquire first information which is generated by processing a detection result output from the first sensor, wherein the first information includes a plurality of respectively detected positions at which the plurality of electronic writing tools are detected on the display image respectively;

acquire second information which is generated by processing respective detection results output from the plurality of second sensors provided respectively in the plurality of electronic writing tools, wherein the second information includes respective sets of relative positions of the other electronic writing tools relative to the plurality of electronic writing tools; and

associate the plurality of electronic writing tools with the plurality of respectively detected positions of the plurality of electronic writing tools on the display image, respectively, based at least on the plurality of respectively detected positions and the respective sets of relative positions of the other electronic writing tools relative to each electronic writing tool of the plurality of electronic writing tools.

15. The system according to claim 14 , wherein each of the plurality of electronic writing tools comprises:

a supporter having a tip end and a rear end;

a light-emitting unit located at the tip end, the light-emitting unit being configured to emit light in writing of an object on a display image; and

the second sensor is located at the tip end and next to the light-emitting unit.

16. A system comprising:

a plurality of electronic writing tools, each of the plurality of electronic writing tools being configured to write a respective object on a display image;

wherein each of the plurality of electronic writing tools comprises;

a supporter having a tip end and a rear end;

a light-emitting unit located at the tip end, the light-emitting unit being configured to emit light in writing of an object on a display image; and

a sensor located at the tip end, the sensor and next to the light-emitting unit, the sensor being configured to detect a respective set of relative positions to other electronic writing tools of the plurality of electronic writing tool, the relative positions are relative to the electronic writing tools in the writing of the object on the display image.

Assignments (2)
MERGER Recorded Jun 26, 2026
From: SHARP NEC DISPLAY SOLUTIONS, LTD.
To: SHARP KABUSHIKI KAISHA
Reel/Frame 075830/0213 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2021
From: ASANO, TAKAHIRO
To: SHARP NEC DISPLAY SOLUTIONS, LTD.
Reel/Frame 058136/0595 →
Continuity (2)
Continuation PCTJP2019023625 · Jun 14, 2019
Related Publication 20220091682A1 · Mar 24, 2022