IP Library › Granted Patent US 11,029,766
Granted Patent B2
US 11,029,766 · App. 14/901,683 · Granted Jun 8, 2021

Information processing apparatus, control method, and storage medium

Inventors: Tomoya Narita (Kanagawa, JP); Taku Inoue (Kanagawa, JP); Takehiro Hagiwara (Kanagawa, JP)
Assignee: SONY CORPORATION
G06F3/0346G02B27/20G06F3/017G06F3/0354G06F3/0386G06F3/0425G06F3/04845G06F2203/0383G06F2203/0384G06F2203/04806
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,029,766
App. No.
14/901,683
Granted
Jun 8, 2021
Kind
B2
Abstract

There is provided an information processing apparatus including: a recognition unit which recognizes an irradiation position of laser light by a laser pointer to a projection image; an acquisition unit which acquires movement information of the laser pointer; and an output unit which outputs a control signal for causing display of an object within a projection image corresponding to the irradiation position to be changed in accordance with the movement information.

Claims (68)

1. An information processing apparatus, comprising:

a central processing unit (CPU) configured to:

recognize a first irradiation position of a non-visible light marker emitted, on a projection image, by a laser pointer of a plurality of laser pointers, wherein

the projection image includes a plurality of objects,

the plurality of objects are different from the non-visible light marker,

the first irradiation position is recognized based on a difference between the projection image and a non-visible light captured image, and

the non-visible light captured image includes the non-visible light marker;

receive determination operation information from the plurality of laser pointers;

determine an object, from the plurality of objects, that corresponds to the first irradiation position of the non-visible light marker in the projection image as an operation target, wherein the object is determined as the operation target based on the received determination operation information;

acquire movement information of the plurality of laser pointers from the plurality of laser pointers,

wherein the acquired movement information of the plurality of laser pointers indicates movement of the plurality of laser pointers;

output a control signal based on the acquired movement information of the plurality of laser pointers; and

control movement of the object in the projection image based on the control signal and the determination of the object as the operation target, wherein

the movement of the object is similar to the movement of the plurality of laser pointers.

2. The information processing apparatus according to claim 1 ,

wherein the determination operation information is detected by the laser pointer.

3. The information processing apparatus according to claim 1 , wherein the CPU is further configured to recognize at least one of a first position coordinate of the first irradiation position of the non-visible light marker emitted by the laser pointer or a second position coordinate of a second irradiation position of a visible light marker emitted by the laser pointer.

4. The information processing apparatus according to claim 3 , wherein at least one of the visible light marker or the non-visible light marker is one of a figure, a one-dimensional bar code, or a two-dimensional bar code.

5. The information processing apparatus according to claim 3 , wherein the CPU is further configured to acquire the movement information based on a distortion of at least one of the visible light marker or the non-visible light marker.

6. The information processing apparatus according to claim 1 , wherein the movement information is associated with at least one of a vertical direction movement of the laser pointer, a horizontal direction movement of the laser pointer, a rotation movement of the laser pointer, a pan movement of the laser pointer, or a tilt movement of the laser pointer with respect to the projection image.

7. The information processing apparatus according to claim 1 , wherein the CPU is further configured to:

control projection of a coordinate recognition image of non-visible light, wherein

the projected coordinate recognition image is superimposed on the projection image, and

the laser pointer:

recognizes the projected coordinate recognition image,

reads coordinate specification information from the recognized coordinate recognition image, and

transmits the read coordinate specification information to the information processing apparatus; and

recognize a second irradiation position of visible light on the projection image based on the coordinate specification information.

8. The information processing apparatus according to claim 1 , wherein the CPU is further configured to recognize at least one of a second irradiation position that corresponds to visible light on the projection image or the first irradiation position based on at least one of:

at least one of a shape of a visible light marker or the shape of the non-visible light marker,

a color of at least one of the visible light marker or the non-visible light marker, or

a user ID embedded in at least one of the visible light marker or the non-visible light marker.

9. The information processing apparatus according to claim 1 , wherein the movement information is detected by at least a sensor device in each laser pointer of the plurality of laser pointers.

10. The information processing apparatus according to claim 1 , wherein

the CPU is further configured to change at least one of the first irradiation position or a second irradiation position to a third irradiation position based on a track of at least one of the first irradiation position or the second irradiation position, and

the second irradiation position corresponds to visible light emitted, on the projection image, by the laser pointer.

11. The information processing apparatus according to claim 10 , wherein

the CPU is further configured to trace the track of at least one of the first irradiation position or the second irradiation position based on the control signal, and

the control signal corresponds to pointer information that includes the movement information.

12. The information processing apparatus according to claim 11 , wherein

the CPU is further configured to output at least one of a cancellation command or a deletion command as the pointer information based on the traced track, and

the traced track corresponds to a horizontal track of at least one of the first irradiation position or the second irradiation position.

13. A control method, comprising:

recognizing an irradiation position of a non-visible light marker emitted, on a projection image, by a laser pointer of a plurality of laser pointers, wherein

the projection image includes a plurality of objects,

the plurality of objects are different from the non-visible light marker,

the irradiation position is recognized based on a difference between the projection image and a non-visible light captured image, and

the non-visible light captured image includes the non-visible light marker;

receiving determination operation information from the plurality of laser pointers;

determining an object, from the plurality of objects, that corresponds to the irradiation position of the non-visible light marker in the projection image as an operation target, wherein the object is determined as the operation target based on the received determination operation information;

acquiring movement information of the plurality of laser pointers from the plurality of laser pointers,

wherein the acquired movement information of the plurality of laser pointers indicates movement of the plurality of laser pointers;

outputting a control signal based on the acquired movement information of the plurality of laser pointers; and

controlling movement of the object in the projection image based on the control signal and the determination of the object as the operation target, wherein

the movement of the object is similar to the movement of the plurality of laser pointers.

14. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a computer, cause the computer to execute operations, the operations comprising:

recognizing an irradiation position of a non-visible light marker emitted, on a projection image, by a laser pointer of a plurality of laser pointers, wherein

the projection image includes a plurality of objects,

the plurality of objects are different from the non-visible light marker,

the irradiation position is recognized based on a difference between the projection image and a non-visible light captured image, and

the non-visible light captured image includes the non-visible light marker;

receiving determination operation information from the plurality of laser pointers;

determining an object, from the plurality of objects, that corresponds to the irradiation position of the non-visible light marker in the projection image as an operation target, wherein the object is determined as the operation target based on the received determination operation information;

acquiring movement information of the plurality of laser pointers from the plurality of laser pointers,

wherein the acquired movement information of the plurality of laser pointers indicates movement of the plurality of laser pointers;

outputting a control signal based on the acquired movement information of the plurality of laser pointers; and

controlling movement of the object in the projection image based on the control signal and the determination of the object as the operation target, wherein

the movement of the object is similar to the movement of the plurality of laser pointers.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2016
From: NARITA, TOMOYA; INOUE, TAKU; HAGIWARA, TAKEHIRO
To: SONY CORPORATION
Reel/Frame 037484/0633 →
Priority Claims (1)
JP JP2013-133891 · Jun 26, 2013 · national
Continuity (1)
Related Publication 20160370883A1 · Dec 22, 2016
Cited By (2)
US 12,271,537 US 12,704,910