IP Library Granted Patent US 10,499,002
Granted Patent B2
US 10,499,002 · App. 16/259,466 · Granted Dec 3, 2019

Information processing apparatus and information processing method

Inventors: Tatsuya Igarashi (Tokyo, JP); Norifumi Kikkawa (Tokyo, JP)
Assignee: SONY CORPORATION
H04N5/44504G06F3/013G06F3/048G06T3/0068G06T19/00H04N5/23216H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,499,002
App. No.
16/259,466
Granted
Dec 3, 2019
Kind
B2
Abstract

The present disclosure is intended to display registration information on a real-world registration information setting point and update the display with detection of an event in accordance with a change in the context as a trigger. A control for displaying a virtual object including registration information on a real-world registration information setting point is performed. The data processing unit performs a process for displaying registration information described in control data and a process for updating the display in accordance with a change in predefined context. Further, the data processing unit displays the virtual object indicative of the registration information setting point in conjunction with the display of the registration information. The data processing unit calculates the positional relationship between an information processing apparatus and the registration information setting point on the basis of the position, direction, and the like of a reference image (anchor) detected from the shot image in a virtual three-dimensional space, and displays the virtual object indicative of the registration information setting point on the basis of the calculated positional relationship and a change in the context.

Claims (50)

1. An information processing apparatus, comprising:

circuitry configured to:

control a display device to display an image of a real space;

acquire virtual object display control data, wherein the virtual object display control data includes:

an anchor as reference real object information,

first positional information associated with the anchor, and

second positional information associated with a registration information setting point;

determine a display position of the registration information setting point in the image based on the virtual object display control data; and

control the display device to display a virtual object at the display position of the registration information setting point in the image, wherein the virtual object includes at least one of position identification mark or registration information associated with the registration information setting point.

2. The information processing apparatus according to claim 1 , wherein

the circuitry is further configured to control the display device to update the virtual object based on an event to update the virtual object.

3. The information processing apparatus according to claim 2 , wherein the event includes one of user operation, lapse of a predetermined time from start of the display of the virtual object, or movement of the display device.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

receive data;

transmit the data to a server; and

receive access information to acquire the virtual object display control data corresponding to the data.

5. The information processing apparatus according to claim 4 , wherein the data includes one of a beacon, a thumbnail, image feature amount data, or a marker.

6. The information processing apparatus according to claim 1 , wherein

the virtual object display control data includes hyper-text markup language (HTML) data and a display control program, and

the circuitry is further configured to:

calculate the display position of the registration information setting point, and

display the virtual object indicative of the registration information setting point in the calculated display position.

7. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the display device to display the registration information on the registration information setting point based on a defined time corresponding to the registration information setting point.

8. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the display device to display the registration information on the registration information setting point based on a determination that an action history of a user of the information processing apparatus and a defined action history coincide with each other.

9. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the display device to display the registration information on the registration information setting point based on registered schedule information associated with a user of the information processing apparatus.

10. The information processing apparatus according to claim 1 , further comprising a sensor configured to detect physical information associated with a user of the information processing apparatus,

wherein the circuitry is further configured to control the display device to display the registration information on the registration information setting point based on a match between an input from the sensor and a defined condition.

11. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to change an output mode of the registration information based on setting information, wherein the setting information is associated with the information processing apparatus.

12. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

acquire user attribute information; and

select the registration information based on the user attribute information.

13. The information processing apparatus according to claim 1 , further comprising a sensor configured to detect a direction of a line of sight of a user of the information processing apparatus,

wherein the circuitry is further configured to control the display device to display the registration information on the registration information setting point in the direction of the line of sight.

14. An information processing method, comprising:

in an information processing apparatus:

controlling a display device to display an image of a real space;

acquiring virtual object display control data, wherein the virtual object display control data includes:

an anchor as reference real object information,

first positional information associated with the anchor, and

second positional information associated with a registration information setting point;

determining a display position of the registration information setting point in the image based on the virtual object display control data; and

controlling the display device to display a virtual object at the display position of the registration information setting point in the image, wherein the virtual object includes at least one of position identification mark or registration information associated with the registration information setting point.

15. A non-transitory, computer-readable medium having stored thereon, computer-executable instructions, which when executed by an information processing apparatus, cause the information processing apparatus to execute operations, the operations comprising:

controlling a display device to display an image of a real space;

acquiring virtual object display control data, wherein the virtual object display control data includes:

an anchor as reference real object information,

first positional information associated with the anchor, and

second positional information associated with a registration information setting point;

determining a display position of the registration information setting point in the image based on the virtual object display control data; and

controlling the display device to display a virtual object at the display position of the registration information setting point in the image, wherein the virtual object includes at least one of position identification mark or registration information associated with the registration information setting point.

Assignments (1)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
Priority Claims (1)
JP 2014-158133 · Aug 1, 2014 · national
Continuity (2)
Continuation 15326550
Related Publication 20190158774A1 · May 23, 2019