IP Library Granted Patent US 12700189
Granted Patent B2
US 12700189 · App. 18/565,638 · Granted Aug 4, 2026

Content display device, content display program, content display method, and content display system

Inventors: Mashuu Nakamura (Tokyo, JP); Jun Takahashi (Kawasaki, JP); Shota Saito (Tokyo, JP); Byongchol Pei (Tokyo, JP)
Assignee: KABUSHIKI KAISHA TOSHIBA
G06T19/006G06F3/04815G06F3/04842G06T7/73G06T2200/24G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12700189
App. No.
18/565,638
Granted
Aug 4, 2026
Kind
B2
Abstract

According to one embodiment, provided are a parameter calculating unit 101 that calculates an initial position and an initial posture of a device as initial parameters based on a captured image of a real object with a position of the real object as an origin, a parameter updating unit 102 that calculates displacement of a position and a posture of the device and updates the position and the posture of the device starting from the initial position and the initial posture, a display processing unit 104 that overlays and displays the content on the real object, the content being disposed in a virtual space with the position of the real object as an origin, and a determination processing unit 105 that changes, when a virtual object included in the displayed content is selected and operated, a determination state of the virtual object.

Claims (87)

1 . A content display device that displays content including at least one or more virtual objects, comprising:

a parameter calculating unit that calculates an initial position and an initial posture of the content display device as initial parameters based on a captured image of a real object with a position of the real object as an origin;

a parameter updating unit that calculates displacement of a position and a posture of the content display device and updates the position and the posture of the content display device starting from the initial position and the initial posture;

a display processing unit that overlays and displays the content on the real object, the content being disposed in a virtual space with the position of the real object as an origin; and

a determination processing unit that changes, when a virtual object included in the displayed content is selected and operated, a determination state of the virtual object,

wherein

the determination state of the virtual object includes at least a normal state and an abnormal state, and

further comprising an output processing unit that outputs determination result information about a virtual object that is determined to be abnormal,

wherein

the determination result information associates an object ID, which is an identifier indicating the virtual object determined to be abnormal, with a user ID, which indicates a user who has changed the determination state.

2 . The content display device according to claim 1 , wherein

the determination processing unit changes the determination state of the virtual object according to a number of selection operations of the virtual object.

3 . The content display device according to claim 1 , wherein

the determination result information further associates the object ID with a date and time at which the determination state is changed.

4 . The content display device according to claim 1 , wherein

the determination result information further associates the object ID with text corresponding to a virtual object indicated by the object ID.

5 . The content display device according to claim 1 , wherein

the determination result information further associates the object ID with a media file.

6 . The content display device according to claim 1 , wherein

in response to an instruction operation of the user, the parameter calculating unit calculates the initial position and the initial posture of the content display device based on the captured image of the real object.

7 . The content display device according claim 1 , wherein

the parameter calculating unit calculates the initial position and the initial posture of the content display device based on the captured image of the real object at each predetermined cycle.

8 . The content display device according claim 1 , wherein

the parameter calculating unit calculates the initial position and the initial posture of the content display device based on the captured image of the real object each time a characteristic part of the real object is captured.

9 . The content display device according to claim 1 , wherein

the display processing unit displays a pin object, which is a pin-shaped virtual object indicating a position specified in the virtual space by the user.

10 . The content display device according to claim 9 , wherein

the pin object is associated with additional information, which includes at least one of text or a media file, and

in a case where the pin object is selected, the display processing unit displays the additional information associated with the pin object.

11 . The content display device according to claim 1 , wherein

the display processing unit extends and contracts a scale of the virtual object selected based on an instruction of the user in a direction selected from three axis directions in the virtual space.

12 . The content display device according to claim 1 , wherein

the virtual object is associated with a group ID that indicates a group to which the virtual object belongs and a parent ID that indicates another group to which the group indicated by such a group ID belongs.

13 . A non-transitory computer readable medium including a content display program that displays content including at least one or more virtual objects, the content display program causing a computer to function as:

a parameter calculating unit that calculates an initial position and an initial posture of a device as initial parameters based on a captured image of a real object with a position of the real object as an origin;

a parameter updating unit that calculates displacement of a position and a posture of the device and updates the position and the posture of the device starting from the initial position and the initial posture;

a display processing unit that overlays and displays the content on the real object, the content being disposed in a virtual space with the position of the real object as an origin; and

a determination processing unit that changes, when a virtual object included in the displayed content is selected and operated, a determination state of the virtual object,

wherein

the determination state of the virtual object includes at least a normal state and an abnormal state, and

further to function as an output processing unit that outputs determination result information about a virtual object that is determined to be abnormal,

wherein

the determination result information associates an object ID, which is an identifier indicating the virtual object determined to be abnormal, with a user ID, which indicates a user who has changed the determination state.

14 . A content display method that displays content including at least one or more virtual objects, wherein a computer:

calculates an initial position and an initial posture of a device as initial parameters based on a captured image of a real object with a position of the real object as an origin;

calculates displacement of a position and a posture of the device and updates the position and the posture of the device starting from the initial position and the initial posture;

overlays and displays the content on the real object, the content being disposed in a virtual space with the position of the real object as an origin; and

changes, when a virtual object included in the displayed content is selected and operated, a determination state of the virtual object,

wherein

the determination state of the virtual object includes at least a normal state and an abnormal state, and

further the computer outputs determination result information about a virtual object that is determined to be abnormal,

wherein

the determination result information associates an object ID, which is an identifier indicating the virtual object determined to be abnormal, with a user ID, which indicates a user who has changed the determination state.

15 . A content display system comprising:

a content display device that displays content including at least one or more virtual objects; and

a content management device communicatively coupled to the content display device, wherein

the content management device includes:

a converting unit that converts entered three-dimensional data into content information including the three-dimensional data and a content ID, which is an identifier uniquely indicating the three-dimensional data, and

a content transmitting unit that transmits the converted content information to the content display device,

the content display device includes:

a parameter calculating unit that calculates an initial position and an initial posture of the content display device as initial parameters based on a captured image of a real object with a position of the real object as an origin;

a parameter updating unit that calculates displacement of a position and a posture of the content display device and updates the position and the posture of the content display device starting from the initial position and the initial posture;

a content receiving unit that receives the content information transmitted from the content management device;

a display processing unit that overlays and displays the content on the real object based on the received content information, the content being disposed in a virtual space with the position of the real object as an origin; and

a determination processing unit that changes, when a virtual object included in the displayed content is selected and operated, a determination state of the virtual object,

wherein

the determination state of the virtual object includes at least a normal state and an abnormal state, and

further comprising an output processing unit that outputs determination result information about a virtual object that is determined to be abnormal,

wherein

the determination result information associates an object ID, which is an identifier indicating the virtual object determined to be abnormal, with a user ID, which indicates a user who has changed the determination state.

16 . A content display method executed by:

a content display device that displays content including at least one or more virtual objects; and

a content management device communicatively coupled to the content display device, wherein

the content management device:

converts entered three-dimensional data into content information including the three-dimensional data and a content ID, which is an identifier uniquely indicating the three-dimensional data, and

transmits the converted content information to the content display device,

the content display device:

calculates an initial position and an initial posture of the content display device as initial parameters based on a captured image of a real object with a position of the real object as an origin;

calculates displacement of a position and a posture of the content display device and updates the position and the posture of the content display device starting from the initial position and the initial posture;

receives the content information transmitted from the content management device;

overlays and displays the content on the real object based on the received content information, the content being disposed in a virtual space with the position of the real object as an origin; and

changes, when a virtual object included in the displayed content is selected and operated, a determination state of the virtual object,

wherein

the determination state of the virtual object includes at least a normal state and an abnormal state, and

further comprising an outputting determination result information about a virtual object that is determined to be abnormal,

wherein

the determination result information associates an object ID, which is an identifier indicating the virtual object determined to be abnormal, with a user ID, which indicates a user who has changed the determination state.