IP Library Granted Patent US 12,333,080
Granted Patent B2
US 12,333,080 · App. 17/349,117 · Granted Jun 17, 2025

Mixed reality display system and mixed reality display terminal

Inventor: Naoyuki Kanda (Tokyo, JP)
Assignee: Maxell, Ltd.
G06F3/017G02B27/017G06T19/006G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,333,080
App. No.
17/349,117
Granted
Jun 17, 2025
Kind
B2
Abstract

In a mixed reality display system, a server and a plurality of mixed reality display terminals are connected, and virtual objects are displayed. The virtual objects include a shared virtual object for which a plurality of terminals have an operation authority and a private virtual object for which only a specific terminal has an operation authority. The server has virtual object attribute information for displaying the virtual objects in each terminal, and each terminal has a motion detecting unit that detects a motion of a user for switching between the shared virtual object and the private virtual object. When a detection result by the motion detecting unit is received from the terminal, the server updates the virtual object attribute information depending on whether the virtual object is the shared virtual object or the private virtual object, and transmits data of the virtual object after the update to each terminal.

Claims (34)

1. A mixed reality display terminal in which virtual objects are displayed in real space in a mixed manner, comprising:

a controller,

a sensing device that detects an operation from a user, and

a communication interface configured to communicate via a network,

wherein the controller is configured to:

control to display three-dimensionally corresponding to a sight line of the user from a position of the user wearing the mixed reality display terminal,

control to display a virtual object superimposed on an image of the real space seen from a direction of the mixed reality display terminal, and

control to generate a changing user instruction for changing between a shared virtual object and a private virtual object and to generate displaying status information with a difference in display state for each display terminal,

wherein the communication interface is configured to:

transmit a virtual object information to the network, including the displaying status information and the changing user instruction, to update an attribute information in accordance with the operation, and

receive the virtual object information which includes the displaying status information and the shared virtual object for which an operation authority is given and the private virtual object for which only a specific display terminal has the operation authority in accordance with the attribute information,

wherein the controller is configured to control copying the shared virtual object to generate the private virtual object or merging the private virtual object with the shared virtual object of a copy source,

wherein the communication interface is configured to:

transmit information which updates the virtual object information necessary for displaying and operating the virtual object on the each display terminal to the network, and

receive updated attribute information from the network based on the information.

2. The mixed reality display terminal according to claim 1 ,

wherein the controller is configured to control to display the virtual object based on the updated attribute information.

3. A mixed reality display terminal in which virtual objects are displayed in real space in a mixed manner, comprising:

a controller,

a sensing device that detects an operation from a user, and

a communication interface configured to communicate via a network,

wherein the controller is configured to:

control to display three-dimensionally corresponding to a sight line of the user from a position of the user wearing the mixed reality display terminal,

control to display a virtual object superimposed on an image of the real space seen from a direction of the mixed reality display terminal, and

control to generate a changing user instruction for changing between a shared virtual object and a private virtual object and to generate displaying status information with a difference in display state for each display terminal,

wherein the communication interface is configured to:

transmit a virtual object information to the network, including the displaying status information and the changing user instruction, to update an attribute information in accordance with the operation,

receive the virtual object information which includes the displaying status information and the shared virtual object for which an operation authority is given and the private virtual object for which only a specific display terminal has the operation authority in accordance with the attribute information,

transmit information which updates the attribute information of the virtual object necessary for displaying and operating the virtual object on each display terminal to the network, and

receive updated attribute information from the network based on the information.

4. The mixed reality display terminal according to claim 3 ,

wherein the controller is configured to control to display the virtual object based on the updated attribute information.

5. The mixed reality display terminal according to claim 3 ,

wherein the information which updates the attribute information has information related to the operation authority for the shared virtual object or the private virtual object.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2021
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 058666/0407 →
MERGER Recorded Nov 29, 2021
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 058255/0579 →
Continuity (3)
Continuation 16990027 · Aug 11, 2020
Continuation 16606797
Related Publication 20210311558A1 · Oct 7, 2021
References Cited (23)
US 20030160785A1 · Baumberg · 2003 [cited by examiner]
US 20040004626A1 · Ida et al. · 2004 [cited by applicant]
US 20080005702A1 · Skourup · 2008 [cited by applicant]
US 20080285892A1 · Sposata et al. · 2008 [cited by applicant]
US 20120194645A1 · Fuller et al. · 2012 [cited by applicant]
US 20120210254A1 · Fukuchi et al. · 2012 [cited by applicant]
US 20130335405A1 · Scavezze · 2013 [cited by examiner]
US 20140368537A1 · Salter et al. · 2014 [cited by applicant]
US 20150149929A1 · Shepherd · 2015 [cited by applicant]
US 20160246899A1 · Hirschtick · 2016 [cited by examiner]
US 20160353062A1 · Ono et al. · 2016 [cited by applicant]
US 20170034227A1 · Yang · 2017 [cited by applicant]
US 20170039770A1 · Lanier et al. · 2017 [cited by applicant]
US 20170186064A1 · Kaptsan · 2017 [cited by examiner]
US 20170236492A1 · Taki et al. · 2017 [cited by applicant]
EP 3062219A1 · 2016 [cited by applicant]
JP 2016045623A · 2016 [cited by applicant]
JP 2016525741A · 2016 [cited by applicant]
Ren Zhou, et al. “Robust Hand Gesture Recognition with Kinect Sensor.” Proceedings of the 19th ACM international conference on Multimedia. ACM. 2011. [cited by applicant]
International Search Report and Written Opinion of PCT/JP2017/020951 dated Jul. 17, 2018. [cited by applicant]
Extended European Search Report received in corresponding European Application No. 17913032.3 dated Dec. 4, 2020. [cited by applicant]
European Office Action received in corresponding European Application No. 22196187.3 dated May 2, 2024. [cited by applicant]
Anonymous, “Combine document revisions”, Jan. 29, 2013, pp. 1-3, URL: https://support.microsoft.com/en-us/office/combine-document-revisions-f8f07f09-4461-4376-b041-89ad67412cfe. [cited by applicant]