IP Library › Granted Patent US 12,631,885
Granted Patent B2
US 12,631,885 · App. 18/887,090 · Granted May 19, 2026

Display control apparatus and display control method

Inventors: Tomokazu Kake (Tokyo, JP); Takayuki Ishida (Tokyo, JP); Akira Suzuki (Tokyo, JP); Yasuhiro Watari (Tokyo, JP)
Assignee: Sony Interactive Entertainment Inc.
G02B27/0179G02B27/017G06F3/01G06F3/012G06F3/013G06F3/0346G06F3/038G06F3/0484G06F3/0485G09G5/00H04N5/64G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,631,885
App. No.
18/887,090
Granted
May 19, 2026
Kind
B2
Abstract

Methods and apparatus provide for: generating a virtual space image by specifying a viewpoint position and a direction of line of sight and display the image on a head-mounted display, specifying a plurality of positions in the virtual space as viewpoint positions, changing the viewpoint position to a position determined from among the plurality of positions in accordance with an operation by a user, specifying a direction of line of sight, when the viewpoint position is changed, and displaying an image based on a same virtual three-dimensional space on the head mounted display and a display device other than the head mounted display.

Claims (40)

1 . A display control apparatus comprising:

one or more memory devices configured to store instructions; and

one or more processors, that upon execution of the instructions, are configured to:

specify a plurality of positions in a virtual space;

display a first image including one or more markers indicative of one or more positions on a screen of a head mount display (HMD);

change a manner of displaying a marker among the one or more markers to indicate a position depicted by the marker;

change a viewpoint position to the position depicted by the marker in accordance with a user operation specifying the position depicted by the marker as the viewpoint position;

and

display the first image including the marker as the viewpoint position based on the virtual space on the HMD and a second image based on the virtual space on a display device other than the HMD.

2 . The display control apparatus of claim 1 , wherein the first image and the second image are at the viewpoint position.

3 . The display control apparatus of claim 1 , wherein the first image is at the viewpoint position and the second image is at a second viewpoint position different from the viewpoint position.

4 . The display control apparatus of claim 1 , wherein at least some of the one or more positions are separate from each other.

5 . The display control apparatus of claim 1 , wherein the one or more processors are configured to continuously move the viewpoint position in a linear manner or a curved manner from the viewpoint position upon the change to the viewpoint position.

6 . The display control apparatus of claim 1 , wherein the one or more processors are configured to move the viewpoint position to another viewpoint position in the virtual space either when the HMD is moved by a distance that is equal to or farther than a given distance or when the HMD is moved at a speed that is equal to or faster than a given speed.

7 . The display control apparatus of claim 1 , wherein the one or more processors, that upon execution of the instructions, are configured change the manner of displaying the marker to indicate the position when the marker enters a given range from a center of the screen.

8 . A method comprising:

specifying a plurality of positions in a virtual space;

displaying a first image including one or more markers indicative of one or more positions on a screen of an HMD;

changing a manner of displaying a marker among the one or more markers to indicate a position depicted by the marker is a candidate viewpoint position;

changing a viewpoint position to the position depicted by the marker in accordance with a user operation specifying the position depicted by the marker as the viewpoint position;

and

displaying the first image including the marker as the viewpoint position based on the virtual space on the HMD and a second image based on the virtual space on a display device other than the HMD.

9 . The method of claim 8 , wherein the first image and the second image are at the viewpoint position.

10 . The method of claim 8 , wherein the first image is at the viewpoint position and the second image is at a second viewpoint position different from the viewpoint position.

11 . The method of claim 8 , wherein at least some of the one or more viewpoint positions are separate from each other.

12 . The method of claim 8 , further comprising continuously moving the viewpoint position in a linear manner or a curved manner from the viewpoint position upon the change to the viewpoint position.

13 . The method of claim 8 , further comprising moving the viewpoint position to another viewpoint position in the virtual space either when the HMD is moved by a distance that is equal to or farther than a given distance or when the HMD is moved at a speed that is equal to or faster than a given speed.

14 . The method of claim 8 , wherein changing the manner of displaying the marker to indicate the position is performed when the marker enters a given range from a center of the screen.

15 . A non-transitory, computer-readable recording medium containing a computer program, which when executed by a computer, causes the computer to perform a method by carrying out actions comprising:

specifying a plurality of positions in a virtual space;

displaying a first image including one or more markers indicative of one or more positions on a screen of an HMD;

changing a manner of displaying a marker among the one or more markers to indicate a position depicted by the marker is a candidate viewpoint position;

changing a viewpoint position to the position depicted by the marker in accordance with a user operation specifying the position depicted by the marker as the viewpoint position;

and

displaying the first image including the marker as the viewpoint position based on the virtual space on the HMD and a second image based on the virtual space on a display device other than the HMD.

16 . The non-transitory, computer-readable recording medium of claim 15 , wherein the computer program, which when executed by the computer, causes the computer to perform the method by carrying out actions, wherein displaying the first image and displaying the second image are at the viewpoint position.

17 . The non-transitory, computer-readable recording medium of claim 15 , wherein the computer program, which when executed by the computer, causes the computer to perform the method by carrying out actions, including displaying the first image the viewpoint position and displaying the second image is at a second viewpoint position different from the viewpoint position.

18 . The non-transitory, computer-readable recording medium of claim 15 , wherein at least some of the one or more viewpoint positions are separate from each other.

19 . The non-transitory, computer-readable recording medium of claim 15 , wherein the computer program, which when executed by the computer, causes the computer to perform the method by carrying out actions, including continuously moving the viewpoint position in a linear manner or a curved manner from the viewpoint position upon the change to the viewpoint position.

20 . The non-transitory, computer-readable recording medium of claim 15 , wherein the computer program, which when executed by the computer, causes the computer to perform the method by carrying out actions, including moving the viewpoint position to another viewpoint position in the virtual space either when the HMD is moved by a distance that is equal to or farther than a given distance or when the HMD is moved at a speed that is equal to or faster than a given speed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2026
From: KAKE, TOMOKAZU; ISHIDA, TAKAYUKI; SUZUKI, AKIRA; WATARI, YASUHIRO
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 073594/0990 →
Priority Claims (1)
JP 2015-235897 · Dec 2, 2015 · national
Continuity (4)
Continuation 18452819 · Aug 21, 2023
Continuation 17225203 · Apr 8, 2021
Continuation 15773409
Related Publication 20250004284A1 · Jan 2, 2025
References Cited (157)
US 5742264A · Inagaki · 1998 [cited by examiner]
US 5907328A · Brush, II · 1999 [cited by examiner]
US 5993318A · Kousaki · 1999 [cited by examiner]
US 6124843A · Kodama · 2000 [cited by examiner]
US 6831656B2 · Kitao · 2004 [cited by examiner]
US 7298384B2 · Anabuki · 2007 [cited by examiner]
US 7479967B2 · Bachelder · 2009 [cited by examiner]
US 7492362B2 · Sakagawa · 2009 [cited by applicant]
US 7646394B1 · Neely, III · 2010 [cited by examiner]
US 8108190B2 · Riener · 2012 [cited by applicant]
US 8564645B2 · Suzuki · 2013 [cited by applicant]
US 8879787B2 · Ikenoue · 2014 [cited by applicant]
US 9075514B1 · Karakotsios · 2015 [cited by examiner]
US 9081177B2 · Wong · 2015 [cited by applicant]
US 9250799B2 · Okura · 2016 [cited by applicant]
US 9256284B2 · Hanaya · 2016 [cited by applicant]
US 9268138B2 · Shimizu · 2016 [cited by applicant]
US 9380287B2 · Nistico · 2016 [cited by applicant]
US 9448625B2 · Kobayashi · 2016 [cited by applicant]
US 9607439B2 · Uematsu · 2017 [cited by applicant]
US 9658737B2 · Rothenberger · 2017 [cited by applicant]
US 9684169B2 · Tanaka · 2017 [cited by applicant]
US 9740009B2 · Fujimaki · 2017 [cited by applicant]
US 9846303B2 · Biwa · 2017 [cited by applicant]
US 9928650B2 · Inomata · 2018 [cited by applicant]
US 10029176B2 · Aizawa · 2018 [cited by applicant]
US 10116914B2 · Woods · 2018 [cited by examiner]
US 10261581B2 · Kim · 2019 [cited by examiner]
US 11042038B2 · Kake · 2021 [cited by applicant]
US 20020024521A1 · Goden · 2002 [cited by examiner]
US 20030017872A1 · Oishi · 2003 [cited by examiner]
US 20040254771A1 · Riener · 2004 [cited by examiner]
US 20050024388A1 · Takemoto · 2005 [cited by examiner]
US 20050270309A1 · Murata · 2005 [cited by examiner]
US 20070109296A1 · Sakagawa · 2007 [cited by applicant]
US 20070252833A1 · Kuroki · 2007 [cited by examiner]
US 20070258658A1 · Kobayashi · 2007 [cited by applicant]
US 20080024392A1 · Gustafsson · 2008 [cited by applicant]
US 20080132334A1 · Nonaka · 2008 [cited by examiner]
US 20080297437A1 · Takahashi · 2008 [cited by examiner]
US 20090069096A1 · Nishimoto · 2009 [cited by examiner]
US 20100026714A1 · Utagawa · 2010 [cited by examiner]
US 20100066734A1 · Ohta · 2010 [cited by examiner]
US 20100087258A1 · Moriwaki · 2010 [cited by examiner]
US 20100182409A1 · Suzuki · 2010 [cited by applicant]
US 20100289878A1 · Sato · 2010 [cited by applicant]
US 20110014977A1 · Yamazaki · 2011 [cited by examiner]
US 20110034300A1 · Hall · 2011 [cited by examiner]
US 20110140994A1 · Noma · 2011 [cited by examiner]
US 20110245942A1 · Yamamoto · 2011 [cited by examiner]
US 20120039507A1 · Ikenoue · 2012 [cited by examiner]
US 20120127284A1 · Bar-Zeev · 2012 [cited by examiner]
US 20120169725A1 · Shimizu · 2012 [cited by examiner]
US 20120212429A1 · Okura · 2012 [cited by applicant]
US 20130009957A1 · Arakita · 2013 [cited by applicant]
US 20130194305A1 · Kakuta · 2013 [cited by examiner]
US 20130258461A1 · Sato · 2013 [cited by examiner]
US 20130293530A1 · Perez · 2013 [cited by examiner]
US 20140002329A1 · Nishimaki · 2014 [cited by examiner]
US 20140125785A1 · Na · 2014 [cited by examiner]
US 20140160129A1 · Sako · 2014 [cited by applicant]
US 20140186002A1 · Hanaya · 2014 [cited by examiner]
US 20140198033A1 · Kobayashi · 2014 [cited by examiner]
US 20140225920A1 · Murata · 2014 [cited by examiner]
US 20140241586A1 · Miyamoto · 2014 [cited by examiner]
US 20140327613A1 · Chessa · 2014 [cited by examiner]
US 20140354515A1 · LaValle · 2014 [cited by examiner]
US 20140361956A1 · Mikhailov · 2014 [cited by examiner]
US 20140362446A1 · Bickerstaff · 2014 [cited by examiner]
US 20140375560A1 · Masuda · 2014 [cited by examiner]
US 20140375687A1 · Tanaka · 2014 [cited by examiner]
US 20150009101A1 · Biwa · 2015 [cited by examiner]
US 20150022664A1 · Pflug · 2015 [cited by examiner]
US 20150049003A1 · Fujimaki · 2015 [cited by applicant]
US 20150049018A1 · Gomez · 2015 [cited by examiner]
US 20150052458A1 · Rothenberger · 2015 [cited by applicant]
US 20150177829A1 · Sakuta · 2015 [cited by examiner]
US 20150199850A1 · Uematsu · 2015 [cited by examiner]
US 20150288944A1 · Nistico · 2015 [cited by examiner]
US 20150293362A1 · Takahashi · 2015 [cited by examiner]
US 20150352437A1 · Koseki · 2015 [cited by examiner]
US 20160078681A1 · Shikoda · 2016 [cited by examiner]
US 20160078682A1 · Shikoda · 2016 [cited by examiner]
US 20160125654A1 · Shikoda · 2016 [cited by examiner]
US 20160162248A1 · Bassett · 2016 [cited by examiner]
US 20160282619A1 · Oto · 2016 [cited by examiner]
US 20160287994A1 · Tamaoki · 2016 [cited by examiner]
US 20160330376A1 · Debevec · 2016 [cited by examiner]
US 20170076486A1 · Aizawa · 2017 [cited by examiner]
US 20170076497A1 · Inomata · 2017 [cited by examiner]
US 20170076503A1 · Tamaoki · 2017 [cited by examiner]
US 20170153713A1 · Niinuma · 2017 [cited by examiner]
US 20170169540A1 · Satori · 2017 [cited by examiner]
US 20170278262A1 · Kawamoto · 2017 [cited by applicant]
US 20180307310A1 · McCombe · 2018 [cited by examiner]
US 20180321493A1 · Kim · 2018 [cited by examiner]
US 20180329215A1 · Kake · 2018 [cited by applicant]
US 20180349083A1 · Kasahara · 2018 [cited by applicant]
US 20190121515A1 · Nashida · 2019 [cited by applicant]
CN 1409218A · 2003 [cited by applicant]
CN 1529880A · 2004 [cited by applicant]
CN 1708982A · 2005 [cited by applicant]
CN 101123692A · 2008 [cited by applicant]
CN 101414383A · 2009 [cited by applicant]
CN 101783967A · 2010 [cited by applicant]
CN 101970067A · 2011 [cited by applicant]
CN 102317888A · 2012 [cited by applicant]
CN 102317892A · 2012 [cited by applicant]
CN 102566052A · 2012 [cited by applicant]
CN 104238665A · 2014 [cited by applicant]
CN 104280882A · 2015 [cited by applicant]
CN 104376194 · 2015 [cited by applicant]
CN 104407700A · 2015 [cited by applicant]
CN 104423041A · 2015 [cited by applicant]
CN 104603673A · 2015 [cited by applicant]
CN 104794757A · 2015 [cited by applicant]
CN 108292490A · 2018 [cited by applicant]
CN 102860837A · 2019 [cited by applicant]
JP 08202281A · 1996 [cited by applicant]
JP 2000020753A · 2000 [cited by applicant]
JP 2000250699A · 2000 [cited by applicant]
JP 2002170132A · 2002 [cited by applicant]
JP 2002263371A · 2002 [cited by applicant]
JP 2004054590A · 2004 [cited by applicant]
JP 2004283521A · 2004 [cited by applicant]
JP 2005174021A · 2005 [cited by applicant]
JP 2006061716A · 2006 [cited by applicant]
JP 2007299326A · 2007 [cited by applicant]
JP 2007312930A · 2007 [cited by applicant]
JP 2012008745A · 2012 [cited by applicant]
JP 2012048597A · 2012 [cited by applicant]
JP 2014127987A · 2014 [cited by applicant]
JP 2014137396A · 2014 [cited by applicant]
JP 2015011368A · 2015 [cited by applicant]
JP 2015095045A · 2015 [cited by applicant]
JP 2015182712A · 2015 [cited by applicant]
JP 2015187797A · 2015 [cited by applicant]
JP 5869177B1 · 2016 [cited by applicant]
International Search Report for corresponding PCT Application No. PCT/JP2016/084937, 3 pages, dated Feb. 28, 2017. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion for corresponding PCT Application No. PCT/JP2016/084937, 10 pages, dated Jul. 6, 2018. [cited by applicant]
Partial Supplementary European Search Report for corresponding EP Application No. 16870544.0, 15 pages, dated Oct. 16, 2018. [cited by applicant]
Extended European Search Report for corresponding EP Application No. 18206819, 8 pages, dated Mar. 14, 2019. [cited by applicant]
Examination Report for corresponding EP Application No. 16870544.0, 5 pages, dated Feb. 25, 2020. [cited by applicant]
Examination Report for corresponding EP Application No. 18206819.7, 7 pages, dated Feb. 25, 2020. [cited by applicant]
Caroline Jay et al: “Amplifying Head Movements with Head-Mounted Displays”, Presence, vol. 12, No. 3, pp. 268-276, Jun. 1, 2003. [cited by applicant]
The First Office Action for corresponding CN Application No. 201680069099.8, 22 pages, dated Jul. 3, 2020. [cited by applicant]
Notice of Reasons for Refusal for corresponding JP Application No. 2020055471, 6 pages, dated Feb. 4, 2021. [cited by applicant]
The Second Office Action for corresponding CN Application No. 201680069099.8, 17 pages, dated Mar. 25, 2021. [cited by applicant]
Notification of Decision to Grant corresponding CN Application No. 201680069099.8, 8 pages, dated Sep. 30, 2021. [cited by applicant]
Extended European Search Report for corresponding EP Application No. 21208486.7, 8 pages, dated Feb. 17, 2022. [cited by applicant]
Notification of Reasons for Refusal for corresponding JP Application No. 2021-088448, 4 pages, dated Apr. 6, 2022. [cited by applicant]
Reconsideration Report before Appeal for corresponding JP Application No. 2021-088448, 4 pages, dated Dec. 16, 2022. [cited by applicant]
Notice of Reasons for Refusal for corresponding JP Application No. 2021-88448, 16 pages, dated Aug. 30, 2023. [cited by applicant]
Sato “The 13th time of VR Gaming Today! series Playstation VR, TGS2015 exhibition title was tried! Precious opportunity. A title to be played by a game fan on a general date!”, Game Watch, 12 pages, Sep. 18, 2015. [cited by applicant]
PlayStation.Blog, “PlayStation “R” VR is jumping to the world of the game!” 9 pages, Nov. 24, 2015. [cited by applicant]
Decision of “the official name of the Sony's retractable VR headset System is,” PlayStation VR ProNews, 4 pages, Sep. 18, 2015. [cited by applicant]
Notification of Fulfilling of Registration Formality for corresponding CN Application No. 202111534076.9, 10 pages, dated Jul. 9, 2024. [cited by applicant]