IP Library Granted Patent US 9,937,420
Granted Patent B2
US 9,937,420 · App. 14/994,027 · Granted Apr 10, 2018

Method and apparatus for the projection of images, video, and/or holograms generated by a computer simulation

Inventor: Takeo Matsukawa (San Jose, CA)
Assignee: Sony Interactive Entertainment Inc.
A63F13/27A63F13/24A63F13/332
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,937,420
App. No.
14/994,027
Granted
Apr 10, 2018
Kind
B2
Abstract

A method includes running a computer simulation that is controlled at least in part by a handheld controller, displaying images generated by the computer simulation on a display, and projecting at least one image generated by the computer simulation from an image projector coupled to the handheld controller. A system includes a display, a handheld controller, an image projector coupled to the handheld controller, and a processor based apparatus. Another system includes a display, a handheld controller, an image projector that is housed in a unit configured to be releasably docked to the handheld controller, and a processor based apparatus. Storage mediums storing one or more computer programs are also provided.

Claims (88)

1. A method, comprising:

running, with a processor based apparatus, a computer simulation that is controlled at least in part by a handheld controller;

displaying images generated by the computer simulation on a display;

detecting a presence of an image projector coupled to the handheld controller; and

in response to detecting a presence of an image projector coupled to the handheld controller, the computer simulation generating and the image projector projecting at least one image that is different than the images being simultaneously displayed on the display.

2. The method of claim 1 , further comprising:

wirelessly streaming the at least one image generated by the computer simulation to a location of the image projector coupled to the handheld controller before the at least one image generated by the computer simulation is projected from the image projector.

3. The method of claim 1 , further comprising:

providing one or more audio signals to a location of the image projector coupled to the handheld controller, wherein the one or more audio signals are generated by the computer simulation and are associated with the at least one image projected from the image projector.

4. The method of claim 3 , wherein the providing one or more audio signals to a location of the image projector coupled to the handheld controller comprises:

wirelessly streaming the one or more audio signals to a location of the image projector coupled to the handheld controller.

5. The method of claim 1 , further comprising:

automatically adjusting an angle of projection of the image projector according to a state of the computer simulation.

6. The method of claim 1 , wherein the projecting at least one image generated by the computer simulation from the image projector coupled to the handheld controller comprises:

forming a hologram based on the at least one image generated by the computer simulation.

7. The method of claim 1 , wherein the projecting at least one image generated by the computer simulation from the image projector coupled to the handheld controller comprises:

projecting the at least one image generated by the computer simulation in a direction of a clear panel.

8. The method of claim 7 , wherein the clear panel is coupled to the handheld controller.

9. The method of claim 7 , further comprising:

automatically adjusting an angle of the clear panel according to a state of the computer simulation.

10. The method of claim 1 , wherein the projecting at least one image generated by the computer simulation from the image projector coupled to the handheld controller comprises:

projecting the at least one image generated by the computer simulation in a direction of small particles suspended in the air.

11. The method of claim 10 , wherein the small particles suspended in the air comprise fog.

12. The method of claim 10 , further comprising:

automatically establishing the small particles suspended in the air according to a state of the computer simulation.

13. The method of claim 1 , wherein:

further in response to the detecting a presence of an image projector coupled to the handheld controller, the at least one image projected by the image projector is generated to include content that is specifically intended for the image projector and which would not otherwise be generated without detecting the presence of the image projector.

14. A system, comprising:

a display;

a handheld controller;

an image projector coupled to the handheld controller; and

a processor based apparatus in communication with the display, the handheld controller, and the image projector;

wherein the processor based apparatus is configured to execute steps comprising:

running a computer simulation that is controlled at least in part by the handheld controller;

sending images generated by the computer simulation to the display;

detecting a presence of the image projector coupled to the handheld controller; and

in response to detecting a presence of the image projector coupled to the handheld controller, the computer simulation generating and sending to the image projector at least one image that is different than the images being simultaneously sent to the display.

15. The system of claim 14 , wherein the sending the at least one image generated by the computer simulation to the image projector comprises:

wirelessly streaming the at least one image generated by the computer simulation to the image projector.

16. The system of claim 14 , wherein the processor based apparatus is further configured to execute steps comprising:

providing one or more audio signals to a location of the image projector coupled to the handheld controller, wherein the one or more audio signals are generated by the computer simulation and are associated with the at least one image generated by the computer simulation that is sent to the image projector.

17. The system of claim 16 , wherein the providing one or more audio signals to a location of the image projector coupled to the handheld controller comprises:

wirelessly streaming the one or more audio signals to a location of the image projector coupled to the handheld controller.

18. The system of claim 14 , wherein the processor based apparatus is further configured to execute steps comprising:

automatically adjusting an angle of projection of the image projector with respect to the handheld controller according to a state of the computer simulation.

19. The system of claim 14 , wherein the processor based apparatus is further configured to execute steps comprising:

controlling the image projector to form a hologram based on the at least one image generated by the computer simulation.

20. The system of claim 14 , wherein the processor based apparatus is further configured to execute steps comprising:

controlling the image projector to project the at least one image generated by the computer simulation in a direction of a clear panel.

21. The system of claim 20 , wherein the clear panel is coupled to the handheld controller.

22. The system of claim 20 , wherein the processor based apparatus is further configured to execute steps comprising:

automatically adjusting an angle of the clear panel according to a state of the computer simulation.

23. The system of claim 14 , wherein the processor based apparatus is further configured to execute steps comprising:

controlling the image projector to project the at least one image generated by the computer simulation in a direction of small particles suspended in the air.

24. The system of claim 23 , wherein the small particles suspended in the air comprise fog.

25. The system of claim 23 , wherein the processor based apparatus is further configured to execute steps comprising:

automatically establishing the small particles suspended in the air according to a state of the computer simulation.

26. The system of claim 14 , wherein:

further in response to the detecting a presence of the image projector coupled to the handheld controller, the at least one image sent to the image projector is generated to include content that is specifically intended for the image projector and which would not otherwise be generated without detecting the presence of the image projector.

27. A non-transitory computer readable storage medium storing one or more computer programs configured to cause a processor based system to execute steps comprising:

running a computer simulation that is controlled at least in part by a handheld controller;

sending images generated by the computer simulation to a display;

sending at least one image generated by the computer simulation to an image projector coupled to the handheld controller;

detecting a presence of the image projector; and

in response to detecting a presence of the image projector, the computer simulation generating the at least one image so that when sent to the image projector it will be different than images being simultaneously sent to the display.

28. The non-transitory computer readable storage medium of claim 27 , wherein the sending at least one image generated by the computer simulation to an image projector comprises:

wirelessly streaming the at least one image generated by the computer simulation to the image projector.

29. The non-transitory computer readable storage medium of claim 27 , wherein the one or more computer programs are further configured to cause the processor based system to execute steps comprising:

automatically adjusting an angle of projection of the image projector according to a state of the computer simulation.

30. The non-transitory computer readable storage medium of claim 27 , wherein the one or more computer programs are further configured to cause the processor based system to execute steps comprising:

controlling the image projector to form a hologram based on the at least one image generated by the computer simulation.

31. The non-transitory computer readable storage medium of claim 27 , wherein:

further in response to the detecting a presence of the image projector, the at least one image sent to the image projector is generated to include content that is specifically intended for the image projector and which would not otherwise be generated without detecting the presence of the image projector.

32. A non-transitory computer readable storage medium storing one or more computer programs configured to cause a processor based system to execute steps comprising:

running a computer simulation that is controlled at least in part by a handheld controller;

sending images generated by the computer simulation to a display;

sending at least one image generated by the computer simulation to an image projector that is housed in a unit configured to be releasably docked to the handheld controller;

detecting a presence of the image projector; and

in response to detecting a presence of the image projector, the computer simulation generating the at least one image so that when sent to the image projector it will be different than images being simultaneously sent to the display.

33. The non-transitory computer readable storage medium of claim 32 , wherein the sending at least one image generated by the computer simulation to an image projector comprises:

wirelessly streaming the at least one image generated by the computer simulation to the image projector.

34. The non-transitory computer readable storage medium of claim 32 , wherein the one or more computer programs are further configured to cause the processor based system to execute steps comprising:

automatically adjusting an angle of projection of the image projector according to a state of the computer simulation.

35. The non-transitory computer readable storage medium of claim 32 , wherein the one or more computer programs are further configured to cause the processor based system to execute steps comprising:

controlling the image projector to form a hologram based on the at least one image generated by the computer simulation.

36. The non-transitory computer readable storage medium of claim 32 , wherein the computer simulation comprises a video game and the handheld controller comprises a game controller.

37. The non-transitory computer readable storage medium of claim 32 , wherein:

further in response to the detecting a presence of the image projector, the at least one image sent to the image projector is generated to include content that is specifically intended for the image projector and which would not otherwise be generated without detecting the presence of the image projector.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 039276/0023 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2016
From: MATSUKAWA, TAKEO
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 037469/0835 →
Continuity (2)
Provisional Application 62234570 · Sep 29, 2015
Related Publication 20170087457A1 · Mar 30, 2017