IP Library › Granted Patent US 10,419,736
Granted Patent B2
US 10,419,736 · App. 14/813,626 · Granted Sep 17, 2019

Method and apparatus for generating three-dimensional image

Inventors: Seok Lee (Hwaseong-si, KR); Dongwoo Kang (Seoul, KR); Byong Min Kang (Yongin-si, KR); Dong Kyung Nam (Yongin-si, KR); Juyong Park (Seongnam-si, KR); Jingu Heo (Yongin-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N13/117H04N13/376
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,419,736
App. No.
14/813,626
Granted
Sep 17, 2019
Kind
B2
Abstract

A method for generating a three-dimensional (3D) image may detect a current eye position of a user and render a 3D image based on at least one of a previously detected eye position of the user and previously generated stereo images. A cycle at which the current eye position of user is detected and a cycle at which a 3D image is rendered may be asynchronous.

Claims (57)

1. A method of generating a three-dimensional (3D) image, the method comprising:

detecting a plurality of current eye positions of a user's eyes consecutively according to a first cycle;

generating respective stereo images for both eyes of the user based on at least one current eye position of the plurality of current eye positions of the user's eyes, the generating performed consecutively according to a second cycle;

rendering a 3D image consecutively based on another at least one current eye position of the plurality of current eye positions of the user's eyes and previously generated stereo images, the rendering performed consecutively according to a third cycle; and

displaying the consecutively-rendered 3D images to the user,

wherein the detecting, the generating, and the rendering are performed in parallel and asynchronously, based on the first, second, and third cycles being different and asynchronized from each other, such that

the detecting includes storing each current eye position of the plurality of current eye positions between consecutive detections of the user's eyes according to the first cycle,

the generating includes generating the respective stereo images based on one current eye position of the plurality of current eye positions that was stored most recently prior to the generating the respective stereo images and storing the respective stereo images that were most recently generated respective stereo images between consecutive generations of respective stereo images according to the second cycle, the one current eye position that was stored most recently prior to the generating the respective stereo images being a first eye position, and

the rendering includes rendering the 3D image based on both another one current eye position of the plurality of current eye positions that was stored most recently prior to the rendering the 3D image and the respective stereo images that were stored most recently prior to the rendering the 3D image, the another one current eye position that was stored most recently prior to the rendering the 3D image being a second eye position, the second eye position being separate from the first eye position.

2. The method of claim 1 , wherein the detecting comprises:

photographing the user using a camera to generate a photographed image of the user; and

detecting at least one current eye position of the plurality of current eye positions of the user's eyes using the photographed image of the user.

3. The method of claim 1 , wherein the rendering comprises:

estimating a current eye position based on the second eye position; and

rendering the 3D image based on the estimated current eye position and the respective stereo images that were stored most recently prior to the rendering the 3D image.

4. The method of claim 1 , wherein the generating comprises:

estimating a current eye position based on the first eye position; and

generating the respective stereo images based on the estimated current eye position.

5. The method of claim 4 , wherein the estimating comprises:

calculating a speed vector of a plurality of previously detected eye positions; and

estimating the current eye position based on the speed vector.

6. The method of claim 1 , wherein the generating comprises different operation cycles based on types of contents to be displayed.

7. The method of claim 1 , further comprising:

receiving an image,

wherein the generating comprises generating the respective stereo images using the image.

8. The method of claim 7 , wherein the generating comprises:

detecting a foreground of the image;

calculating a motion vector of the detected foreground;

estimating a current position of the foreground in the image based on the calculated motion vector; and

generating the respective stereo images based on the estimated current position.

9. The method of claim 1 , wherein the generating respective stereo images comprises receiving the previously generated stereo images.

10. An apparatus for generating a three-dimensional (3D) image, the apparatus comprising:

a memory storing a program of instructions; and

a processor configured to execute the program of instructions to

detect a plurality of current eye positions of a user's eyes consecutively according to a first cycle,

generate respective stereo images for both eyes of the user based on at least one current eye position of the plurality of current eye positions of the user's eyes, the generating performed consecutively according to a second cycle;

render a 3D image in parallel with the detecting based on another at least one current eye position of the plurality of current eye positions of the user's eyes and previously generated stereo images, the rendering performed consecutively according to a third cycle, and

display the consecutively-rendered 3D images to the user,

wherein the detecting, the generating, and the rendering are performed in parallel and asynchronously, based on the first, second, and third cycles being different and asynchronized from each other, such that

the detecting includes storing each current eye position of the plurality of current eye positions between consecutive detections of the user's eyes according to the first cycle,

the generating includes generating the respective stereo images based on one current eye position of the plurality of current eye positions that was stored most recently prior to the generating the respective stereo images and storing the respective stereo images that were most recently generated respective stereo images between consecutive generations of respective stereo images according to the second cycle, the one current eye position that was stored most recently prior to the generating the respective stereo images being a first eye position, and

the rendering includes rendering the 3D image based on both another one current eye position of the plurality of current eye positions that was stored most recently prior to the rendering the 3D image and the respective stereo images that were stored most recently prior to the rendering the 3D image, the another one current eye position that was stored most recently prior to the rendering the 3D image being a second eye position, the second eye position being separate from the first eye position.

11. The apparatus of claim 10 , the processor further configured to execute the program of instructions to

estimate a current eye position based on the first eye position, and

generate the respective stereo images based on the estimated current eye position.

12. The apparatus of claim 11 , the processor further configured to execute the program of instructions to

calculate a speed vector of a plurality of previously detected eye positions, and

estimate the current eye position based on the speed vector.

13. The apparatus of claim 11 , the processor further configured to execute the program of instructions to perform different operation cycles based on types of contents to be displayed.

14. The apparatus of claim 11 , the processor further configured to execute the program of instructions to:

receive an image, and

generate the respective stereo images using the image.

15. The apparatus of claim 11 , the processor further configured to execute the program of instructions to

detect a foreground of the image,

calculate a motion vector of the detected foreground,

estimate a current position of the foreground in the image based on the calculated motion vector, and

generate the respective stereo images based on the estimated current position.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2015
From: LEE, SEOK; KANG, DONGWOO; KANG, BYONG MIN; NAM, DONG KYUNG; PARK, JUYONG; HEO, JINGU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 036219/0048 →
Priority Claims (1)
KR 10-2014-0169678 · Dec 1, 2014 · national
Continuity (1)
Related Publication 20160156902A1 · Jun 2, 2016
Cited By (1)
US 12,323,567