Granted Patent B2

US 12,249,020 · App. 17/426,112 · Granted Mar 11, 2025

Inventors: Wilhelmus Hendricus Alfonsus Bruls (Eindhoven, NL); Christiaan Varekamp (Veldhoven, NL); Bart Kroon (Eindhoven, NL)

Assignee: Koninklijke Philips N.V.

G06T15/06G06T7/70G06T2207/10028

Abstract

Claims (243)

1. An apparatus comprising:

a receiver circuit,

wherein the receiver circuit is arranged to receive an image signal,

wherein the image signal represents a scene,

wherein the image signal comprises image data and metadata,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describe a variation of the plurality of ray origins,

wherein the plurality of ray origins are mapped to a closed curve,

wherein the closed curve is an oval, and

wherein the plurality of parameters describe at least one property of the oval; and

a renderer circuit,

wherein the renderer circuit is arranged to render images from the plurality of images in response to the plurality of parameters.

2. The apparatus of claim 1 , wherein the closed curve is an ellipse.

3. The apparatus of claim 1 , wherein at least a portion of the plurality of parameters describe different functions for mapping pixel image positions to one of the ray origins and ray directions for at least two images of the plurality of images.

4. The apparatus of claim 1 ,

wherein at least two images of the plurality of images represent partial field of views, and

wherein the partial field of views is different for the at least two images.

5. The apparatus of claim 1 , comprising a variation of ray directions.

6. The apparatus of claim 1 ,

wherein each of the plurality of images comprises a first light intensity image and a first depth value image for the first light intensity image,

wherein the first depth value image comprises depth values for the pixels of the first light intensity image,

wherein a depth value for a first pixel of the first light intensity image is indicative of a distance from the ray origin for the first pixel to an object represented by the first pixel along a ray direction, and

wherein the renderer circuit is arranged to render images in response to the first light intensity image and the first depth value image.

7. The apparatus of claim 6 ,

wherein the renderer circuit is arranged to determine scene positions for image objects of the first light intensity image in response to the depth value image, and

wherein the renderer circuit is arranged to render images in response to the scene positions.

8. An apparatus comprising:

a receiver circuit,

wherein the receiver circuit is arranged to receive an image signal,

wherein the image signal represents a scene,

wherein the image signal comprises image data and metadata,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describe a variation of the plurality of ray origins, and

wherein the variation of the plurality of ray origins corresponds to a non-circular arrangement of the plurality of ray origins; and

a renderer circuit,

wherein the renderer circuit is arranged to render images from the plurality of images in response to the plurality of parameters,

wherein the plurality of parameters are provided by a map,

wherein the map is linked to the at least one image of the plurality of images,

wherein the map has a lower resolution than the at least one image, and

wherein at least a portion of the plurality of ray origins are mapped to the map.

9. The apparatus of claim 8 , wherein the renderer circuit is arranged to determine at least one of the ray origins by interpolation from the ray origins that are mapped to the map.

10. An apparatus comprising:

a receiver circuit,

wherein the receiver circuit is arranged to receive an image signal,

wherein the image signal represents a scene,

wherein the image signal comprises image data and metadata,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describe a variation of the plurality of ray origins, and

wherein a mapping from image positions to the plurality of ray origins is a continuous non-circular function, and

a renderer circuit,

wherein the renderer circuit is arranged to render images from the plurality of images in response to the plurality of parameters.

11. The apparatus of claim 10 , wherein at least a portion of the plurality of parameters describe different functions for mapping pixel image positions to one of the ray origins and ray directions for at least two images of the plurality of images.

12. The apparatus of claim 10 ,

wherein at least two images of the plurality of images represent partial field of views, and

wherein the partial field of views is different for the at least two images.

13. The apparatus of claim 10 , comprising a variation of ray directions.

14. The apparatus of claim 10 ,

wherein each of the plurality of images comprises a first light intensity image and a first depth value image for the first light intensity image,

wherein the first depth value image comprises depth values for the pixels of the first light intensity image,

wherein a depth value for a first pixel of the first light intensity image is indicative of a distance from a ray origin for the first pixel to an object represented by the first pixel along a ray direction, and

wherein the renderer circuit is arranged to render images in response to the first light intensity image and the first depth value image.

15. The apparatus of claim 14 ,

wherein the renderer circuit is arranged to determine scene positions for image objects of the first light intensity image in response to the depth value image, and

wherein the renderer circuit is arranged to render images in response to the scene positions.

16. An apparatus comprising:

a signal generator for generating an image signal,

wherein the image signal represents a scene,

wherein the signal generator is arranged to include an image data and a metadata in the image signal;

a first generator,

wherein the first generator is arranged to generate the image data,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins, and

wherein the ray origin is different for at least a portion of the pixels, and

a second generator,

wherein the second generator is arranged to generate the metadata,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describes a variation of the plurality of ray origins,

wherein the plurality of ray origins are mapped to a closed curve,

wherein the closed curve is an oval, and

wherein the plurality of parameters describe at least one property of the oval.

17. The apparatus of claim 16 , wherein the closed curve is an ellipse.

18. A method comprising:

receiving an image signal,

wherein the image signal represents a scene,

wherein the image signal comprises image data and metadata,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins,

wherein the ray origin is different positions for at least a portion of the pixels,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describe a variation of the plurality of ray origins,

wherein the plurality of ray origins are mapped to a closed curve,

wherein the closed curve is an oval, and

wherein the plurality of parameters describe at least one property of the oval; and

rendering images from the plurality of images in response to the plurality of parameters.

19. A non-transitory computer-readable medium comprising a computer program, wherein the computer program, when executed on a processor, performs the method as claimed in claim 18 .

20. The method of claim 18 , wherein the closed curve is an ellipse.

21. A method comprising:

generating an image signal,

wherein the signal generator is arranged to include the image data and the metadata in the image signal, and

wherein the image signal represents a scene;

generating image data,

wherein the image data comprises a plurality of images,

wherein each image comprising pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins, and

wherein the ray origin is different positions for at least a portion of the pixels; and

generating metadata,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describes a variation of the plurality of ray origins,

wherein the plurality of ray origins are mapped to a closed curve,

wherein the closed curve is an oval, and

wherein the plurality of parameters describe at least one property of the oval.

22. A non-transitory computer-readable medium comprising a computer program, wherein the computer program, when executed on a processor, performs the method as claimed in claim 21 .

23. The method of claim 21 , wherein the closed curve is an ellipse.

24. An apparatus comprising:

a signal generator for generating an image signal,

wherein the image signal represents a scene, and

wherein the signal generator is arranged to include an image data and a metadata in the image signal;

a first generator,

wherein the first generator is arranged to generate the image data,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins, and

wherein the ray origin is different for at least a portion of the pixels, and

a second generator,

wherein the second generator is arranged to generate the metadata,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describes a variation of the plurality of ray origins,

wherein the variation of the plurality of ray origins corresponds to a non-circular arrangement of the plurality of ray origins,

wherein the plurality of parameters are provided by a map,

wherein the map is linked to an image of the plurality of images,

wherein the map has a lower resolution than the image, and

wherein at least a portion of the of the plurality of ray origins are mapped to the map.

25. A method comprising:

receiving an image signal,

wherein the image signal represents a scene,

wherein the image signal comprises image data and metadata,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins,

wherein the ray origin is different positions for at least a portion of the pixels,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describe a variation of the plurality of ray origins,

wherein the variation of the plurality of ray origins corresponds to a non-circular arrangement of the plurality of ray origins,

wherein the plurality of parameters are provided by a map,

wherein the map is linked to an image of the plurality of images,

wherein the map has a lower resolution than the image, and

wherein at least a portion of the plurality of ray origins are mapped to the map; and

rendering images from the plurality of images in response to the plurality of parameters.

26. The method of claim 25 , wherein the rendering comprises determining at least one of the ray origins by interpolation from the ray origins that are mapped to the map.

27. A method comprising:

generating an image signal,

wherein the signal generator is arranged to include the image data and the metadata in the image signal, and

wherein the image signal represents a scene;

generating image data,

wherein the image data comprises a plurality of images,

wherein each image comprising pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins, and

wherein the ray origin is different positions for at least a portion of the pixels; and

generating metadata,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describes a variation of the plurality of ray origins,

wherein the variation of the plurality of ray origins corresponds to a non-circular arrangement of the plurality of ray origins,

wherein the plurality of parameters are provided by a map,

wherein the map is linked to the at least one image of the plurality of images,

wherein the map has a lower resolution than the at least one image, and

wherein at least a portion of the plurality of ray origins are mapped to the map.

28. An apparatus comprising:

a signal generator for generating an image signal,

wherein the image signal represents a scene, and

wherein the signal generator is arranged to include an image data and a metadata in the image signal;

a first generator,

wherein the first generator is arranged to generate the image data,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins, and

wherein the ray origin is different for at least a portion of the pixels, and

a second generator,

wherein the second generator is arranged to generate the metadata,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describes a variation of the plurality of ray origins, and

wherein a mapping from image positions to the plurality of ray origins is a continuous non-circular function.

29. A method comprising:

receiving an image signal,

wherein the image signal represents a scene,

wherein the image signal comprises image data and metadata,

wherein the image data comprises a plurality of images,

wherein each image comprises pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins,

wherein the ray origin is different positions for at least a portion of the pixels,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describe a variation of the plurality of ray origins, and

wherein a mapping from image positions to the plurality of ray origins is a continuous non-circular function; and

rendering images from the plurality of images in response to the plurality of parameters.

30. A non-transitory computer-readable medium comprising a computer program, wherein the computer program, when executed on a processor, performs the method as claimed in claim 29 .

31. A method comprising:

generating an image signal,

wherein the signal generator is arranged to include the image data and the metadata in the image signal, and

wherein the image signal represents a scene;

generating image data,

wherein the image data comprises a plurality of images,

wherein each image comprising pixels,

wherein at least one image of the plurality of images comprises a plurality of ray origins,

wherein each pixel of the at least one image represents an image property of the scene along a ray,

wherein the ray has a ray direction from a ray origin of the plurality of ray origins, and

wherein the ray origin is different positions for at least a portion of the pixels; and

generating metadata,

wherein the metadata comprises a plurality of parameters,

wherein the plurality of parameters describes a variation of the plurality of ray origins, and

wherein a mapping from image positions to the plurality of ray origins is a continuous non-circular function.

32. A non-transitory computer-readable medium comprising a computer program, wherein the computer program, when executed on a processor, performs the method as claimed in claim 31 .

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (24)