Granted Patent B2

US 12,256,110 · App. 18/488,663 · Granted Mar 18, 2025

Inventors: Andranik Aslanyan (Henderson, NV); Vin Lee Rah (Henderson, NV); Jasmine Hunter (Henderson, NV)

Assignee: Movella Inc.

H04N21/23424H04N5/265H04N21/25891H04N21/2743H04N21/4854

Abstract

Claims (70)

1. A method comprises:

capturing, in a streamer device, a user video stream from a user comprising at least a first image and a second image;

determining, in the streamer device, a first image of a marker in the first image, wherein the marker is located at a first marker location in the first image;

determining, in the streamer device, a second image of the marker in the second image, wherein the marker is located at a second marker location in the second image;

receiving, in the streamer device from a remote provider server, incoming object data associated with an object;

determining, in the streamer device, first characteristics associated with the object in response to the first image of the marker and the incoming object data;

determining, in the streamer device, second characteristics associated with the object in response to the second image of the marker and the incoming object data;

rendering, in the streamer device, a first image of the object in response to the first characteristics associated with the object and the incoming data associated with the object;

rendering, in the streamer device, a second image of the object in response to the second characteristics associated with the object and the incoming data associated with the object;

forming, in the streamer device, a composite user video stream comprising a first composite image and a second composite image, wherein the first composite image is determined in response to the first image and the first image of the object, and wherein the second composite image is determined in response to the second image and the second image of the object;

sending, from the streamer device to a video distribution server, the composite user video stream;

receiving, in the streamer device from the video distribution server, video consumption data associated with the composite user video stream provided by the video distribution server;

sending, from the streamer device to the remote provider server, the video consumption data associated with the composite user video, data associated with the first image of the object, and data associated with the second image of the object.

2. The method of claim 1 wherein the first characteristics associated with the object are selected from a first group consisting of: a first marker surface normal, a first marker size, and a first marker distance and a first marker direction; and

wherein the second characteristics are selected from a second group consisting of: a second marker surface normal, a second marker size, and a second marker distance and a second marker direction.

3. The method of claim 2

wherein the first marker surface normal is related to the second marker surface normal in a relationship selected from a third group consisting of: identical and different; and

wherein the first marker size is related to the second marker size in a relationship selected from a third group consisting of: identical and different.

4. The method of claim 2 wherein a size of first image within the first composite image is determined in response to the first marker distance.

5. The method of claim 1 wherein the incoming object data associated with the object is selected from a group consisting of: a three-dimensional model of the object, a two-dimensional image of the object.

6. The method of claim 1 further comprising:

specifying, in the streamer device from the user, data provider preferences for the incoming object data associated with the object; and

sending, from the streamer device to the remote provider server, an indication of the data provider preferences.

7. The method of claim 6 wherein the data provider preferences are selected from a group consisting of: preferred advertisers, preferred advertising criteria, prohibited advertisers, and prohibited advertising criteria.

8. The method of claim 1

wherein the first image is associated with a first camera at a first position relative to the user;

wherein the second image is associated with a second camera at a second position relative to the user; and

wherein the first position and the second position are different.

9. The method of claim 8 wherein the first image of the object and the second image of the object are different.

10. The method of claim 1

wherein the first image is associated with a first virtual camera within an environment;

wherein the virtual environment is selected from a group consisting of: a virtual environment, a game environment, and a social network.

11. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device, the one or more programs including instructions for:

capturing a user video stream from a user comprising at least a first image and a second image;

for determining a first image of a marker in the first image, wherein the marker is located at a first marker location in the first image;

for determining a second image of the marker in the second image, wherein the marker is located at a second marker location in the second image;

for receiving from a remote provider server, incoming object data associated with an object;

for determining first characteristics associated with the object in response to the first image of the marker and the incoming object data;

for determining second characteristics associated with the object in response to the second image of the marker and the incoming object data;

for rendering a first image of the object in response to the first characteristics associated with the object and the incoming data associated with the object;

for rendering a second image of the object in response to the second characteristics associated with the object and the incoming data associated with the object;

for forming a composite user video stream comprising a first composite image and a second composite image, wherein the first composite image is determined in response to the first image and the first image of the object, and wherein the second composite image is determined in response to the second image and the second image of the object;

for sending a video distribution server, the composite user video stream;

for receiving from the video distribution server, video consumption data associated with the composite user video stream provided by the video distribution server; and

for sending to the remote provider server, the video consumption data associated with the composite user video, data associated with the first image of the object and data associated with the second image of the object.

12. The non-transitory computer-readable storage medium of claim 11

wherein the first characteristics associated with the object are selected from a first group consisting of: a first marker surface normal, a first marker size, a first marker distance and a first marker direction; and

wherein the second characteristics are selected from a second group consisting of: a second marker surface normal, a second marker size, a second marker distance and a second marker direction.

13. The non-transitory computer-readable storage medium of claim 12

wherein the first marker surface normal is related to the second marker surface normal in a relationship selected from a third group consisting of: identical and different; and

wherein the first marker size is related to the second marker size in a relationship selected from a third group consisting of: identical and different.

14. The non-transitory computer-readable storage medium of claim 12 wherein a size of first image within the first composite image is determined in response to the first marker distance.

15. The non-transitory computer-readable storage medium of claim 11 wherein the incoming object data associated with the object is selected from a group consisting of: a three-dimensional model of the object, and a two-dimensional image of the object.

16. The non-transitory computer-readable storage medium of claim 11 wherein the one or more programs including instructions for:

specifying from the user, data provider preferences for the incoming object data associated with the object; and

sending to the remote provider server, an indication of the data provider preferences; and

wherein the data provider preferences are selected from a group consisting of: preferred advertisers, preferred advertising criteria, prohibited advertisers, and prohibited advertising criteria.

17. The non-transitory computer-readable storage medium of claim 11

wherein the first image is associated with a first camera at a first position relative to the user;

wherein the second image is associated with a second camera at a second position relative to the user; and

wherein the first position and the second position are different.

18. The non-transitory computer-readable storage medium of claim 11

wherein the first image is associated with a camera selected from a group consisting of: a live video camera, a virtual camera, a virtual camera within a software application, a virtual camera within a game, and a virtual environment associated with a social network.

19. An apparatus comprises:

a video input portion, configured to provide a user video stream from a user comprising a plurality of images;

a processor coupled to the video input portion, wherein the processor is configured to capture capturing a user video stream from a user comprising at least a first image and a second image, wherein the processor is configured to determine a first image of a marker in the first image, wherein the marker is located at a first marker location in the first image, wherein the processor is configured to determine a second image of the marker in the second image, wherein the marker is located at a second marker location in the second image, wherein the processor is configured to receive from a remote provider server, incoming object data associated with an object, wherein the processor is configured to determine first characteristics associated with the object in response to the first image of the marker and the incoming object data, wherein the processor is configured to determine second characteristics associated with the object in response to the second image of the marker and the incoming object data, wherein the processor is configured to render a first image of the object in response to the first characteristics associated with the object and the incoming data associated with the object, wherein the processor is configured to render a second image of the object in response to the second characteristics associated with the object and the incoming data associated with the object, wherein the processor is configured to form a composite user video stream comprising a first composite image and a second composite image, wherein the first composite image is determined in response to the first image and the first image of the object, and wherein the second composite image is determined in response to the second image and the second image of the object, wherein the processor is configured to send a video distribution server, the composite user video stream, wherein the processor is configured to receive from the video distribution server, video consumption data associated with the composite user video stream provided by the video distribution server, and wherein the processor is configured to send to the remote provider server, the video consumption data associated with the composite user video, data associated with the first image of the object and data associated with the second image of the object.

20. The apparatus of claim 18

wherein the first characteristics associated with the object are selected from a first group consisting of: a first marker surface normal, a first marker size, and a first marker distance and a first marker direction;

wherein the second characteristics are selected from a second group consisting of: a second marker surface normal, a second marker size, and a second marker distance and a second marker direction; and

wherein the incoming object data associated with the object is selected from a third group consisting of: a three-dimensional model of the object, and a two-dimensional image of the object.

Assignments (3)

Continuity (2)

References Cited (9)