IP Library › Patent Application 18129766
Patent Application
App. No. 18/129,766

TRAVELING IN TIME AND SPACE CONTINUUM

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/129,766
Abstract

Generally described, one or more aspects of the present application relate to capturing and generating viewpoints of any given space. Pixel averaging and camera configurations, including microlens cameras, may be implemented to generate and capture viewpoints of any given space.

Claims (58)

1 . A system for remote viewing, the system comprising:

memory configured to store computer-executable instructions; and

a hardware processor in communication with the memory, wherein the computer-executable instructions, when executed by the hardware processor, cause the hardware processor to:

obtain a sequence of images of a location, wherein the sequence of images is captured by at least one of a plurality of cameras positioned at one or more positions in the location;

generate a virtual space, wherein the virtual space is a virtual representation of the location;

determine at least one of a position, a direction of travel, or a speed of travel of a remote user within the virtual representation of the location based on one or more measurements obtained from a sensory input;

select a subset of cameras from the plurality of cameras positioned at one or more positions in the location based on at least one of the position, the direction of travel, or the speed of travel of the user within the virtual representation of the location; and

cause a user device to display one or more images in the sequence of images captured by the subset of cameras in an order based on the position, the direction of travel, and the speed of travel of the user within the virtual representation of the location.

2 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the hardware processor to:

obtain an indication of an object to track and a first image in the sequence of images captured by a first camera in the subset of cameras and displayed by the user device;

apply image processing to the first image to identify a characteristic of the object;

apply image processing to images in the sequence of images other than the first image to identify a second image in the sequence of images that depicts the object with the characteristic; and

cause the user device to display the second image following the first image.

3 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the hardware processor to apply the first image as an input to a trained object detection artificial intelligence model, wherein application of the first image as the input to the trained object detection artificial intelligence model causes the trained object detection artificial intelligence model to output an indication that the object with the characteristic is depicted in the first image.

4 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the hardware processor to:

determine a location of a first camera in the subset of cameras that captured a first image in the sequence of images that is displayed by the user device;

determine a distance from the first camera based on at least one of the direction of travel of the user or the speed of travel of the user;

determine that a second camera in the subset of cameras is located at a distance from the location of the first camera that matches the determined distance; and

cause the user device to display a second image in the sequence of images captured by the second camera subsequent to the user device displaying the first image.

5 . The system of claim 1 , wherein the sensory input comprises one of a touch input, a haptic input, a gesture input, a wearable input, or a voice input provided to the user device.

6 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the hardware processor to determine at least one of an updated position, an updated direction of travel, or an updated speed of a travel of the user within the virtual representation of the location based on one or more second measurements obtained from the sensory input and generated subsequent to the one or more measurements.

7 . A non-transitory, computer-readable medium storing computer-executable instructions for remote viewing, wherein the computer-executable instructions, when executed, cause a computing system to:

obtain a sequence of images of a location, wherein the sequence of images is captured by at least one of a plurality of cameras positioned at one or more positions in the location;

generate a virtual space, wherein the virtual space is a virtual representation of the location;

determine at least one of a position, a direction of travel, or a speed of travel of a remote user within the virtual representation of the location based on one or more measurements obtained from a sensory input;

select a subset of cameras from the plurality of cameras positioned at one or more positions in the location based on at least one of the position, the direction of travel, or the speed of travel of the user within the virtual representation of the location; and

cause a user device to display one or more images in the sequence of images captured by the subset of cameras in an order based on the position, the direction of travel, and the speed of travel of the user within the virtual representation of the location.

8 . The non-transitory, computer-readable medium of claim 7 , wherein the computer-executable instructions, when executed, further cause the computing system to:

obtain an indication of an object to track and a first image in the sequence of images captured by a first camera in the subset of cameras and displayed by the user device;

apply image processing to the first image to identify a characteristic of the object;

apply image processing to images in the sequence of images other than the first image to identify a second image in the sequence of images that depicts the object with the characteristic; and

cause the user device to display the second image following the first image.

9 . The non-transitory, computer-readable medium of claim 7 , wherein the computer-executable instructions, when executed, further cause the computing system to:

determine a location of a first camera in the subset of cameras that captured a first image in the sequence of images that is displayed by the user device;

determine a distance from the first camera based on at least one of the direction of travel of the user or the speed of travel of the user;

determine that a second camera in the subset of cameras is located at a distance from the location of the first camera that matches the determined distance; and

cause the user device to display a second image in the sequence of images captured by the second camera subsequent to the user device displaying the first image.

10 . A system for capturing a scene, the system comprising:

a plurality of cameras, wherein each camera in the plurality of cameras is distributed throughout a location, wherein each camera in the plurality of cameras is configured to capture an image at a predetermined frame per second value; and

a image processing system comprising a hardware processor and in networked communication with the plurality of cameras, the image processing system configured with computer-executable instructions that, when executed by the hardware processor, cause the image processing system to integrate output from the plurality of cameras with a perspective view of a virtual representation of the location.

11 . The system of claim 10 , wherein the plurality of cameras is evenly spaced throughout the location.

12 . The system of claim 10 , wherein the plurality of cameras is irregularly spaced throughout the location.

13 . The system of claim 10 , wherein the computer-executable instructions, when executed, further cause the image processing system to:

select a subset of cameras from the plurality of cameras; and

integrate output from the subset of cameras with the perspective view of the virtual representation of the location.

14 . The system of claim 10 , wherein the location comprises one of an event hall, an aquarium, a mall, a grocery store, a grocery aisle, a concert hall, an outdoor space, a park, or a conference room

15 . The system of claim 10 , wherein the plurality of cameras comprises a microlens camera.

16 . The system of claim 15 , wherein the microlens camera comprises a plurality of lenses coupled together to form one of a sphere, a cylinder, a three dimensional elliptical, or a cone.

17 . A computer-implemented method of interacting with a virtual representation of a space, the computer-implemented method comprising:

receiving a first set of user inputs, the first set of user inputs indicating a first point of view (POV) request;

generating a first POV based on the first POV request, wherein the first POV is a virtual representation of a scene from a first angle, wherein the virtual representation of the scene comprises one or more images captured by a plurality of imaging devices at a time at which the first POV request is received;

receiving a second set of user inputs, the second set of user inputs indicating a second POV request; and

generating a second POV based on the second POV request, wherein the second POV is an updated version of the virtual representation of the scene from a second angle, wherein the updated version of the virtual representation of the scene comprises one or more second images captured by the plurality of imaging devices at a second time at which the second POV request is received.

18 . The computer-implemented method of claim 17 , wherein the first set of user inputs comprises an indication of a time scale.

19 . The computer-implemented method of claim 17 , wherein the first set of user inputs comprises an indication of a direction and a speed at which to move within the virtual representation of the scene.

20 . The computer-implemented method of claim 17 , wherein the plurality of imaging devices comprises a microlens camera.

21 . The computer-implemented method of claim 20 , wherein the microlens camera comprises a plurality of lenses coupled together to form one of a sphere, a cylinder, a three dimensional ellipse, or a cone.

22 . The computer-implemented method of claim 17 , wherein the first set of user inputs comprises an indication of a first direction at which to move within the virtual representation of the scene, wherein the one or more images depict a portion of the scene in a direction of the first direction, wherein the second set of user inputs comprises an indication of a second direction at which to move within the virtual representation of the scene, and wherein the one or more second images depict a portion of the scene in a direction of the second direction.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2023
From: GENOME INTERNATIONAL CORPORATION
To: SENAPATHY, PERIANNAN
Reel/Frame 064488/0351 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2023
From: SENAPATHY, PERIANNAN
To: GENOME INTERNATIONAL CORPORATION
Reel/Frame 064345/0412 →