IP Library Granted Patent US 12,111,907
Granted Patent B2
US 12,111,907 · App. 17/942,304 · Granted Oct 8, 2024

Analytic image format for visual computing

Inventors: Christina R. Strong (Hillsboro, OR); Vishakha Gupta (Seattle, WA); Luis Carlos Maria Remis (Hillsboro, OR); Kushal Datta (Hillsboro, OR); Arun Raghunath (Portland, OR)
Assignees: HYUNDAI MOTOR COMPANY; KIA CORPORATION
G06F21/44G06F9/4881G06F9/5044G06F9/5066G06F9/5072G06F16/535G06F16/538G06F16/54G06F16/951G06F18/21G06F18/211G06F18/213G06F18/2163G06F18/22G06F18/24G06F18/24143G06F21/45G06F21/53G06F21/6254G06F21/64G06K15/1886G06N3/04G06N3/045G06N3/063G06N3/08G06N5/022G06T7/11G06T7/70G06V10/20G06V10/40G06V10/454G06V10/75G06V10/82G06V10/95G06V10/96G06V20/00G06V30/19173G06V30/274G06V40/161G06V40/20H04L9/0643H04L9/3239H04L67/12H04L67/51H04N19/46H04N19/80H04W4/70G06F18/24323G06F2209/503G06F2209/506G06F2221/2117G06T7/20G06T7/223G06T2207/10016G06T2207/20021G06T2207/20024G06T2207/20052G06T2207/20056G06T2207/20064G06T2207/20084G06T2207/20221G06T2207/30242G06V30/194G06V2201/10H04L9/50H04L67/10H04N19/12H04N19/124H04N19/167H04N19/172H04N19/176H04N19/42H04N19/44H04N19/48H04N19/513H04N19/625H04N19/63H04W12/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,111,907
App. No.
17/942,304
Granted
Oct 8, 2024
Kind
B2
Abstract

In one embodiment, an apparatus comprises a storage device and a processor. The storage device stores a plurality of images captured by a camera. The processor: accesses visual data associated with an image captured by the camera; determines a tile size parameter for partitioning the visual data into a plurality of tiles; partitions the visual data into the plurality of tiles based on the tile size parameter, wherein the plurality of tiles corresponds to a plurality of regions within the image; compresses the plurality of tiles into a plurality of compressed tiles, wherein each tile is compressed independently; generates a tile-based representation of the image, wherein the tile-based representation comprises an array of the plurality of compressed tiles; and stores the tile-based representation of the image on the storage device.

Claims (59)

1. An electronic device, comprising:

a storage medium; and

processing circuitry to:

receive, via an image storage application programming interface (API), a request to store an image in a compressed tile format;

evaluate a performance of a plurality of compressed tile formats for at least a portion of the image, wherein the plurality of compressed tile formats use different tile sizes;

select, based on the performance of the plurality of compressed tile formats, a tile size for partitioning the image into a plurality of tiles;

partition the image into the plurality of tiles, wherein the plurality of tiles comprise non-overlapping contiguous portions of the image;

compress the plurality of tiles into a plurality of compressed tiles, wherein individual tiles are independently compressed; and

store the image in the compressed tile format on the storage medium, wherein the compressed tile format comprises the plurality of compressed tiles, and wherein the compressed tile format is organized such that the compressed tiles can be independently retrieved for specified regions of the image.

2. The electronic device of claim 1 , wherein the compressed tile format further comprises metadata indicating:

a tile size for the plurality of tiles; and

a compression type for the plurality of compressed tiles.

3. The electronic device of claim 2 , wherein:

the tile size is fixed across the plurality of tiles; or

the tile size varies across the plurality of tiles.

4. The electronic device of claim 2 , wherein:

the compression type is fixed across the plurality of compressed tiles; or

the compression type varies across the plurality of compressed tiles.

5. The electronic device of claim 2 , wherein the compressed tile format further comprises an array data structure to store the plurality of compressed tiles, wherein the array data structure is organized based on spatial positions of the plurality of compressed tiles within the image.

6. The electronic device of claim 5 , wherein the array data structure is stored in an array database on the storage medium.

7. The electronic device of claim 5 , wherein the metadata further indicates an order in which the plurality of compressed tiles are arranged in the array data structure.

8. The electronic device of claim 2 , wherein the metadata further indicates a spatial position of a region of interest within the image.

9. The electronic device of claim 1 , wherein the processing circuitry to partition the image into the plurality of tiles is further to:

determine, based on one or more regions of interest within the image, varying tile sizes for partitioning the image into the plurality of tiles.

10. At least one non-transitory machine-accessible storage medium having instructions stored thereon, wherein the instructions, when executed on processing circuitry, cause the processing circuitry to:

receive, via an image storage application programming interface (API), a request to store an image in a compressed tile format;

evaluate a performance of a plurality of compressed tile formats for at least a portion of the image, wherein the plurality of compressed tile formats use different tile sizes; and

select, based on the performance of the plurality of compressed tile formats, a tile size for partitioning the image into a plurality of tiles;

partition the image into the plurality of tiles, wherein the plurality of tiles comprise non-overlapping contiguous portions of the image;

compress the plurality of tiles into a plurality of compressed tiles, wherein individual tiles are independently compressed; and

store the image in the compressed tile format on a storage device, wherein the compressed tile format comprises the plurality of compressed tiles, and wherein the compressed tile format is organized such that the compressed tiles can be independently retrieved for specified regions of the image.

11. The storage medium of claim 10 , wherein the compressed tile format further comprises metadata indicating:

a tile size for the plurality of tiles; and

a compression type for the plurality of compressed tiles.

12. The storage medium of claim 11 , wherein:

the tile size is fixed across the plurality of tiles; or

the tile size varies across the plurality of tiles.

13. The storage medium of claim 11 , wherein:

the compression type is fixed across the plurality of compressed tiles; or

the compression type varies across the plurality of compressed tiles.

14. The storage medium of claim 11 , wherein the compression type comprises LZ4 compression for at least some of the plurality of compressed tiles.

15. The storage medium of claim 11 , wherein the compressed tile format further comprises an array data structure to store the plurality of compressed tiles, wherein the array data structure is organized based on spatial positions of the plurality of compressed tiles within the image.

16. The storage medium of claim 15 , wherein the array data structure is stored in an array database on the storage device.

17. The storage medium of claim 15 , wherein the metadata further indicates an order in which the plurality of compressed tiles are arranged in the array data structure.

18. The storage medium of claim 11 , wherein the metadata further indicates a spatial position of a region of interest within the image.

19. The storage medium of claim 10 , wherein the instructions that cause the processing circuitry to partition the image into the plurality of tiles further cause the processing circuitry to:

determine, based on one or more regions of interest within the image, varying tile sizes for partitioning the image into the plurality of tiles.

20. A method, comprising:

receiving, via an image storage application programming interface (API), a request to store an image in a compressed tile format;

evaluating a performance of a plurality of compressed tile formats for at least a portion of the image, wherein the plurality of compressed tile formats use different tile sizes; and

selecting, based on the performance of the plurality of compressed tile formats, a tile size for partitioning the image into a plurality of tiles;

partitioning the image into the plurality of tiles, wherein the plurality of tiles comprise non-overlapping contiguous portions of the image;

compressing the plurality of tiles into a plurality of compressed tiles, wherein individual tiles are independently compressed; and

storing the image in the compressed tile format on a storage device, wherein the compressed tile format comprises the plurality of compressed tiles, and wherein the compressed tile format is organized such that the compressed tiles can be independently retrieved for specified regions of the image.

21. The method of claim 20 , wherein the compressed tile format further comprises metadata indicating:

a tile size for the plurality of tiles; and

a compression type for the plurality of compressed tiles.

22. The method of claim 20 , wherein partitioning the image into the plurality of tiles comprises:

determining, based on one or more regions of interest within the image, varying tile sizes for partitioning the image into the plurality of tiles.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: INTEL CORPORATION
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 067737/0094 →
Continuity (6)
Continuation 17374217 · Jul 13, 2021
Continuation 16142468 · Sep 26, 2018
Continuation In Part PCTUS2018040390 · Jun 29, 2018
Provisional Application 62691464 · Jun 28, 2018
Provisional Application 62611536 · Dec 28, 2017
Related Publication 20230114468A1 · Apr 13, 2023
Cited By (2)
US 12,541,959 US 12,693,412