IP Library Granted Patent US 10,699,150
Granted Patent B2
US 10,699,150 · App. 16/168,735 · Granted Jun 30, 2020

Machine guided photo and video composition

Inventors: Borui Wang (San Jose, CA); Zhen Hua Yan (San Jose, CA)
Assignee: Polarr, Inc.
G06K9/3241G06K9/00369G06N3/08G06N20/00G06T7/60G06T2207/20132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,699,150
App. No.
16/168,735
Granted
Jun 30, 2020
Kind
B2
Abstract

A process for operating a machine guided photo and video composition system involves generating processed image data. The process operates an object detection engine to identify objects and object locations in the processed image data. The process operates a computer vision analysis engine to identify geometric attributes of objects. The process operates an image cropping engine to select potential cropped image locations within the processed image data. The image cropping engine generates crop location scores for each of the potential cropped image locations and determine highest scored cropped image location. The image cropping engine communicates a highest crop location score to a score evaluator gate. The process generates object classifications from the object locations and the geometric attributes. The process receives device instructions at a user interface controller by way of the score evaluator gate. The method displays device positioning instructions through a display device.

Claims (26)

1. A method comprising:

generating processed image data with reduced pixel channel values from a raw image data through operation of an image processor;

operating an object detection engine to identify objects and object locations in the processed image data through use of an object detection algorithm;

operating a computer vision analysis engine to identify geometric attributes of objects in the processed image data through use of a line geometry analysis algorithm;

operating an image cropping engine to:

select potential cropped image locations within the processed image data through operation of a selector;

generate crop location scores for each of the potential cropped image locations and determine highest scored cropped image location through operating of a cropped image evaluator; and

communicate highest crop location score for the highest scored cropped image location to a score evaluator gate;

generating object classifications from the object locations and the geometric attributes through operation of an object classifier;

receiving device instructions at a user interface controller by way of the score evaluator gate; and

configuring a display device to display device positioning instructions transformed from the received device instructions.

2. The method of claim 1 comprising:

receiving the object locations and the geometric attributes at a switch configured by an avoid object amputation control to release the object locations and the geometric attributes to the image cropping engine, wherein the object locations and the geometric attributes identify the object locations as bounding boxes around the objects; and

operating the image cropping engine to:

select the potential cropped image locations within the processed image data from the object locations and the geometric attributes through operating of a selector, wherein the selector excludes the potential cropped image locations with partial bounding boxes around the objects.

3. The method of claim 1 , wherein the object detection algorithm utilizes a convolutional neural network machine learning algorithm to identify the objects and the object locations in the processed image data.

4. The method of claim 1 , wherein the cropped image evaluator utilizes a convolutional neural network machine learning algorithm to determine the highest scored cropped image location.

5. The method of claim 1 further comprising:

releasing a control from the score evaluator gate to a crop coordinate mapper in response to the highest crop location score being greater than a crop score threshold;

generating the device instructions comprising device zoom, focus, and rotation instructions from the crop coordinate mapper in response to receiving the control from the score evaluator gate; and

communicating the device instructions to the user interface controller from the crop coordinate mapper.

6. The method of claim 1 further comprising:

releasing a control from the score evaluator gate to an object based compute engine in response to the highest crop location score being lower than a crop score threshold;

generating the device instructions comprising device focus and rotation instructions from the object locations, the geometric attributes, and the object classifications through operation of the object based compute engine in response to receiving the control from the score evaluator gate; and

communicating the device instructions to the user interface controller from the object based compute engine.

7. The method of claim 1 , wherein the user interface controller generates revised device positioning instructions in response to a device position information from the display device.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded May 19, 2025
From: POLARR INC.
To: PIXIESET MEDIA INC.
Reel/Frame 071153/0906 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2019
From: WANG, BORUI; YAN, ZHEN HUA
To: POLARR INC
Reel/Frame 048799/0198 →
Continuity (1)
Related Publication 20200125880A1 · Apr 23, 2020