TRIAL DESIGN WITH PARETO TECHNIQUES

1 - 475 . (canceled)

476 . A method comprising:

obtaining trial design simulation results for a set of trial designs;

determining a score for each trial design based on a performance criteria;

evaluating Pareto optimality for each design in the set of trial designs to determine a Pareto frontier;

filtering designs that are not on the Pareto frontier; and

communicating the Pareto frontier designs.

477 . The method of claim 476 further comprising:

recommending designs within epsilon-distance from the Pareto frontier.

478 . The method of claim 476 further comprising:

identifying separations in the Pareto frontier and performing simulated annealing based on the separations.

479 . The method of claim 476 further comprising:

identifying different design types on the Pareto frontier and recommending different design types.

480 . The method of claim 476 further comprising:

identifying a second level Pareto frontier.

481 . The method of claim 477 further comprising:

receiving feedback for recommended designs and determining epsilon values for additional recommendations.

482 . The method of claim 476 further comprising:

clustering designs dominated by designs in the Pareto frontier.

483 . The method of claim 476 further comprising:

clustering designs that are within a margin of error.

484 . The method of claim 476 further comprising:

updating the Pareto designs in response to at least one of addition or subtraction of designs from the set of trial designs.

485 . The method of claim 476 , further comprising:

updating the Pareto designs in response to an update of scenario probabilities.

486 . The method of claim 476 , further comprising:

evaluating historical trial design selections to identify one or more trial design parameters based at least in part on one or more trial design criteria determined from a user via an interactive interface, wherein obtaining the trial design simulation results is based at least in part on a quick search data structure and the one or more trial design parameters;

generating a substitute for at least some of the trial design simulation results based at least in part on a relationship between the trial design simulation results and supplemental data;

generating a performance surface based at least in part on the set of trial designs;

evaluating one or more trial designs based at least in part on the performance surface; and

calculating a score based on normalized score component values corresponding to the design simulation results.

487 . An apparatus comprising:

a data processing circuit configured to obtain design data for a set of trial designs;

an optimality determining circuit configured to determine optimum designs using Pareto analysis from the set of trial designs; and

a design analysis circuit configured to analyze the Pareto designs and determine a modification to the Pareto analysis;

wherein the optimality determining circuit received the modification and determines a second set of optimum designs.

488 . The apparatus of claim 487 , wherein the set of trial designs includes all design options for a set of criteria.

489 . The apparatus of claim 487 , wherein the optimality determining circuit modifies the Pareto analysis to determine designs within epsilon-distance of Pareto designs.

490 . The apparatus of claim 487 , wherein the optimality determining circuit modifies the Pareto analysis to determine designs dominated by the Pareto designs.

491 . The apparatus of claim 487 , wherein the optimality determining circuit modifies the Pareto analysis to determine designs clustered by the Pareto designs.

492 . The apparatus of claim 487 , wherein the optimality determining circuit modifies the Pareto analysis to determine twins of the Pareto designs.

493 . The apparatus of claim 487 , wherein the optimality determining circuit modifies the Pareto analysis to determine siblings of the Pareto designs.

494 . The apparatus of claim 487 , wherein the optimality determining circuit modifies the Pareto analysis to determine second level Pareto designs.

495 . A system comprising:

an electronic device having an electronic display; and

a server in electronic communication with the electronic device and having at least one processor structured to:

obtain trial design simulation results for a set of trial designs;

determine a score for each trial design based on a performance criteria;

evaluate Pareto optimality for each design in the set of trial designs to determine a Pareto frontier;

filter designs that are not on the Pareto frontier; and

transmit the Pareto frontier designs to the electronic device;

wherein the electronic device displays the Pareto frontier on the electronic display.

496 - 696 . (canceled)