Setting Up A Bid Experiment

Select the lead type that you would like to run a bid experiment on.

Select the Source value that you would like to run a bid experiment on. Your experiment will only apply to pings with this SRC value. You can add additional ping criteria in the next step.

Each Source value can only be utilized in one active experiment at a time. If you don't see the SRC that you would like to use, that means it is already being used in an active experiment.

This step allows you to set additional criteria for pings that qualify for this bid experiment. Any pings (even those with the SRC selected in step 2) that do not meet all of the criteria set in this step will not qualify for this bid experiment.

This option specifies whether your bid experiment will be testing a positive or negative change in your current margin settings or current price set for qualifying pings for the SRC you selected in Step 2.

This option should be chosen by those who buy and sell leads and create a profit from the margin realized by the difference of the lead cost and the sale price. With this option, the algorithm will test a higher and a lower margin by leaving the final price the same.

This option should be chosen by those who buy leads and would like to optimize the pricing strategy on bidding. With this option, the algorithm will test a higher and a lower bidding price and calculate the buying rate for the current setting and the increased/decreased prices.

The adjustment controls the change in either your margin or price (as selected in the previous step) in relation to the current setting (control group). This adjustment is then used to influence your bid on the ping. When making the adjustment, you can use either an absolute value or a percent value.

The absolute value is an addition or subtraction to the control group bid based on the positive or negative value used. Margin Adjustment Example: If your current margin is $1 and the absolute value adjustment is $2, your new margin will be $3. This will decrease your bid amount. Price Adjustment Example: If the ping's current price is $10 and the absolute value adjustment is -$2, the tested bid price will be $8.

The percent value is an addition or subtraction to the control group bid based on the percentage increase or decrease that you apply. Margin Adjustment Example: If your current margin is $2 and the percent value adjustment is -50%, your new margin will be $1. This will increase your bid amount. Price Adjustment Example: If the ping's current price is $10 and the percent value adjustment is 30%, the tested bid price will be $13.

This setting acts as a bid ceiling for this experiment. After the adjustment is applied to the bid, the system will run the price against the Maximum Best Price. If the maximum best price is exceeded, the Maximum Best Price value will be used. All bids adjusted due to this setting will not be included in the final analysis of this experiment.

This setting acts as a bid floor for this experiment. However, this should only be used in specific cases. Please contact support before using.

Finally, review the details of your experiment. If you'd like to make any changes, navigate using the numerical menu or the Previous Step button.

After saving your campaign, it will be placed in the Draft status. At this point, you can still edit your experiment. Once you are satisfied with your experiment configuration, click the Start Experiment button. Your experiment will then be placed into the Active status and begin running to your specifications. You can pause or stop your experiment at any time.

You can view your experiment settings while active, although they can no longer be adjusted. When your experiment reaches its designated ping total, it will be changed to the Completed status. At this point you can navigate to the experiment dashboard to review the results.

See the following table to see recommendations to reach 90%+ significance level for different adjustments and conversion rates. ProTip: Running experiments for sources with low incoming ping volume can be very slow. To shorten the wait set a higher adjustment value. This will let you use a smaller sample size to reach the required minimum significance level.