Documentation

How to Run an Experiment on a Dynamic Page Variant

Superfunnel allows you to run experiments (A/B tests) on Dynamic Page variants to optimize performance and improve results.

You can test:

• Headlines
• Layout changes
• Messaging
• Offers
• CTAs
• Entire page designs


Step 1: Open Your Dynamic Page

  1. Go to Dynamic Pages from the left sidebar

  2. Click the page where you want to run an experiment

Scroll to the Variants section.


Step 2: Click “Experiment” on a Variant

In the Variants table:

  1. Locate the variant you want to test

  2. Click Experiment

The Start Experiment modal will open.


Experiment Setup Parameters

Below is a breakdown of each setting inside the experiment modal.


1. Experiment Name

Give your experiment a clear name.

Example:
• Main Experiment
• Headline Test – Urgency
• Mobile CTA Optimization

This helps you track and compare experiments later.


2. Primary Metric (Required)

This defines what the experiment is optimizing for.

Available options:

• Conversion Rate
• Conversions
• Button Clicks
• Form Submissions

Choose the metric that best reflects your goal.

Example:
• Choose Conversion Rate to maximize efficiency
• Choose Conversions to maximize total volume


3. Secondary Metrics (Optional)

You can track additional metrics alongside your primary goal.

This helps you monitor trade-offs or additional behavior signals.


4. Experiment Variations

You must add at least one variation to test against the original.

The interface shows:

• Original (Control)
• Variation A
• Traffic allocation percentage

You can:

• Add multiple variations
• Adjust traffic split
• Describe what the variation is testing

Traffic distribution must equal 100%.


5. Completion Criteria (Required)

This determines when the experiment ends.

There are four available options:


The experiment ends when a winner is determined with 95% confidence.

Additional parameters:

• Minimum Visitors per Variant
• Minimum Duration (days)

Best for:
• Performance optimization
• Reliable decision-making


B) Fixed Duration

End the experiment after a specified number of days.

You define:
• Duration (in days)

Best for:
• Time-based campaigns
• Promotional tests


C) Visitor Count

End the experiment after reaching a target number of visitors.

You define:
• Target Visitors

Best for:
• Traffic-based testing
• Controlling sample size


D) Manual

The experiment runs until you manually stop it.

Best for:
• Open-ended testing
• Continuous optimization


Step 6: Start the Experiment

After configuring:

  1. Review traffic distribution

  2. Confirm completion criteria

  3. Click Start Experiment

Superfunnel will automatically split traffic according to your configuration.


How Experiment Traffic Works

• Traffic is distributed according to your defined percentages
• The original variant acts as the control
• Variations compete against the control
• Performance is tracked based on the selected primary metric


Best Practices for Experiments

• Test one major change at a time
• Use Statistical Significance when possible
• Ensure enough traffic per variant
• Avoid stopping experiments too early
• Clearly document what each variation is testing