PressPlay's experiment backlog is your queue management system for A/B tests. It determines which experiments run when, based on priorities you set, and ensures only one experiment runs at a time per app to maintain statistical integrity.
The backlog operates on a simple principle: experiments with higher priority values run first. When an experiment completes, the system automatically starts the next highest-priority experiment that's ready to run.
Experiments are assigned numeric priority values, where higher numbers indicate higher priority. For example, an experiment with priority 10 will run before one with priority 5. This system gives you complete control over test sequencing.
Key rules:
Only one experiment runs at a time per app
Higher priority numbers execute first
Experiments must be in READY status to enter the active queue
Priority can be changed anytime before an experiment starts
Understanding how experiments move through the backlog helps you manage your testing queue effectively:
Experiments in NOT_READY or ERROR status are not eligible for the backlog. They won't execute until you resolve issues and change their status to READY.
READY experiments wait in the queue based on their priority. You can see your queue position and adjust priorities as needed before experiments start.
The highest-priority READY experiment automatically transitions to IN_PROGRESS when execution begins. During this time, other experiments remain queued.
When an experiment reaches FINISHED or STOPPING status, it exits the backlog, and the next experiment in the queue begins automatically.
Navigate to your app's experiment list to see all queued experiments. The interface displays:
Current priority ranking
Experiment status
Estimated queue position
Next scheduled experiment
Effective backlog management ensures your most important tests run first:
Strategic Prioritization: Assign priorities based on business impact, urgency, and dependencies between experiments
Buffer Management: Leave gaps between priority numbers (e.g., use 10, 20, 30) so you can easily insert urgent experiments later
Regular Reviews: Periodically review your queue as business priorities change
Dependency Planning: Sequence experiments that build on each other's findings
PressPlay automatically manages the backlog without manual intervention:
When the currently running experiment completes, the system immediately identifies the next highest-priority READY experiment and starts it. No manual action required.
Receive alerts when:
An experiment starts running
An experiment completes
Queue position changes significantly
Issues prevent automatic execution
Create and configure multiple experiments in advance. Set appropriate priorities so tests execute in the optimal sequence without gaps between experiments.
Regularly check that upcoming experiments are properly configured and READY status. This prevents execution delays when the current test completes.
Establish priority ranges for different test types:
Critical/urgent tests: 90-100
High-priority optimization: 70-89
Standard testing: 50-69
Low-priority experiments: 1-49
Maintain notes about why experiments have specific priorities. This helps team members understand the testing sequence and make informed priority adjustments.
Need to run an urgent test? Give it a priority higher than your current highest-priority queued experiment. It will run next after the current experiment completes.
To postpone an experiment without removing it from the backlog, simply lower its priority below other queued experiments.
To temporarily stop automatic execution, set all READY experiments to NOT_READY status. No new experiments will start automatically until you restore READY status.
Experiment Priority System - Detailed guide to setting and managing priorities
Experiment Status Lifecycle - Understanding experiment states and transitions
Experiment Duration - Planning optimal test lengths for your queue
