Product Experimentation Lead
Betsson Group is looking for a Product Experimentation Lead to operationalize, scale, and champion our experimentation program across our global portfolio of digital products. This role is central to ensuring that every customer-facing decision is backed by evidence, rigor, and user insight.
Sitting at the intersection of product, analytics, UX, and engineering, you will drive evidence-based decision-making through robust A/B testing and live validation frameworks. You’ll execute and interpret high-quality experiments to evangelize a test-and-learn culture and scale the infrastructure that supports it. This includes instilling best practices, improving tools, and ensuring we learn the right things—not just run the right tests.
A taster of what you will be involved with:
Experimentation Platform & Governance:
- Own and optimize the use of experimentation tools (e.g., Optimizely), ensuring robust configuration, scalability, and cost efficiency
- Develop best practices, playbooks, and governance models to ensure statistical rigor and test hygiene across all markets and brands
- Establish guardrails to prevent test collisions and misleading results
- Ensure test documentation is consistently captured, tagged, and archived for future reference. Help build and maintain a repository that connects experiments to broader user insights, product decisions, and research learnings
- Support the development of a cross-functional knowledge system to prevent redundant testing, track learnings over time, and accelerate future decision-making
Strategy & Roadmap:
- Develop and maintain a strategic experimentation roadmap aligned with product priorities and market goals
- Partner closely with Analytics and UX Research (UXR) teams to track research insights and ensure continuity from discovery to validation
- Prioritize initiatives based on user needs, business impact, and technical feasibility
- Account for seasonality, test interdependence, and long-term effects on user behavior in planning
Test Design & Execution:
- Collaborate with PMs, researchers, and analysts to define hypotheses, test structure, and success metrics
- Guide test design including traffic allocation, sample sizing, segmentation, and statistical methods
- Manage test execution end-to-end and ensure robust post-test analysis
- Ensure tests are designed to capture both short-term effects and longitudinal impacts (e.g., retention, engagement)
- Pre-test analysis using GA or similar tools, to identify experiment parameters
- Manage or preferably execute robust post-test analysis ensuring all relevant data sources are used to ‘paint the full picture’ and insights/recommendations are clear
- Proactively develops the applicable experiments to run during low-request periods. Identify opportunities for improvements
What we are looking for:
- 5+ years of relevant experience in product experimentation, CRO, product analytics, or related role
- Hands-on experience running and scaling A/B and multivariate tests across high-traffic digital products
- Expertise with testing platforms (e.g., Optimizely, AB Tasty, VWO) and analytics tools (GA, Amplitude, Adobe Analytics, ContentSquare)
- Strong statistical acumen: understanding of test design, power analysis, segmentation, and validity
- Experience working cross-functionally with product, analytics, research, design, and engineering teams
- Clear communicator able to translate test results into actionable insights and strategic recommendations
- Experience in Data Visualization (through Google Looker Studio, Power BI, Tableau or similar)
- Experience using Business Intelligence and Operational Intelligence tools
Much like a rollercoaster, life at Betsson Group is fast-paced, full of twists and turns, and always exciting. With more than 2,800 colleagues representing over 75 nationalities across a global network of offices - including 1,500 at our operational headquarters in Malta - every day brings new challenges and opportunities to grow. It may not be for the faint-hearted, but if you thrive on innovation, enjoy pushing boundaries and want to be part of a diverse, international team, then you’ll fit right in at Betsson.
Challenge accepted?By submitting your application, you understand that your personal data will be processed as set out in our Privacy Policy