We’re looking for a head of Experimentation to lead the Experimentation Science and research teams at Chewy. This leader will employ a right combination of people, processes and platform to build a “Culture of Experimentation”, fundamentally accelerate product development and learning through rapid experimentation and help Chewy build differentiated web and app product experiences for pet parents and partners everywhere. In this high-visibility, high-impact role, you’ll provide structure to this complex space, and identify iterative steps that add new value early and often for experimenters while still heading towards a long-term vision.

This role is inherently cross-functional; you will work closely with product managers, engineering, analytics, project management, design, finance, marketing, and executive teams to identify product insights, develop and grow business opportunities, and enhance our customer experience. As a successful leader, you’ll:

• Build a solid team of data scientist and researchers to scale the experimentation program at Chewy.
• Define experimentation best practices, statistical and scientific methodologies and scalable frameworks for creating, monitoring, and learning from experiments.
• Build close relationships with internal experimentation platform users, understand their preferences and gaps in their experiences and empower them to run rapid, trustworthy online experiments through training, office hours, documentation, and ad-hoc support
• Provide consulting on test design (power analysis), choosing the right metric, defining clear hypothesis and rollout criteria, anomaly detection, and manual test readouts
• Partner with experimentation engineering team for consistent adoption and implementation of SDK, and building out toolkit for developers for consistent activation of experiment across different page and platform owners.
• Ensure quality of data and computation by developing monitoring and alerting mechanisms to catch spillovers and bias and provide guidance on step-wise identification of root-case
• Onboard metrics directly on the platform in order to scale the computation and enable automated readouts. Employ statistical methods and dashboards to reduce false discovery through multiple-comparisons.
• Build out templates and processes for consistent communication & socialization of test results, and scale learnings through a centralized knowledge repo.
• Research and recommend different testing capabilities and causal inference techniques (A/B/n testing, holdback, pre-post, MAB, targeted delivery etc) based on relevant use cases
• Partner with existing experimentation platform provider to prioritize Chewy’s experimentation use cases, and periodically evaluate latest experimentation platforms in the market
• Define methods and metrics for measuring the platform & program's success, and communicate those metrics with senior leadership. Provide visibility and transparency into what experiments are running and what key metrics are being impacted.

Minimum Qualifications:

• Bachelor’s Degree in Physics, Statistics, Mathematics, Data Science, Econometrics, Operations Research, Computer Science, or related field AND 8+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
• OR Master's Degree in Physics, Statistics, Mathematics, Data Science, Econometrics, Operations Research, Computer Science, or related field AND 7+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
• OR Doctorate in Physics, Statistics, Mathematics, Data Science, Econometrics, Operations Research, Computer Science, or related field AND 5+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
• 8+ years experience with relational database and SQL skills with working knowledge of data warehousing concepts, including technical architecture, infrastructure components, ETL/ELT and reporting/analytic tools and environments such as Hadoop, Spark, Pig, Hive, or MapReduce
• Experience with market-leading 3P experimentation platforms like Optimizely, Adobe Target, AB Tasty, Statsig etc or in-house experimentation platform are a plus
• 9+ years of experience in an analytics and/or optimization role with at least 5 years management experience
• Demonstrated ability to solve complex problems, collaborating with cross-functional teams, translating high-level business requirements into technical architecture, developing and executing strategic vision
• Strong leadership skills including growing and mentoring others.

Additional or Preferred Qualifications

• Bachelor's Degree in Physics, Statistics, Mathematics, Data Science, Econometrics, Operations Research, Computer Science, or related field AND 10+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
• OR Master's Degree in Physics, Statistics, Mathematics, Data Science, Econometrics, Operations Research, Computer Science, or related field AND 10+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
• OR Doctorate in Physics, Statistics, Mathematics, Data Science, Econometrics, Operations Research, Computer Science, or related field AND 8+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results)
• Previous experience of applying software development skills to economic-oriented problems, randomized controlled experiments and deploying statistical models.

Chewy is committed to equal opportunity. We value and embrace diversity and inclusion of all Team Members. If you have a disability under the Americans with Disabilities Act or similar law, and you need an accommodation during the application process or to perform these job requirements, or if you need a religious accommodation, please contact CAAR@chewy.com.

If you have a question regarding your application, please contact HR@chewy.com.

To access Chewy's Customer Privacy Policy, please click here. To access Chewy's California CPRA Job Applicant Privacy Policy, please click here.