Share this Job

Marketing Analyst, Test and Learn (Remote)

Date:  Aug 3, 2022

Broomfield, CO, US

Company:  Vail Resorts
Shift Type:  Year Round

As a leading mountain resort operator with over 40 resorts in sixteen states and four countries. We exist to create an Experience of a Lifetime for our employees, so they can, in turn, provide and Experience of a Lifetime for our guests. We are looking for leaders, innovators, creators, and ambitious professionals to join our talented team. If you’re ready to pursue your fullest potential, we want to get to know you!

Many of our Corporate function teams can now live and work in any of the states in which Vail Resorts currently operates* – enabling flexible remote work alongside a commitment to building and maintaining strong culture both in person and virtually. If you’re ready to pursue your fullest potential, we want to get to know you. Find your purpose with us at

Job Specifications: 

  • Housing: Not Available 
  • Outlet: Corporate / Remote
  • Shift & Schedule Availability: Full Time / Year Round
  • The budgeted range starts at $67,000 - $81,150.  Actual pay will be adjusted based on experience.


Job Summary:

The primary purpose of the Testing Analyst position is to provide recommendations for test and personalization improvements, monitor performance of live A|B testing across primary marketing audiences and channels, identify reporting opportunities for test performance reads, and partner with other Analytics and Marketing teams. You will partner with Digital Experience, Media, Relationship Marketing, Analytics, and IT teams to define test hypotheses, identify success/failure criteria, and select representative audience samples. You will also coordinate with the IT team to identify opportunities for improved efficiency and to ensure ongoing reporting is created in the most standardized manner possible. Your involvement in Marketing includes: being the liaison between Analytics / Channel Marketing for all test setup, ensuring recurring analysis and reporting processes are conducted correctly and in a timely manner, analyzing test results, providing recommendations, troubleshooting, and producing detailed ad-hoc analysis as required by the business leaders. You will be responsible for helping senior leaders understand: A|B & multivariate testing effectiveness, confidence thresholds, and using Test & Learn software to forecast roll-out of winning test experiences.

Job Responsibilities:

  • [Strategy] Partner with Marketing & Channel teams to understand go-to-marketing strategies, business objectives, and key questions. Leverage prior test performance and new insights to provide testing recommendations (defining the hypothesis, reporting KPIs, audience segments, traffic splits, etc.)
  • [Testing Design] Understand Test & Learn tooling and setup process, define success/failure criteria across key KPI’s, check &mitigate against sample bias, advise & measure against confidence levels, and propose audience splits
  • [Interpretation & Insights] Partner with Analytics, Channel, and IT teams to provide ongoing test reads, reporting, and actionable insights. Understand and be able to interpret lift impacts and confidence levels using business acumen. Advise high-impact audiences for roll-out of winning experiences. Forecast and measure testing lift against baseline business results
  • [Standardization & Efficiency] Partner with Test & Learn teammates to align processes, facilitate trainings, and document best practices that ensure efficient and consistent analysis across the team. Standardize methodology for addressing common questions and ensure that consistent approaches be utilized across the enterprise. Proactively develop new analytic approaches and partner with other analytical groups to develop tools that support marketing tactics at every level
  • [Reporting] Create and distribute recurring test read-outs & reports to track existing test performance and provide insights that inform new testing opportunities for the enterprise
  • [Data Analysis] Analyze and organize the testing data available for business use. Inspect, clean, understand, and transform data as required for analysis purpose. Keep the big picture of business goals in mind while thinking of new ways to approach analysis and enterprise-level testing insights
  • [Ad-hoc] Support complex ad-hoc pre, during, and post analysis of tests as required by leadership and partner teams
  • [IT Troubleshooting] Leverage knowledge of test setup, site & campaign implementation, and key business KPIs to partner with IT teams to quickly troubleshoot issues as they arise
  • [Testing Culture & Knowledge Base] Populate and maintain accessible knowledge base of past testing to enable trended impact of Test & Learn impact to business results, provide guidance on methodology & assumptions used in analysis, and to enforce integrity of testing process and use of best practices across the enterprise. Leverage historical learnings to make recommendations on strategy to marketing leadership & lead culture changes to enable an agile Test & Learn environment


Job Requirements:


  • Bachelor’s degree in related field (Business, Technology, Economics, Marketing, Statistics, Computer Science, Data Science, or Mathematics)
  • 1-3 years prior marketing analytics, A|B testing, statistics, digital analytics, or other related experience
  • Experience evaluating website or marketing channel performance, including analysis of A|B experiments and evaluation of results against randomized control groups
  • Statistics background including but not limited to A|B Testing, Multivariate Testing, Regression Analysis, and Hold-out Experiments
  • Demonstrated success working with very large data sets, developing tools for streamlined analysis, and creating reports that succinctly summarize complex concepts
  • Comfortable running statistical analysis and manipulating data in Alteryx, RStudio, Python, or other open source analytics software
  • Excellent interpersonal and relationship management skills, with the ability to communicate and present effectively at all levels of the organization
  • Must be able handle multiple projects simultaneously and coordinate across multiple functions within an organization
  • Experience with 1 or more analytics tools/software specific to testing analysis (Adobe Analytics / Adobe Target / Optimizely /Google Analytics / APT / other CRO platforms)
  • High level of comfort with Digital Analytics & Marketing Technology



  • Hospitality or travel industry experience helpful
  • RStudio, Python, Alteryx, Tableau, experience a plus


The budgeted range starts at $67,000 - $81,150.  Actual pay will be adjusted based on experience.

The perks include a free ski pass, and a set of benefits including... 

  • Medical, Dental, Vision insurance, and a 401(k) retirement plan  
  • Hourly employees are generally eligible for accrued Paid Time Off (PTO), Extra Time Off (ETO) and Sick Time.  Salaried employees are generally eligible for Flexible Time Off (FTO) 
  • Paid Parental Leave for eligible mothers and fathers  
  • Healthcare & Dependent Care Flexible Spending Accounts  
  • Life, AD&D, and disability insurance 


Reach Your Peak at Vail Resorts.  At Vail Resorts, our team is made whole by the brave, passionate individuals who ambitiously push boundaries and challenge the status quo. Whether you’re looking for seasonal work or the career of a lifetime, join us today to reach your peak.  

*Remote work is currently permitted from British Columbia and the 16 U.S. states in which we currently operate. This includes: California, Colorado, Indiana, Michigan, Minnesota, Missouri, New Hampshire, New York, Nevada, Ohio, Pennsylvania, Utah, Vermont, Washington State, Wisconsin, and Wyoming. Please note that the ability to work remotely, and the particulars related to such work, are subject to change at any time; and, accordingly, the Company reserves the right to change its policies and/or require in-person/in-office work at any time in its sole discretion.   

Vail Resorts is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, protected veteran status or any other status protected by applicable law.

Requisition ID 458408

Nearest Major Market: Denver