We design Spotify’s consumer experience end to end, from one moment to the next, across every screen, platform, and partner integration. Our goal is to make listening feel effortless, personal, and joyful for billions of people worldwide. We transform complexity into clarity across hundreds of touchpoints—from our mobile and desktop apps to smart speakers, TVs, cars, and the integrations where Spotify shows up every day. If it affects consumers, we shape it. By combining deep insight into human behavior, design, and technology, we build experiences that feel intuitive, expressive, and unmistakably Spotify.

We power the world’s best audio network by helping creators and content distributors deliver their work with minimal friction, while giving Spotify teams access to the richest possible catalog. This is the mission of the Content Platform team, which applies its understanding of consumer expectations to improve the lives of millions of users worldwide by delivering the music and audio people love to the devices, apps, and platforms they use every day.

The Annotation Platform Ops team collaborates with Product and Engineering teams within the Content Platform R&D studio to create rich, connected datasets that enable outstanding consumer experiences through a combination of machine and human expertise. We support use cases across all of Spotify’s areas: Music, Podcasts, and Audiobooks.

We’re looking for an Annotation QA Analyst to help build a wide range of labeled datasets used by Content Platform teams to train, evaluate, and better understand models and systems. This role offers an exciting opportunity to be at the heart of ML and AI development.

What you’ll do:
– Review annotated data to ensure it meets Spotify’s quality standards and policies, prioritizing tasks based on business needs
– Deliver accurate, timely results to Product and Engineering teams using established QA frameworks and metrics such as agreement rates and consensus
– Handle complex edge cases by establishing ground truth and reducing ambiguity across datasets
– Identify patterns, insights, and opportunities for improvement, and clearly communicate findings to both technical and non-technical partners
– Support feedback loops between annotation teams, R&D collaborators, and content policy specialists to improve workflows and outputs
– Develop and refine annotation guidelines, including supporting annotator training and continuous improvement
– Work closely with teammates across multiple projects and domains

Who you are:
– You have experience with annotation work, data quality, or QA processes in ML/AI environments
– You understand LLM or AI-driven annotation workflows and human-in-the-loop systems
– You’re comfortable reviewing large-scale datasets in formats such as text, audio, images, or video
– You care deeply about quality and consistency and approach data evaluation in a structured way
– You communicate clearly and can explain complex ideas simply
– You work well with cross-functional partners in fast-paced settings
– You understand the machine learning lifecycle, from data collection through deployment
– You’re comfortable working with emerging AI tools and agent-based workflows
– You’re curious about and genuinely interested in music, podcasts, or audiobooks
– You have familiarity with SQL or music metadata standards (nice to have)

Where you’ll be:
– This role is based in New York.
– You can work flexibly, with some in-person meetings while still having the option to work from home.

The U.S. base salary range for this role is $82,921.00–$118,459.00, plus equity. Benefits include health insurance, six months of paid parental leave, a 401(k), a monthly meal allowance, 23 paid days off, and 13 paid flexible holidays. These ranges may change over time.

Spotify is an equal opportunity employer. We invite you to apply as you are—regardless of your background, appearance, or what you listen to. Our platform is for everyone, and so is our workplace. The more voices we include and elevate, the more we all thrive, contribute, and stay forward-thinking. Bring your personal experience, perspectives, and background—we’ll find strength in our differences as we continue to transform how the world listens.

At Spotify, we’re committed to inclusivity and to ensuring our entire recruitment process is accessible to everyone. We can provide reasonable accommodations during the interview process. If you need accommodations at any point during the application or interview process, please let us know—we’re here to help.

Spotify changed music listening forever when we launched in 2008. Our mission is to unlock the power of human creativity by enabling a million creative artists to earn a living from their work, and by giving billions of fans the opportunity to enjoy and passionately follow those creators. Everything we do is driven by our love for music and podcasting. Today, we’re the world’s most popular audio streaming subscription service.