Practice & Reference · Case Study · Real company

Spotify & the Birth of Backstage

This is the case that gave the whole industry two of its favourite words: golden path and Backstage. It is a real, named company's story, and this page sticks to what Spotify's own engineers have said about it in public — engineering-blog posts, Backstage's own documentation, and on-the-record press interviews. No invented metrics, no filled-in gaps. Where the public record runs out, this page says so rather than guessing.

☺ Explain it like I'm 10

Imagine a school that grew from ten kids to ten thousand almost overnight. Everyone was free to build their own science project however they liked — which was great, until nobody could find anyone else's project, tell whose it was, or copy a good idea without hunting down its owner in the hallway. So a few teachers made one big noticeboard listing every project and who made it, plus a one-page "how to build a good project" instruction sheet. That noticeboard is Backstage. That instruction sheet is a golden path. And because the noticeboard turned out so useful, the school eventually gave a copy to every other school for free.

🦊🦋Your hosts for this case file: Foxy & Mira the Butterfly — Foxy investigates why a music-streaming company ended up donating software to the CNCF, and Mira translates what she finds into the Software Catalog and Software Templates concepts you already met on the Backstage page.

The starting situation: hypergrowth turns autonomy into fragmentation

☺ Like you're 10: When a school gets huge fast, "everyone does their own thing" stops being freedom and starts being chaos — nobody can find anything.

"Rumour-driven development"

Spotify's engineering organisation is famous for the "Spotify model" of autonomous squads and tribes, popularised around 2012 in Henrik Kniberg's widely shared write-up of Spotify's culture. Whatever you think of that model as an org chart — it's frequently cited today as more aspirational marketing than an accurate map of how Spotify actually ran engineering — the underlying fact this case study cares about is real and well documented: squad autonomy at scale produced serious tooling fragmentation. As Spotify's own engineering blog put it in a 2020 post, independent teams built independent point solutions without knowing similar ones existed elsewhere, and the only way to learn how to do something was to ask a colleague — what the post itself named "rumour-driven development."

System Z: the first fix

By 2014, Spotify had grown past 100 engineers who were spinning up new microservices on a weekly basis, according to an account of Backstage's history summarised in Gergely Orosz's Pragmatic Engineer newsletter (itself drawing on Spotify's own retrospective). Services multiplied faster than anyone could track them: nobody had a reliable answer to "what exists," "who owns it," or "is this actually running in production." A platform team's response was a small internal tool they called System Z — a registry where a team could register a service along with its code link, its owning team, and its product owner.

🦆 Dot's-eye view

"I don't want to file a ticket to find out who owns the recommendations service, or spend an afternoon in Slack asking who remembers how the last team wired up CI. If the fastest way to learn something is still 'ask around,' the platform hasn't actually solved my problem yet — it's just moved the paperwork into chat."

The Golden Path: origin, and what it means as a practice, not a tool

☺ Like you're 10: A golden path didn't start as a fancy piece of software — it started as one really good instruction sheet a few engineers wrote in a single week.

A Hack Week tutorial, not a platform roadmap item

This is the detail most retellings skip, and it matters: the Golden Path did not begin as a platform feature. According to Spotify's own 2020 engineering-blog post, "How We Use Golden Paths to Solve Fragmentation in Our Software Ecosystem," the first Golden Path tutorial was built during a company Hack Week, roughly six years before that post was written — put a handful of senior backend engineers in a room for a week, and what came out was a single, opinionated, step-by-step tutorial for "the recommended way of using our services." It worked well enough that Spotify's Platform Developer Experience (PDX) tribe formalised the pattern and extended it across other disciplines.

The blog post defines a Golden Path plainly: "the opinionated and supported path to build something" — a backend service, a website, a data pipeline. By the time that post was written, Spotify had one Golden Path tutorial per discipline — backend, client, data engineering, data science, machine learning, web, and audio processing — each built as a written, step-by-step tutorial (using the same TechDocs mechanism you can read about on the Backstage page) and then surfaced inside Backstage itself, so the "how-to" documentation lives right next to the catalog entry for the thing it's about.

◆ Key idea — the golden path is an organisational practice wearing a tool's clothes

It is tempting to read "golden path" as a synonym for "scaffolder template," and the CNCF-hosted Backstage scaffolder is genuinely one implementation of it. But Spotify's own account describes three layers stacked on top of each other: a path definition (the opinionated decision about what the "right" way to build a backend service actually is — a real organisational judgment call, made and owned by named engineers), a tutorial layer (the documented, step-by-step walkthrough a human can follow by hand), and only then a scaffolding implementation (software that automates the tutorial into a button). Skip straight to automation without ever making — and periodically revisiting — the underlying decision about what "good" looks like, and you've built a very fast way to create the wrong thing. The golden path is the decision and the discipline of maintaining it; the scaffolder is just the fastest way to hand that decision to a developer.

Optional, not mandatory

Crucially, Spotify made the path optional, never mandatory — the post is explicit that "the idea behind having Golden Paths is not to limit or stifle engineers." A team can still build something bespoke; they simply don't get the same support, documentation, or fast lane if they do. That non-coercive design is exactly the mechanic covered in more depth on Platform as a Product & Golden Paths — a path people are free to leave is the only kind of path you can honestly measure the popularity of.

Architecture and technology decisions: from a registry to a portal

☺ Like you're 10: The noticeboard started as a simple list, then grew buttons, then grew so many buttons that they had to rebuild it from scratch.

The 2017 rewrite

System Z's scope grew organically. Per Backstage's own "Spotify Story" background documentation, once engineers were already visiting System Z daily to look up service ownership, the platform team noticed it was also the natural place to bolt on UIs for developer-infrastructure tools that had previously only existed as CLIs. Relationships between services got modelled too — which service depended on which, and which services belonged together as one product. By 2017, System Z's organic feature growth had outpaced its original design, and Spotify undertook a complete rewrite. That rewrite is the tool that would eventually be named Backstage.

Two concepts: the catalog and the templates

Two concepts came out of that rewrite as Backstage's structural core, both explored in full depth on the dedicated Backstage page — this case study only needs their shape:

ConceptWhat it isThe problem it directly answers
Software CatalogA graph of every component, API, resource, system and team, built from small metadata files that live beside the code they describe"What exists, and who owns it?" — System Z's original question, generalised and kept honest by staying next to the code
Software Templates (the scaffolder)A form-driven "create new X" button that renders a project skeleton, opens a repository, and registers the result back into the catalog"How do I start a new thing the right way?" — the Golden Path's tutorial layer, turned into a repeatable, enforced action

A minimal software-catalog entry looks like this — the same shape whether you're Spotify in 2017 or a reader trying this today (see Backstage for the full entity-kind reference):

# catalog-info.yaml — lives at the root of the service's own repo
apiVersion: backstage.io/v1alpha1
kind: Component
metadata:
  name: recommendations
  description: Generates the Discover Weekly candidate set.
  annotations:
    backstage.io/techdocs-ref: dir:.
spec:
  type: service
  lifecycle: production
  owner: group:default/personalization-team
  system: discovery

Plugins: extending without re-centralising

Backstage's plugin architecture followed the same growth pattern as System Z did before it: rather than one team owning every integration, other teams could write a plugin against a stable API and have it appear as a tab on the catalog entity page — Kubernetes status, on-call, CI results, cost. The platform team keeps owning the core (catalog, scaffolder, TechDocs); everyone else extends it. That division of labour is exactly what let the tool keep scaling past what any one team could build alone.

Organisational choices: who owns the path, and how that changed

☺ Like you're 10: At first, one person wrote every instruction sheet. That became too much for one person, so lots of teams started writing their own — which brought a new problem.

From one writer to distributed ownership

The organisational story here is honestly reported, including its own unsolved edge. Spotify's 2020 Golden Paths post describes the ownership model evolving in two stages. Initially, a single technical writer owned each Golden Path tutorial — a workable model at small scale, since one person could keep one tutorial coherent and current. As the number of paths grew across seven-plus disciplines, that didn't scale, and ownership shifted to being distributed across multiple teams per discipline. Spotify's own post is candid that this created a new coordination problem it was still working through at time of writing: many owners can mean many slightly different opinions about what "the" backend Golden Path should even be.

Treating the path as a product, not a project

The broader organisational lesson is one this course returns to repeatedly on Platform as a Product & Golden Paths: the PDX tribe treated the Golden Paths as a product with real owners and a mandate to keep them current, not a one-off documentation project that ships and then rots. The tutorials became, in Spotify's own words, "our most read and most used technical documentation" and are folded directly into new-engineer onboarding in their first two weeks — which only stays true if someone keeps them alive.

⚠ What the public record doesn't tell you

Spotify has not published a detailed org chart of exactly how many people currently staff Backstage or the Golden Paths, what the reporting line looks like today, or how the "many owners, one opinion" coordination problem was ultimately resolved. Treat the ownership story as directionally accurate and illustrative — one technical writer, then distributed teams — rather than a precise current-day staffing model you can copy line for line.

Why Spotify open-sourced it — and then gave it to the CNCF

☺ Like you're 10: They'd already been burned once by building their own version of something everyone else eventually standardised on — so this time, they got ahead of it.

The stated reasons

Spotify open-sourced Backstage on March 16, 2020 — by its own account, the company's first major open-source infrastructure release — and donated it to the Cloud Native Computing Foundation later that year; the CNCF accepted it as a Sandbox project on September 8, 2020, and it graduated to the Incubating maturity level on March 15, 2022. The stated reasoning, on the record from more than one source, is more interesting than "we like open source":

Notice that this is the mirror image of the Golden Path story: the Golden Path was Spotify importing discipline into a fragmented internal ecosystem, while open-sourcing Backstage was Spotify exporting that discipline so the wider industry wouldn't fragment around competing portals the way container orchestration once did.

The public timeline

2014 System Z service registry born at 100+ engineers ~2014 Hack Week first Golden Path tutorial, backend 2017 Rewrite renamed "Backstage" Mar 2020 Open-sourced first major Spotify infra open-source Sep 2020 CNCF Sandbox donated to the CNCF Mar 2022 Incubating CNCF maturity level upgrade Six years an internal tool, two years to CNCF Incubating — dates as reported by Spotify Engineering and the CNCF

What changed: the numbers Spotify has actually published

☺ Like you're 10: Faster new-hire ramp-up inside Spotify, and thousands of other companies borrowing the same noticeboard.

Public, attributable figures are thinner here than the qualitative story, and this page only uses the ones traceable to a named source. The Pragmatic Engineer newsletter's account of Backstage's history, drawing on Spotify's own retrospective, cites a 55% decrease in onboarding time for new engineers and adoption across 280 internal engineering teams by 2020. Spotify's own five-year retrospective, published on its engineering blog in 2025, states that Backstage's Golden Path tutorials became the company's most-read and most-used technical documentation, and that roughly 700 Spotify R&D squads now rely on the tool to ship daily. The same 2025 post reports that more than 3,000 companies outside Spotify had adopted Backstage to build their own internal developer portals — a figure that has grown from the "over 130 external contributors, ~40% of PRs from outside Spotify" reported within roughly six months of the 2020 open-source release.

⚠ Read these numbers as directional, not audited

Every figure in this section is self-reported by Spotify or drawn from an interview, not an independently audited study. "55% decrease in onboarding time" in particular is a headline number without a published methodology behind it — treat it as evidence that the internal tool clearly worked well enough to be worth publicising, not as a rigorously controlled result you could cite in a peer-reviewed paper. That caveat doesn't make the number worthless; it just means you should say "Spotify has reported" rather than "it's proven that."

What to steal for your own platform

☺ Like you're 10: You don't need Spotify's size to copy their trick — write the instruction sheet before you write the software.

Honest caveats: what doesn't transfer

☺ Like you're 10: A story built for a company Spotify's size doesn't automatically fit a company with twenty engineers.

🦊 Foxy's stakeout · 15 min

Pick one real onboarding pain at your own company — something a new engineer has to ask a colleague to figure out, because there's no page for it. Write the one-page tutorial version first, by hand, the way Spotify's Hack Week team did: no scaffolder, no automation, just "here is the opinionated, supported way to do this." Have one other engineer follow it cold and time them. If it's faster and correct, you've just built your first Golden Path — the software (a Backstage template, a cookiecutter, a shell script) can come later.

🎬 At the Platform Guild
🦊

Foxy: So the famous Golden Path started as… a Hack Week project? Not a grand platform strategy?

🦋

Mira: Exactly. A handful of engineers wrote one really good tutorial in a week. The scaffolder — the button, the automation — came years later, after Spotify already knew the tutorial worked.

🦆

Dot: That actually makes me trust it more. It wasn't "we bought a tool," it was "we figured out the right way to do this, then made it easy."

👺

Gizmo: Boring! Skip the tutorial, buy the fanciest developer-portal SaaS on the market, and call it done by Friday! 🤑

🐢

Timmy: And you'll have a shiny catalog with nothing correct in it. Spotify's own catalog started as a plain list of service owners — get the truth right first, at any size, before you buy the shop window to display it in.

🦫

Benny: And remember the portal never deploys anything itself. Spotify's scaffolder writes to Git, same as ours does — the actual paving is the platform underneath.

Where this connects in the course

☺ Like you're 10: This one story touches three different lessons — read them next in whichever order matches what you're building.

This case is really three lessons wearing one company's name tag. The mindset — treat the platform as a product, and a golden path as something developers choose rather than something forced on them — is Platform as a Product & Golden Paths. The mechanics — Software Catalog, Software Templates, TechDocs, and the gotchas of actually operating a Backstage instance — are the full Backstage deep dive. And how a catalog and a scaffolder compose with Crossplane, GitOps and policy into one end-to-end paved road is Self-Service & Developer Portals. For the other companies whose public stories sit alongside this one, return to the case studies hub.

🐢 Timmy's checkpoint

1. What specific problem did Spotify's engineering blog name "rumour-driven development," and what caused it? 2. How did the first Golden Path tutorial actually get built, and in what year, roughly? 3. Name the three layers of a Golden Path described in this case, from most-organisational to most-automated. 4. What internal tool preceded Backstage, and what did its 2017 rewrite produce? 5. Give the two main reasons Spotify has stated, on the record, for open-sourcing Backstage. 6. Why should you treat "55% decrease in onboarding time" as directional rather than audited?

Check your answers
  1. Rumour-driven development: with autonomous squads building independent tooling, the only way to learn how to do something was to ask a colleague, because no shared, discoverable source of truth existed.
  2. It was built during a company Hack Week, by a handful of senior backend engineers, roughly six years before Spotify's 2020 blog post about it — so approximately 2014.
  3. The path definition (the organisational judgment call about what "right" looks like), the tutorial layer (a human-followable written walkthrough), and the scaffolding implementation (software automation of the tutorial).
  4. System Z, a service registry built around 2014 as Spotify passed 100 engineers; its 2017 complete rewrite was renamed Backstage.
  5. A scar from migrating off the homegrown Helios container orchestrator when Kubernetes became the industry standard (Spotify didn't want to repeat that costly migration with a developer portal), and a wish to share Backstage's internal productivity gains with the wider community that could, in turn, keep improving it.
  6. Because it is a self-reported figure from Spotify's own retrospective, without a published methodology or independent audit — real evidence the tool worked, but not a rigorously controlled result to cite as proven fact.