Lumen Learning: Weekly active teams Dropped 24%
Product Management
medium40 min0 submissionsBain
Scenario
You are the PM for Lumen Learning's core edtech product.
Weekly active teams has fallen 24% over the past 9 days. The drop appears concentrated in all platforms and is most pronounced in Europe.
Context that may or may not be relevant:
- A redesigned onboarding flow shipped 12 days ago to 50% of users
- Marketing paused a paid acquisition campaign 25 days ago
- A competitor launched a free tier last month
- The data team migrated the analytics pipeline 4 days ago
Your VP wants an answer by end of day and is already asking whether the redesign should be rolled back.
Supporting data
incident
- metric
- weekly active teams
- drop pct
- 24
- window days
- 9
- concentrated region
- Europe
- concentrated platform
- all platforms
recent changes
- onboarding rollout pct
- 50
- onboarding redesign days ago
- 12
- competitor free tier launched
- last month
- paid campaign paused days ago
- 25
- analytics pipeline migrated days ago
- 4
Your task
Diagnose the drop. Provide:
- Analysis — how you would structure the investigation and which hypotheses you would test in what order.
- Risks — of acting too early, and of acting too late.
- Recommendation — your diagnostic sequence and what you would tell the VP today.
Be specific about the data cuts you would pull.
Ready to move forward? Up next: Amber Grid: Trial-to-paid conversion Dropped 8%Next question
How you'll be graded
100 points, 60% to pass.
- data analysis25
- recommendation25
- problem structuring25
- hypothesis generation25
Hint
Reveal suggested structure
- Is it real? Check instrumentation first — the pipeline migration is the cheapest hypothesis to eliminate and the most embarrassing to miss.
- Decompose the metric. For DAU: new + returning + resurrected − churned. Which component moved?
- Segment. Platform, region, cohort, acquisition channel, new vs existing users.
- Timeline. Does the drop align with a specific deploy, or is it gradual?
- Internal vs external. Internal changes are testable and reversible; external ones are not.
- Act on the evidence, with a rollback only if the evidence points there.