13 July 2026 · Min-jun Park
Reading Cohort Decay Curves Without Overfitting
Why the steepest drop in month two often reflects onboarding gaps rather than product failure — and how to annotate curves so executives ask better questions.
Every retention curve tells two stories at once: how customers behave, and how the analyst chose to group them. When we review draft charts from client teams, the most common mistake is treating month-two drop as a product verdict before checking whether the cohort was defined by first purchase date or first meaningful visit.
For a specialty retailer in Centum City, the apparent cliff at week six disappeared once we separated in-store registrants from online-first buyers. The curve still declined — but the slope reflected onboarding friction, not category rejection. Annotating that distinction on the chart plate saved the merchandising director from a premature assortment cut.
Three annotations worth adding
First, mark the cohort definition in plain language at the chart foot — "customers whose first purchase occurred in January 2025, in-store or online." Second, note any external events that overlap the period: holiday closures, promotional windows, or POS migrations. Third, include the denominator: a retention rate without the starting count invites misreading at the board table.
Overfitting arrives quietly when analysts slice until a curve looks actionable. We recommend agreeing on two segmentation dimensions before any plotting session — typically acquisition channel and region — and holding additional cuts for a follow-up memo rather than the primary plate.
When to escalate to a full report
If leadership needs to compare three or more cohort definitions, or if segment overlap drives the business question, a single curve is insufficient. That is when clients commission our Cohort Segmentation Report rather than extending an audit scope ad hoc.