No one likes the mad scramble when a KPI drops. Plans get thrown out the window. Meetings get pushed. Your hopes of a productive day… ruined.
This “KPI Drop Checklist” could help. So could using Loops - watch the video at the bottom to see mor4e of Loops.
KPI Drop Checklist:
✅ Data Issues
☑ Check for errors and anomalies, and that data is still flowing
☑ Review data quality for bad / null data coming through
☑ Check for any data schema or format changes
✅ Seasonality
☑ Compare YoY data / history
☑ Use anomaly detection models that account for seasonality
☑ Adjust your model for each KPI
✅ Marketing Traffic
☑ Review marketing promotions/ campaigns
☑ Review channel mix: changes, new channels, and the quality of users attracted
✅ User Segmentation
☑ Changes in the size of a segment (client status, device, operating system, country, other cohorts)
☑ KPI changes specific to a segment
☑ Rank segments in order of contribution to change
✅ Product Issues
☑ Bugs and errors☑ Usability - especially across devices and onboarding flows
☑ Latency and Performance
✅ New Features / LaunchesPerform Feature/Release Impact analysis:
☑ analyze user journeys☑ relevant funnels
☑ adoption by segment
☑ unexpected release impact on other KPIs, etc.
✅ A/B Tests
☑ Check for your test setup and review the level of traffic through underperforming tests - they can impact your KPIs
Watch the KPI Checklist Video>>>
