we finally got around to pulling xcode organizer data through the app store connect api instead of checking it manually. we're piping everything into elasticsearch and using z-scores to flag
weird spikes in performance. when a regression hits, the system auto-generates jira_tickets and pings slack. it's basically an automated early warning system so devs can fix things before users notice. do not skip the anomaly detection step or you will just get flooded with false positives.
the real struggle is tuning the z-score threshold . anyone else using similar logic for their mobile performance monitoring?
https://hackernoon.com/how-we-automated-xcode-organizer-performance-monitoring?source=rss