If the change is not significant, it will be zero. Else Cliffs delta is used to determine how large the change is. In Graphite we could then alert on everything > 0. And then match Cliffs delta to tell us if the change is small, medium or large.
* A new compare plugin. Make it possible to compare the performance using Wilcox or Mann Whitney U.
Peter Hedenskog