Commit Graph

25 Commits

Author SHA1 Message Date
Peter Hedenskog e20fe9ddc1
Fix Wilcoxon NaN values (#4402) 2025-01-16 09:32:34 +01:00
Peter Hedenskog b9456eef6e
Replace intel with sitespeed.io/log (#4381)
* Replace intel with sitespeed.io/log
2025-01-07 08:53:48 +01:00
Pavel Bairov 4f88cf9265
[Compare] Add validation for dataset lengths for the Wilcoxon test. (#4341) 2024-12-18 11:31:35 +01:00
Peter Hedenskog 70a0c5c4ff
Make it easier to see which test type that is used (#4339) 2024-12-17 05:55:38 +01:00
soulgalore 4780bd9ca8 Log input data on error 2024-12-14 14:52:48 +01:00
Peter Hedenskog 74b9fd7de8
compare: verbose log the actual input data (#4337) 2024-12-13 19:33:35 +01:00
Peter Hedenskog 957fe5220b
fix: use compare with --cpu for Firefox failed. (#4324)
This catches if we got no longtask information.
2024-11-23 19:51:26 +01:00
Peter Hedenskog 83f4a656eb
Skip visual metrics contentful and perceptual progress from baseline. (#4308)
https://github.com/sitespeedio/sitespeed.io/issues/4307
2024-10-30 17:17:51 -04:00
Roel Vreuls 465e054346
Fix error on warning msg (#4279) 2024-09-18 17:54:22 +02:00
Peter Hedenskog 3741366d45
Upgrade to eslint/unicorn 54 (#4213) 2024-07-08 08:19:41 +02:00
Peter Hedenskog 6d81b86a2d
Use browser, connectivity and slug in compare name. (#4083)
If you don't give your compare an id, this will add
browser, connectivity and slug to the filename. This
is a breaking change if you use the compare plugin
without an id.
2024-02-09 15:39:23 +01:00
Peter Hedenskog 72b32324f6
First step to a better compare (#4064) 2024-01-19 06:53:34 +01:00
Peter Hedenskog 0039afb460
Add isSignificant to result. (#4030)
If the change is not significant, it will be zero. Else
Cliffs delta is used to determine how large the change is.

In Graphite we could then alert on everything > 0. And then match
Cliffs delta to tell us if the change is small, medium or large.
2023-12-15 14:42:42 +01:00
Peter Hedenskog 28bb0aef65
Show if datasets are identical (#4029) 2023-12-14 10:14:24 +01:00
Peter Hedenskog 1757b0acbb more text fixes 2023-12-07 20:55:40 -08:00
Peter Hedenskog 5f02dacde7 tune the text 2023-12-07 20:47:22 -08:00
Peter Hedenskog fc939b45cd
Show the sigificant change in the graphs (#4025) 2023-12-07 16:45:55 -08:00
Peter Hedenskog 3c4dc43a8c
Use Cliffs delta to know the size of the significant change (#4024) 2023-12-07 16:01:58 -08:00
Peter Hedenskog c56859daf6
Make it easier to understand alternatives (#4023)
* Makes it easier to understand alternative settings

* make it easier to understand tests

* better sync
2023-12-07 10:20:46 -08:00
Peter Hedenskog 3d396b47db
Add link to graphs (#4016) 2023-11-29 09:09:31 +01:00
soulgalore 5ef91453e7 cleanup 2023-11-29 07:32:42 +01:00
Peter Hedenskog 308fd627e5
Include browser benchmark in the baseline data (#4015) 2023-11-29 07:30:12 +01:00
Peter Hedenskog 4cd5158722
Also handle decimals for GWV (#4014) 2023-11-29 06:06:28 +01:00
Peter Hedenskog 0cbf6ffcff
Autogenerate ids if we miss an id (#4013) 2023-11-28 11:42:55 +01:00
Peter Hedenskog da6c0997c7
A new compare plugin. (#4009)
* A new compare plugin.

Make it possible to compare the performance using Wilcox or
Mann Whitney U.
2023-11-24 13:57:14 +01:00