Commit Graph

266 Commits

Author SHA1 Message Date
soulgalore 69955af6eb new browsertime 2021-01-05 21:27:17 +01:00
Peter Hedenskog ddeb72be91
Make sure cli-alias is propagated to Browsertime. (#3227)
I've made a mistake in the stable release and didn't add the
right alias to Browsertime when you run sitspeed.io.

https://github.com/sitespeedio/sitespeed.io/issues/3226
2020-12-30 23:00:10 +01:00
Peter Hedenskog f37e0b9d89
Move the WebPageTest plugin out of sitespeed.io (#3205)
* Move the WebPageTest plugin out of sitespeed.io

You can find the plugin at:
https://github.com/sitespeedio/plugin-webpagetest
2020-12-15 08:10:47 +01:00
Peter Hedenskog 5c32deeaef
Introducing slug for your test and a new experimental setup (#3203) 2020-12-08 19:48:51 +01:00
soulgalore 9775872def Run Firefox nightly/beta easier on Android 2020-11-18 13:26:45 +01:00
soulgalore a75a2b7727 Geckodriver flags 2020-11-18 13:21:18 +01:00
Peter Hedenskog ca4e389e9b
Setup basic structure to send messages to Matrix #2947 (#3086) 2020-11-02 13:22:57 +01:00
Peter Hedenskog 6000536aa2
Remove passing result urls (#3175) 2020-11-02 11:05:20 +01:00
Peter Hedenskog 6d37a98fbd
cli: verfiy that a phone has a internet connection before a test (#3152) 2020-09-26 20:19:20 +02:00
soulgalore 96db43d7fc Add video params convert flag 2020-09-04 14:01:44 +02:00
Peter Hedenskog a0359c4746
Browsertime 10.0.0-alpha.2 (#3142)
* Browsertime 10.0.0-alpha.1

* Support setting perceptual/contentful speed index

* Guard against missing PerceptualSpeedIndex

* new alpha
2020-09-04 12:32:29 +02:00
soulgalore 42edc68071 Add check for multi vs crux 2020-07-04 10:32:22 +02:00
Peter Hedenskog 0fd6d9edbb
Get CrUx data for a URL (or more) and origin. (#3061)
* Get CrUx data for a URL (or more) and origin.

Use the CrUx API to get Crux Data

* Correct cli
2020-06-30 09:09:47 +02:00
Peter Hedenskog fc975cd8d3
Add error (to all cli errors) (#3013) 2020-05-27 05:43:00 +02:00
Peter Hedenskog fd9f02abf7
Add --android to wpr (#3012)
* follow the same pattern to run WPR and Android as Browsertime

* remove set for now

* no need for edge yet
2020-05-25 09:58:14 +02:00
Erick Wilder 2c0ba7928e
feat(plugins): move influxdb CLI options to the plugin defintion (#3005) 2020-05-21 17:44:49 +02:00
Peter Hedenskog cc3ca04380
Add xvfb cli args (#3003) 2020-05-18 12:01:02 +02:00
Peter Hedenskog 6cf357869e
Cli help and catch if the config files don't exist (#3000) 2020-05-16 21:16:58 +02:00
Peter Hedenskog 89f51d47dc
Make it possible to set the limit/thresholds on the summary page (#2997) 2020-05-15 12:09:32 +02:00
Erick Wilder c750fe2b4a
Move graphite cli options to plugin (#2991)
* test(cli): add graphite coverage for current cli options

* refactor(plugins/graphite): move CLI option definitions to plugin
2020-05-13 12:14:20 +02:00
soulgalore f01cc84ed3 typeo 2020-05-12 09:43:35 +02:00
soulgalore ec570d3fe0 Added new CLI options.
Run:
* Rooted Android phones
* Safari Technology Preview
* Make it possible to enable Tracking protection and safe browsing.
2020-05-12 09:40:58 +02:00
Erick Wilder 8cf3c24722
Refactor grafana cli options (#2984)
* test(cli): add basic coverage to test cli help output

- Add basic coverated when invoking the command without arguments
- Basic checks for grafana help

* feat(cli): delegate command line options configuration to the Grafana plugin

It uses the name of the plugin as a namespace for all options. Plugin authors _may_ use this
in the future to show helpful messages in the default sitespeed CLI help output.

- Move CLI options to its own module to not pollute the plugin's `index.js` file.
- Change the plugin interface to define a `.cliOptions` property or method containing the `yargs`
  configuration to be used by the CLI code
- Add code coverage for the existing plugin API to ensure no regressions are introduced for Grafana
- Move parts of the `yargs`-related code to `cli/util.js`. Tests to ensure the initial proposition for
  plugin-based CLI options are included.

Co-authored-by: Peter Hedenskog <peter@soulgalore.com>
2020-05-11 20:31:52 +02:00
soulgalore bbd5adbbc7 Group Alias do not for for scripting (yet) 2020-04-29 09:18:32 +02:00
Peter Hedenskog 1448e5e468
First go at adding configurable groups #2958 (#2964)
* First go at adding configurable groups #2958

* Fix broken group

* simplify group handling

* Adjust test to the new structure
2020-04-27 08:19:41 +02:00
soulgalore 289980a683 Add new CLI options from BT 8.7.0 2020-04-24 14:09:29 +02:00
soulgalore 71023b9dcd Add iqr option for Browsertime 2020-04-06 09:34:16 +02:00
soulgalore 732f8e3b56 Add example on how to add one Chrome trace category 2020-03-26 08:52:44 +01:00
Chris Adams 3fba6b2e01
Extract co2 and hosting checks into separate module (#2899)
Co-authored-by: Peter Hedenskog <peter@soulgalore.com>
2020-02-29 09:29:22 +01:00
Peter Hedenskog 75c91708ff
Make it possible to disable the hosting check (#2902) 2020-02-27 17:31:33 +01:00
Peter Hedenskog 12268fef05
Verify NodeJS version (#2901) 2020-02-27 14:37:40 +01:00
Peter Hedenskog 3305b61a1d
Remove --sustainable.hosting since we will soon get the data locally (#2893) 2020-02-24 22:12:01 +01:00
Peter Hedenskog cea0b68f95
Do not silently ignore crawl/multi now working together #2765. (#2889) 2020-02-24 15:52:08 +01:00
soulgalore 45c5b4efea You don't need to give the path to edgedriver anymore 2020-02-24 08:31:22 +01:00
Chris Adams b1d40bec16
Add carbon emissions figures for data over the wire [sustainability plugin] (#2868) 2020-02-21 16:43:53 +01:00
Peter Hedenskog e07ba6b8a8
Make it easy to use tcpdump. (#2862) 2020-02-06 08:24:18 +01:00
soulgalore f2d4bbe7a3 Adjust to new browsertime names 2020-02-05 14:22:01 +01:00
soulgalore fdf73179e3 Browsertime 8.0.0 beta 2 and Chrome 80 2020-02-05 08:30:28 +01:00
soulgalore e752fa7201 Ignore certificate errors by default, as before with Chrome 2020-01-29 08:21:50 +01:00
soulgalore fd28a7a413 Follow the same pageLoadStrategy changes as in Browsertime 2020-01-28 19:34:11 +01:00
Peter Hedenskog b854bac769
Disable --cpu for Firefox so we can investigate if all configs are right. (#2855)
And we don't add too much over head.
2020-01-27 15:15:52 +01:00
Peter Hedenskog 55b8e5dd70
Add support to run edge (#2852) 2020-01-23 13:50:29 +01:00
Peter Hedenskog e3dcd3fdb7
Add support to download Geckoprofiler trace. (#2838) 2020-01-08 22:43:22 +01:00
Peter Hedenskog 5ca4c272f4
Add new CLI params from Browsertime 8 (#2830) 2019-12-29 08:26:39 +01:00
soulgalore c56b217a5a Removed one extra pageLoadStrategy item 2019-12-05 04:51:15 +01:00
Peter Hedenskog 6ce0ff5e87
Add new complete check params from BT (#2811) 2019-12-04 20:10:57 +01:00
Peter Hedenskog cd6c961055
Handle URLs with Arabic characters (#2813) 2019-12-04 20:10:27 +01:00
Peter Hedenskog 92cf54f9ba
Let Grafana annotations have same functionality as Graphite annotations. (#2798) 2019-11-24 14:26:47 -05:00
Samuli Reijonen b97dce509e Add --crawler.include (#2763) 2019-11-09 21:55:03 +01:00
Peter Hedenskog 6b2f38d6ba
Documentation changes for 11.0 (#2756) 2019-11-07 09:45:39 +01:00
soulgalore 8c0ce07d5a Added FF windowRecorder cli option 2019-11-03 08:48:42 +01:00
Peter Hedenskog a71cb9dd5d
skip using cli array param since it's kind of evil (#2742) 2019-11-01 15:30:30 +01:00
Peter Hedenskog b9f46f370f
Call friendly names ... friendly names :) (#2741) 2019-11-01 15:25:17 +01:00
thapasya-m 34ee102630 feat:summary box on result page (#2736)
customizable summary box on result index page
handle summary for tool axe separately
fix summary key mismatch
2019-11-01 15:22:37 +01:00
Peter Hedenskog b2a0e6c259
Better cli info text for gcs.key after feedback (#2739)
* Better cli info text for gcs.key after feedback

* one the is enough
2019-11-01 10:23:11 +01:00
Peter Hedenskog 1f1434963e
Follow the same pattern to handle multiple cli params (#2731)
* Follow the same pattern to handle multiple cli params
2019-10-31 20:18:27 +01:00
Peter Hedenskog a09a5f3a15
Make it possible to disable video/visualMetrics in Docker using config file. (#2715) 2019-10-23 19:30:43 +02:00
thapasya-m 4fdd121912 feat-metric page display change, by new user entered arg (#2711)
cli args to display metric tests require
ISSUES CLOSED: 2001
2019-10-23 14:48:41 +02:00
Peter Hedenskog ce83f9d9af
Move per iteration to experimental flag. (#2685)
--graphite.experimental.perIteration
2019-10-07 05:22:30 +02:00
soulgalore 0879b57c2a typeo 2019-10-04 15:31:58 +02:00
Peter Hedenskog fd8909431a
Add link to compare HAR files (#2680)
* Add link to compare HAR files

* fix link on run page

* new structure
2019-10-04 15:28:33 +02:00
Peter Hedenskog d870a63192
bugfix: fix faulty axe config #2670 (#2676) 2019-10-02 22:03:17 +02:00
soulgalore 3a956e2368 Make it clear that you can only limit by one metric #2669 2019-10-01 19:33:26 +02:00
Peter Hedenskog ba0fe57256
Simplify running Safari on ios by only using --safari.ios (#2666) 2019-10-01 13:16:06 +02:00
Peter Hedenskog 3afe4a0fbf
Fix for resultBaseURL as env variable #2663 (#2664) 2019-09-30 23:55:29 +02:00
soulgalore 06aa80ba2d remove --connectivity log warning since in some extend scenario the warning is wrong 2019-09-23 10:55:10 +02:00
Peter Hedenskog 78e28df70a
Using --connectivity as alias was broken and breaks setting connectivity at all. (#2649) 2019-09-23 02:20:30 +02:00
Peter Hedenskog 1845dd990f
Yargs 14.1 and extending merging configs (#2626)
* Yargs 14.1 and extending merging configs

* lint
2019-09-07 21:51:03 +02:00
Peter Hedenskog 83013e59d6
Added new metrics for slacking: (#2611)
* firstPaint
* visualComplete85
* lastVisualChange
* fullyLoaded

And fixed broken fullyLoaded.
2019-08-30 08:27:24 +02:00
soulgalore b94a3a80e2 Fix plugins.remove text 2019-08-29 07:29:01 +02:00
Peter Hedenskog 767ea15701
Switch --debug to log in verbose log and use --debugMessages to log the queue. (#2607)
Users add --debug and think they get more detailed log messages but instead
they get the each message in the queue. With this fix we change that.
2019-08-29 07:19:19 +02:00
Peter Hedenskog e18243412e
Only log to a file if you ask for it (#2606) 2019-08-29 07:15:07 +02:00
soulgalore d4715f4f08 Added missing tsproxy 2019-08-21 07:51:00 +02:00
Peter Hedenskog 9171392651
follow the same format all over the place (#2580) 2019-08-17 10:38:33 +02:00
Peter Hedenskog be12197c92
Safari support (#2578) 2019-08-16 16:37:36 +02:00
Peter Hedenskog 549d0cdef4
Make it easy to run axe core (#2571)
* use axe with `--axe.enable`
2019-08-14 20:37:14 +02:00
soulgalore 7de6883060 support other response bodies in Chrome 2019-07-29 19:42:56 +02:00
Peter Hedenskog a561955c61
Use --android to test Chrome stable on Android (#2544)
* Use --android to test Chrome stable on Android
2019-07-13 20:48:48 +02:00
Peter Hedenskog b7450aaaf9
Make it easier for users to understand that the JSON is malformed. (#2525) 2019-06-29 23:37:09 +02:00
soulgalore d40a2ad052 injectJS support in Chrome 2019-06-29 08:23:11 +02:00
soulgalore 8c3c5f6460 cli: set which chromedriver to use 2019-06-14 06:51:00 +02:00
soulgalore 5753b79e72 fixed typeo 2019-06-13 12:10:13 +02:00
Peter Hedenskog e98bb68d26 Added enableTraceScreenshots shortcut 2019-06-10 13:37:51 +02:00
soulgalore 0a08ae476b fix broken help 2019-06-01 16:56:53 +02:00
Peter Hedenskog fc331da6fb
Using extend missed out on configured objects. (#2490) 2019-05-31 22:49:38 +02:00
Peter Hedenskog fe978ccbb9
Pre-parse the config file so we can extend it. (#2488)
Extends only works on objects, not path that is instantiated, so we
read the file and make it and object, so we can use extend.
2019-05-30 20:53:21 +02:00
soulgalore af71bbf3fe Added missing clis 2019-05-19 14:18:31 +02:00
Peter Hedenskog ad60c21a30
CPU per tool to data storage (#2462)
* CPU per tool to data storage
2019-05-18 20:47:02 +02:00
Peter Hedenskog 1f8b8dee1c
Add --cpu shortcut (#2456) 2019-05-14 09:58:17 +02:00
soulgalore ac4dec0d57 remove console log 2019-05-14 08:55:52 +02:00
Peter Hedenskog fc3d58d9db
Support for .rc file (#2454) 2019-05-14 08:37:50 +02:00
Peter Hedenskog 9184d20d13
First go at use Browsertime 5 (beta.1) (#2449)
* First go at use Browsertime 5 (beta.1)
2019-05-10 06:34:28 +02:00
Peter Hedenskog 8ebb751e35
Use latest yargs (#2445) 2019-05-07 13:47:55 +02:00
Markus Liljedahl 6b3209e4b3 Fixes/gcs fixes (#2438)
* Ensure only files are uploaded since the node lib does not support uloading folders directly

* Addig flag for enabeling gzip metadata encoding and disabled resumable upload since to many connecteins are opened some times.

* Running the linter to late as usual
2019-04-26 12:54:17 +02:00
Peter Hedenskog 7c0a17ae98
Show cdp performance metrics (#2410) 2019-04-08 01:55:05 +02:00
Ferdinand Holzer aa9b1676e2 Improve use of browsertime.connectivity.alias option (#2397) 2019-03-29 08:49:17 +01:00
Peter Hedenskog f57eb55491
--useHash was not populated to Browsertime #2392 (#2393) 2019-03-26 23:17:37 +01:00
Peter Hedenskog 8f10868895
Fix disabling of screenshots #2377 (#2378) 2019-03-19 08:34:54 +01:00
Markus Liljedahl fa5fec263d Feature/google cloud storage plugin (#2360)
* New plugin for storing the results in a Google Cloud storage bucket.

* Adding package "fast-crc32c" faster crc32c computation when
validating the uploaded files to Google Cloud storage. This package
is not required but speeds up the validation 7x ~ 9x. More
information at https://github.com/ashi009/node-fast-crc32c


Co-Authored-By: mliljedahl <liljedahl.markus@gmail.com>
2019-03-06 17:04:37 +01:00
Ferdinand Holzer fbdf293b6e Add --html.assetsBaseURL option (#2321)
* Add --html.assetsBaseURL option

The base URL to the server serving the assets of HTML results.
In the format of https://result.sitespeed.io. This can be used
to reduce size in large setups. If set, disables writing of assets.

* Clarify html.assetsBaseURL parameter description
2019-03-01 08:19:01 +01:00
soulgalore ffabe979d9 lint 2019-02-28 20:24:15 +01:00
Markus Liljedahl 02c920b301 Added new option for Graphite, `--graphite.annotationTitle` (#2333)
* Added new option for Graphite, `--graphite.annotationTitle MyTitle`
to be able to set a custom title in the annotation.

* Removed the "run" in the end from the annotation when setting a custom title.

* Fixed linting issues in graphite send-annotation

* Update lib/cli/cli.js

Fix for copy-paste misstake

Co-Authored-By: mliljedahl <liljedahl.markus@gmail.com>
2019-02-28 20:23:26 +01:00
soulgalore 2e5aca30db docs: optional to use endpoint for s3 2019-02-23 16:00:37 +01:00
Ferdinand Holzer 3c5ccc338c Add support for crawler exclude patterns (#2319)
* Add support for excluding patterns from crawling. Resolves #1929

* Make eslint happy, fix error handling issue
2019-02-17 17:38:33 +01:00
Peter Hedenskog 68cb94851a
Add the test a name #2301 (#2302)
Give the test a name #2301
2019-02-12 01:00:30 +01:00
Peter Hedenskog 67b04d3afd
Output the budget result as JSON (#2299)
* Output the budget result as JSON
2019-02-08 21:03:01 +01:00
Peter Hedenskog cebad1424d
Make it possible to show the used script(s) in the HTML. (#2298)
* Make it possible to show the used script(s) in the HTML.
2019-02-07 13:51:10 +01:00
Jonathan Lee 33daee89e4 Fixes #2072 by adding endpoint as an configurable argument for s3 options (#2285) 2019-02-03 20:47:15 +01:00
Peter Hedenskog 3d17d46694
Adding back the pre/post script (#2282) 2019-02-01 06:43:37 +01:00
James Leatherman 6210eced83 Add missing spaces (#2279) 2019-01-31 19:36:38 +01:00
Peter Hedenskog 38b743e221
Show the filmstrip #1555 (#2274)
Inspired by [Stefan Burnickis](https://github.com/sburnicki) work on https://github.com/iteratec/wpt-filmstrip
2019-01-31 13:44:50 +01:00
soulgalore 2a0ba83713 Links in the cli 2019-01-22 00:32:44 +01:00
soulgalore 2ee7d15342 show hidden Grafana auth/bearer config 2019-01-12 22:15:40 +01:00
soulgalore 6897dfce97 simplify use spa and android phones 2019-01-01 22:28:58 +01:00
Peter Hedenskog b62d93194a
Use Browsertime 4.0 (alpha) (#2236)
* Use Browsertime 4.0 (alpha)

With support for testing multiple pages.
2018-12-30 15:57:55 +01:00
Peter Hedenskog 964a8e9212
Make it easy for people that use # in the URL and want to keep it. (#2142)
* Make it easy for people that use # in the URL and want to keep it.

We have been old and conservative in how we use # when creating URLs:
From the beginning (5+ years ago) we always left out # from URLs when
we decided if a URL is unique or not. Now you can choose yourself
with --useHash (is there a better name out there?).
2018-10-07 21:24:37 +02:00
Peter Hedenskog 74311216d6
Use alias from cli #2127 (#2133) 2018-10-07 00:01:22 +02:00
soulgalore 79e8aded6f link to Chrome command line switches 2018-10-03 08:35:59 +02:00
Peter Hedenskog 4910a18452 Grafana annotation with template support 2018-10-02 19:01:13 +02:00
Peter Hedenskog fb0d236b83 support injectJs in Firefox 2018-10-02 16:55:29 +02:00
Peter Hedenskog 3e24d65466
Prepare for using Grafana annotations with tags (coming in Grafana 5.4) (#2152)
* Prepare for using Grafana annotations with tags (coming in Grafana 5.4) #1826

* push the cli when 5.4 Grafana is released
2018-09-28 09:34:06 +02:00
soulgalore 46f5c1b36e group visual elements per browser (for now) 2018-09-16 21:40:47 +02:00
Peter Hedenskog dddaf3ba73
Include screenshots in annotations (#2144) 2018-09-16 12:24:25 +02:00
soulgalore d1f8fe6c8f added visual elements in the cli 2018-09-15 21:20:34 +02:00
soulgalore 102472867f remove shortcut for connectivity.engine 2018-08-08 07:52:57 +02:00
Peter Hedenskog 15e3490423 Make it easier to understand how to activate connectivity #2125 2018-08-07 14:46:34 +02:00
soulgalore f3f7ef9c23 added pageCompleteCheckInactivity in cli 2018-07-25 20:58:39 +02:00
Peter Hedenskog 0e9e6ea0e0
Add extra tags to annotations #2102 (#2112) 2018-07-25 09:46:52 +02:00
Peter Hedenskog 4b10db8338
Append message to annotation #2102 (#2114) 2018-07-24 22:18:00 +02:00
Peter Hedenskog 2e3bb0fc7d
Adding missing group for a couple of Browsertime cli params (#2113) 2018-07-24 22:06:40 +02:00
soulgalore 1e5be1196b Tell what do not work in headless mode 2018-07-14 23:04:59 +02:00
soulgalore cd1bb8921b latest BT support multiple cookies 2018-07-14 22:44:23 +02:00
soulgalore 91114c52b3 simple cookie support 2018-06-30 21:39:16 +02:00
soulgalore 759c3c146f fixed typeo 2018-05-31 22:55:15 +02:00
Peter Hedenskog 0c856c072f
Rollback pageloadstrategy (#2066)
* use page load strategy normal as default
2018-05-31 12:05:25 +02:00
soulgalore 480db4441e added pageLoadStrategy on the cli 2018-05-30 20:31:50 +02:00
soulgalore 207a8e9618 simplify 2018-05-13 10:39:29 +02:00
Peter Hedenskog 1f89559d29
Merge branch 'master' into influxdb_regexp_tag_group 2018-05-13 10:17:35 +02:00
soulgalore 889fc2e0d5 removed duplicated firefox preferences 2018-05-13 09:25:41 +02:00
amic81 2c8931dd71 influx db sets regexp tag group 2018-05-11 10:49:11 +02:00
Peter Hedenskog 117c3afc35
New S3 plugin (#2013)
Skip the old and outdated S3 plugin and use our own instead where you can configure
almost everything for your S3 instance/upload.
2018-05-05 08:36:01 +02:00
soulgalore 75931a03c2 lint fix 2018-04-30 09:10:06 +02:00
soulgalore 33ab6ab57d help: easier to understand video/visual metrics 2018-04-30 09:02:34 +02:00
Omri 8193a31245 Add StatsD support (with bulking) (#1994)
* Add StatsD support with bulking
2018-04-24 13:33:34 +02:00
soulgalore 0dd63e9804 add check for iterations and browser 2018-04-20 21:50:23 +02:00
soulgalore c60f20de1a adding missing char for vm 2018-04-20 16:16:09 +02:00
Peter Hedenskog 1d9dae83bf
Headless will not work with video/visualMetrics, someone will try so let us be one step ahead (#1990) 2018-04-20 14:00:49 +02:00
agupt13 b77bfe1256 make outputFolder as string type 2018-04-17 07:38:10 +02:00
Peter Hedenskog f82dbfb8b3
Group by FF/Chrome to make it easier to use (#1974) 2018-04-10 11:54:11 +02:00
Peter Hedenskog d1ba3e5769 Expose headless 2018-04-10 07:42:56 +02:00