Commit Graph

214 Commits

Author SHA1 Message Date
soulgalore 7884ae71dd added support for local configuration #387 2014-03-08 20:37:01 +01:00
soulgalore e8169aa880 if we use IE or Chrome, use firstPaint as default #387 2014-03-08 20:29:47 +01:00
soulgalore 375dec8f8a made it clearer that each line in a file must end with a newline 2014-02-27 19:15:16 +01:00
soulgalore 35374d1686 show redirectsPerPage & maxRequestPerDomain on summary #384 #385 2014-02-21 21:25:46 +01:00
soulgalore e2c7c74050 updated crawler version closes #382 2014-02-19 13:50:31 +01:00
soulgalore eaa5128a4e cleaner check for port number when using basic auth #372 2014-02-13 13:12:16 +01:00
soulgalore 73e1808f46 merge from zack 2014-02-11 18:56:14 +01:00
Zack Tollman 217ee1616a Connect via any SSL protocol
When connecting to a site that does not support SSLv3, the following error is triggered:

"Could not analyze $url unrecoverable error when parsing the page..."

PhantomJS defaults to using SSLv3 [1] when making secure connections with a site. If the site does not support SSLv3, the result of calling `require('webpage').open` in the YSlow script is a status of "fail" [2]. PhantomJS allows you to specify the protocol to use when opening a page; however, the sitespeed.io script does not allow this parameter to be specified, which results in the default value of SSLv3 always being used. This "fail" status causes the "unrecoverable" error in the sitespeed.io script.

SSLv3 is an outdated protocol with known security vulnerabilities [3]. It would be nice to use sitespeed.io with sites that do not support the protocol.

To fix this issue, the `--ssl-protocol=any` argument can be sent to the PhantomJS call. This allows the connection to be made via SSLv3, SSLv2, or TLSv1. I think that specifying this argument as "any" allows for the best user experience as it should just work when testing against SSL. This commit adds this parameter.

[1] http://phantomjs.org/api/command-line.html
[2] ef14079f85/src/phantomjs/controller.js (L237)
[3] http://www.acunetix.com/vulnerabilities/tls1sslv3-renegotiation-v/
2014-02-11 05:49:47 -08:00
soulgalore 35b531613e new crawler version 2014-02-11 07:44:50 +01:00
soulgalore bf6c5950e1 log errors to error.log when crawling closes #378 2014-02-10 10:13:13 +01:00
soulgalore 1365d3109d bumped the year (better late than never) 2014-02-09 12:18:06 +01:00
soulgalore 68638a61e3 upgraded to new full crawler release 2014-02-08 12:20:38 +01:00
soulgalore a03e17e37c new version of the crawler 2014-02-07 15:17:41 +01:00
soulgalore f56c2916f7 adding back the host dir in the path, somehow it was removed 2014-02-07 10:13:50 +01:00
soulgalore 17dee84eb3 support supply CDN name #374 2014-02-07 09:55:51 +01:00
soulgalore 6a29bf7d79 upgraded to latest browsertime 2014-02-05 20:49:09 +01:00
soulgalore 8b6d6ddb1b latest browsertime 2014-02-05 20:46:31 +01:00
soulgalore 592ee226a4 removed hardcoded port #295 2014-02-05 15:08:28 +01:00
soulgalore 770f3fdd14 define auth so it easy to understand how to override in local config 2014-02-05 13:29:55 +01:00
soulgalore 937d793906 first version of support for basic auth #295 2014-02-05 13:21:49 +01:00
soulgalore 5844e80a77 Merge branch 'basicauth' into 2.6-wip 2014-02-05 12:46:30 +01:00
soulgalore 35bddaa17a upgraded to YSlow 3.1.8 2014-02-05 09:29:48 +01:00
soulgalore 150c9a5f55 starting with basic auth 2014-02-05 08:49:43 +01:00
soulgalore e06742bf29 hopefully better handling of users with Java installed in dirs with spaces on win #358 2014-02-03 21:22:41 +01:00
soulgalore c1f71f3646 cleaner if checks for true or false 2014-02-02 20:09:35 +01:00
soulgalore 778d604c26 log local config file if an error happens closes #361 2014-02-02 20:00:13 +01:00
soulgalore 68cec70fb4 updated to new & coming browsertime version 2014-02-01 20:30:49 +01:00
soulgalore d50e060772 updated doc 2014-01-31 21:31:06 +01:00
soulgalore 461b98e041 define summary and columns early, so you understand why they are used 2014-01-30 10:27:07 +01:00
soulgalore 7ba71705ca tell the world when a locan config file is used 2014-01-30 10:22:14 +01:00
soulgalore 1c92f4b165 Merge branch 'AD7six-allow-user-config-file' into 2.6-wip 2014-01-29 13:31:15 +01:00
soulgalore 7e9eea090a new crawler where the proxy support works & updates proxy for BT & curl #351 2014-01-29 13:09:20 +01:00
AD7six 1cbab5ddeb allow for user-specific config file
In this way the defaults can be overriden/changed making usage more
concises.
2014-01-29 10:26:15 +00:00
soulgalore 6a85afc416 upgraded the crawler to latest version 2014-01-28 10:20:49 +01:00
soulgalore 67b4668c5d fix for standard err check (exists in master) 2014-01-27 21:56:47 +01:00
soulgalore 25c594bbd2 fix solving problem if a analyze doesnt work 2014-01-27 19:12:46 +01:00
soulgalore b597222f90 removed windows fix until I have tested it 2014-01-27 04:53:56 +01:00
soulgalore 524b189920 reverting and changed the BT java path for Windows #358 2014-01-26 21:06:24 +01:00
soulgalore 36601d41d0 new crawler version 2014-01-26 12:52:15 +01:00
soulgalore cd29a6d356 Fix for spaces in your classpath on Windows running BT closes #358 2014-01-26 12:42:46 +01:00
soulgalore 9c21323ecb Added latest full release of the crawler 2014-01-25 13:15:21 +01:00
soulgalore 7e2f5a1417 use the end location of an redirected URL closes #356 2014-01-24 22:16:29 +01:00
soulgalore 34d11e8d09 show how many files that has been parsed closes #354 2014-01-24 20:04:51 +01:00
soulgalore f7e6c69988 show how many pages that are beeing created #354 2014-01-24 11:51:10 +01:00
soulgalore f38a3df76d added explaining text for #352 2014-01-23 22:04:24 +01:00
soulgalore f618cbd215 another shot at getting the path right when outputting errors 2014-01-23 22:01:32 +01:00
soulgalore 4799c3bf9b windows fix for output 2014-01-23 21:57:49 +01:00
soulgalore f5831231f0 choosing output for error 2014-01-23 21:45:54 +01:00
soulgalore e11946a8ce use stderr instead if tty to work with no terminal #352 2014-01-23 21:20:29 +01:00
soulgalore 0530bd5c2a upgraded to latest xml-velocity version 2014-01-20 13:44:15 +01:00
soulgalore d0236201e7 Don't add the chromedriver output to the error log #334 2014-01-18 20:00:18 +01:00
soulgalore 0f07432589 new way of handling browser param in #341 2014-01-18 13:28:10 +01:00
soulgalore 8aa3677dca cleanup 2014-01-18 12:56:37 +01:00
soulgalore 3e92308c1d define if we should show the link to error urls or not 2014-01-17 21:58:17 +01:00
soulgalore d5241c4f71 moved log version to own function 2014-01-17 21:08:41 +01:00
soulgalore f127f766cf add failed browser time urls to error list #334 2014-01-17 19:40:28 +01:00
soulgalore dbcad21bbe fixed path to the browser xml if it fails #341 2014-01-17 15:26:46 +01:00
soulgalore 3aa6abce2e log browser time errors to the error log #334 2014-01-16 20:47:35 +01:00
soulgalore b15805f3c6 changed possibility to feed BT, now you only choose number of runs per URL #341 2014-01-16 20:41:43 +01:00
soulgalore d79b6138de removed faulty print to errorlog 2014-01-15 21:20:29 +01:00
soulgalore 03987c36e4 call the error method when something bad happens #334 2014-01-15 21:09:10 +01:00
soulgalore 1dca055674 send error to console & logfile #334 2014-01-15 20:56:05 +01:00
soulgalore 82ffb5ff4d merged master 2014-01-15 20:50:00 +01:00
soulgalore 5e66346d12 dont break if phantomjs fails #334 2014-01-15 20:27:37 +01:00
soulgalore 8888c34c22 write error log path to sout when phantomjs is failing #334 2014-01-15 20:08:13 +01:00
soulgalore aaebc7986c removed debugging 2014-01-13 14:52:29 +01:00
soulgalore d1f2319f46 show the right metrics on the in detail page #341 2014-01-13 14:51:58 +01:00
soulgalore 8375be5395 put the HAR file in the har folder without a move #343 2014-01-10 14:06:26 +01:00
soulgalore a7c8f292ed added new xml-velocity version 2014-01-10 00:47:37 +01:00
soulgalore ba9cb9efa4 use multiple different browsers when you collect metrics #341 2014-01-09 22:21:13 +01:00
soulgalore b7369169bf updated browsertime to 0.5 2014-01-09 00:19:28 +01:00
soulgalore 99c0629a86 updated the xml-velocity jar 2014-01-07 13:22:48 +01:00
soulgalore 4609766aad when feeding URL:s from a file, create basedir the same as the filename, closes #342 2014-01-05 21:08:13 +01:00
soulgalore bdb01d2cc7 show firstPaint by default on summary when IE is used closes #340 2014-01-03 14:23:51 +01:00
soulgalore d79b3912ec new way of adding the BT XML to the XML-velocity parser to work on Windows #337 2014-01-01 13:11:11 +01:00
soulgalore 9ce78745b1 small change on how to create the path to the BT XML file #337 2013-12-31 14:25:22 +01:00
soulgalore 2d81a63bfd updated to new browsertime 2013-12-30 22:18:01 +01:00
soulgalore 6beb354d82 reverted the error log fix again 2013-12-29 21:42:16 +01:00
soulgalore ad8ee01a77 use OS specific file separator 2013-12-28 14:11:06 +01:00
soulgalore 003c1c6dd9 reverted error log file changes for now (didn't work on windows) 2013-12-28 03:17:04 +01:00
soulgalore 8ba48df7c6 new xml-velocity jar 2013-12-28 03:01:47 +01:00
soulgalore d02e6094a1 send errors both to output & the error log #334 2013-12-27 22:59:55 +01:00
soulgalore 328e638f7b send specific phantomjs errors to the phantomjs log #334 2013-12-27 22:36:19 +01:00
soulgalore 0235355514 merge from master 2013-12-27 22:12:42 +01:00
soulgalore 3e23235a8b quick & dirty fix to handle when api.exip.org is down 2013-12-27 20:57:02 +01:00
soulgalore 5477ee8530 testing new xml velocity jar 2013-12-27 20:53:48 +01:00
soulgalore 14223f7209 right path to error log #296 2013-12-26 21:05:36 +01:00
soulgalore 93e9db168a upgraded xml-vel jar 2013-12-19 08:41:05 +01:00
soulgalore 7d1aae86c6 show red/yellow/green for cachetime, closes #312 2013-12-18 23:45:18 +01:00
soulgalore 4d33e0d8fc show firstPaint by default chrome #307 and add new summary fields #325 2013-12-17 14:43:12 +01:00
soulgalore a67c5ee82a merge 2013-12-10 20:47:59 +01:00
soulgalore d4e03494d4 take care of error message if the junit dir exists 2013-12-06 19:49:57 +01:00
Tobias Lidskog 65f9f708f3 Document -V option. 2013-12-03 00:33:16 +01:00
soulgalore 2811f33f00 merges for 2.2.3 2013-12-02 10:12:54 +01:00
soulgalore 1f9fc8cff6 removed requestsWithoutGZipPerPage as default for now 2013-12-02 10:10:02 +01:00
soulgalore 9f78677453 fix for browser parameters in Jenkins 2013-12-02 10:06:34 +01:00
umar1233 8405cb84d8 Bug fix for sitespeed.io file not found 2013-11-29 14:58:01 +00:00
soulgalore 66525fd365 added requests without GZip on summary pages closes #310 2013-11-20 21:44:51 +01:00
soulgalore 81eed09da6 upgraded to latest versions 2013-11-15 00:16:43 +00:00
soulgalore 65e7f9bc5d fix for sites with extremely far away last mod time closes 2013-11-14 00:16:06 +00:00
soulgalore 84755c37e0 fix for relative paths 2013-11-12 19:27:37 +01:00
soulgalore 6712103c17 added example 2013-11-12 11:52:02 +01:00
soulgalore 761a9bcead new naming standard 2013-11-11 22:11:22 +01:00
soulgalore 425bee76b1 right way handling running browsertime 2013-11-11 09:55:50 +01:00
soulgalore 5fb22258f7 bt fix 2013-11-11 08:39:43 +01:00
soulgalore 71403946db bt fix 2013-11-11 08:37:35 +01:00
soulgalore 78ccb98585 moved to check BT version so everything is defined 2013-11-11 08:33:57 +01:00
soulgalore 5286d1a0af fixed Java parameters for BT 2013-11-11 08:25:54 +01:00
soulgalore 49f281e6bb print current dir if failing 2013-11-11 08:01:25 +01:00
soulgalore f468b52c5c removed unused code 2013-11-11 00:42:54 +01:00
soulgalore 4b172a3847 better packaging #306 2013-11-11 00:21:46 +01:00
soulgalore 431a79ad5c cleaning up for #306 2013-11-11 00:14:23 +01:00
soulgalore 5ba68c2fe8 added version 2013-11-10 22:52:55 +01:00
soulgalore 43a7e28c7b Moving scripts & making paths easier #306 2013-11-10 22:50:02 +01:00