Commit Graph

213 Commits

Author SHA1 Message Date
Jimmy 13249329f7 Greasemonkey: skip window scoping test on webkit
The implementation of Proxy in JSCore used by current QtWebkit (webkit
602.1) doesn't support the `set()` handler for whatever reason. So
instead of testing for a specific behaviour that we can't ensure on that
version let's just skip the tests and handle user complaints with
sympathy.
2018-05-20 18:42:40 +12:00
Florian Bruhin 6f9c62b24a Improve marker descriptions 2018-02-26 07:56:51 +01:00
Jay Kamat 76bf35cbdd
Add qtbug60673 markers to relevant tests 2018-02-25 19:00:15 -05:00
Florian Bruhin 53e7d13c2d Skip failing scrolling tests on Qt 5.10 on Travis
See #3572
2018-02-08 10:42:55 +01:00
Florian Bruhin 20d5b4e384 Update pytest log handling
In pytest 3.4, we now need to explicitly set the log level and caplog.at_level
now sets the level of the root handler.
2018-02-06 23:17:40 +01:00
Florian Bruhin 56759cca6b Make more unit tests run with Qt 5.7.1 on a newer Linux 2017-11-28 08:16:07 +01:00
Florian Bruhin 75555fc244 Fix warning regex 2017-11-21 13:21:50 +01:00
cryzed 222c51aa6e Ignore additional Qt error messages 2017-11-08 16:34:40 +01:00
Florian Bruhin be08cee63c Make testsuite work with LC_ALL=C 2017-11-07 17:23:38 +01:00
Florian Bruhin cbe0ff94a1 Ignore inotify_add_watch Qt warning
This happens on Travis from time to time.
2017-10-13 09:12:31 +02:00
Florian Bruhin cc871389c9 Increase pytest-faulthandler timeout a bit
See #2777
2017-10-04 08:58:35 +02:00
Florian Bruhin 46cfd5353d Use a pytest marker to fake an OS 2017-09-20 11:30:18 +02:00
Florian Bruhin 3772dc5930 Drop legacy QtWebKit support
See #2742
2017-09-18 23:01:17 +02:00
Florian Bruhin 852baaa8c3 Drop support for Qt < 5.7.1
See #2742
2017-09-18 23:01:17 +02:00
Florian Bruhin 5a11c96e56 Don't fail tests because of OpenSSL 1.1 warnings
"Downloading with SSL errors" from downloads.feature still fails, but like this,
at least all other tests pass without the need to modify LD_LIBRARY_PATH.
2017-09-14 18:23:40 +02:00
Florian Bruhin 50aab7a802 Skip tests needing AppDataLocation on older Qt versions 2017-09-13 21:32:22 +02:00
Florian Bruhin f6a0500bd3 Merge branch 'master' into new-config
This pulls the travis changes to drop the old Qt 5.2 environment.
2017-09-11 18:39:41 +02:00
Florian Bruhin 1491f20201 Remove geolocation tests
They just cause more trouble than they're worth.
2017-09-11 18:32:23 +02:00
Ryan Roden-Corrent 6e0f65c063 Remove duplicate line from pytest.ini. 2017-09-07 07:34:26 -04:00
Ryan Roden-Corrent 111846a909 Merge remote-tracking branch 'upstream/master' into configmerge 2017-08-20 21:18:47 -04:00
Florian Bruhin 81b260998d Ignore a new Geoclue error during tests 2017-08-08 06:25:50 +02:00
Ryan Roden-Corrent 71b71dbc58 Merge remote-tracking branch 'upstream/master' into HEAD 2017-08-06 18:13:49 -04:00
Florian Bruhin 79e7eb6495 pytest: Show Median instead of Mean for benchmarks 2017-07-25 17:37:18 +02:00
Florian Bruhin 79c088d3a4 pytest.ini: Add benchmark-columns 2017-07-24 16:52:36 +02:00
Florian Bruhin a3834d043b pytest: Set testpaths 2017-07-19 12:22:30 +02:00
Florian Bruhin ad615941a2 Replace OS X with macOS 2017-07-08 11:12:43 +02:00
Florian Bruhin 378914b327 Ignore another new geoclue error during tests 2017-07-04 18:01:24 +02:00
Florian Bruhin f71e678d80 Ignore a new Geoclue error during tests 2017-07-04 15:09:23 +02:00
Florian Bruhin 79c11d6008 Skip test_configdata.test_init_benchmark on Travis in Docker
See #2777
2017-07-04 15:09:23 +02:00
Florian Bruhin 250da212cd Adjust tests for new QtWebKit-NG 2017-06-09 10:28:41 +02:00
Florian Bruhin 7dba877354 tests: Update "Unable to set geometry" ignore 2017-03-31 13:05:34 +02:00
Florian Bruhin e28eabe5eb Add marker for #2478 2017-03-31 13:03:17 +02:00
Florian Bruhin a3a885f053 Ignore bogus Qt warning during tests 2017-03-31 13:03:17 +02:00
Florian Bruhin 98e1603abb Don't make SSL resolve errors fail tests 2017-02-09 15:19:26 +01:00
Florian Bruhin af40439f4a tests: Ignore more QPainter::end warnings 2017-02-08 15:27:45 +01:00
Florian Bruhin 208ee04bdc Add simple tests for QtWebEngine renderer crash/kill 2017-02-08 09:41:55 +01:00
Florian Bruhin ccb6594e07 Ignore QPainter warning in tests
This happens on Debian Jessie from time to time.
2017-02-08 00:58:41 +01:00
Florian Bruhin 91bdc00410 Make tests work with QtWebKit-NG
Fixes #1571
2017-02-06 08:48:08 +01:00
Florian Bruhin 348a50ad69 Fix inserting text with QtWebEngine
The insertText event doesn't seem to be available with newer Chromium releases,
which means this broke (probably with Qt 5.7.1).

Fixes #2183
Fixes #2217
2017-02-06 08:06:58 +01:00
Florian Bruhin de50f30b9b Replace all GitHub links 2017-02-05 00:13:11 +01:00
Florian Bruhin c7970eb2ee Xfail tests which fail on Docker/Travis
See #2183
2016-12-20 21:32:46 +01:00
Florian Bruhin d04534dc33 Reenable @qtwebengine_createWindow tests
Closes #2121
2016-11-15 07:03:13 +01:00
Florian Bruhin 2ded5ef6dd tests: Get rid of flaky_once mark 2016-11-10 22:45:27 +01:00
Florian Bruhin 40c5c75a6c tests: Add a js_prompt marker 2016-11-10 22:45:27 +01:00
Sebastian Frysztak 97d00b2355 Ignore NetworkManager-related Qt warnings
(discussed in #2016)
2016-10-08 11:10:27 +02:00
Florian Bruhin 861ce478b3 Add a 'this' pytest marker 2016-09-07 20:26:41 +02:00
Florian Bruhin a119e9d5b0 Mark :insert-text with undo test as xfail on OS X 2016-09-07 19:01:24 +02:00
Florian Bruhin 1106104700 Add a @qtwebengine_flaky marker 2016-09-06 21:43:02 +02:00
Florian Bruhin 050507c0a6 Merge branch 'webengine-createwindow' 2016-09-05 17:42:15 +02:00
Florian Bruhin d71aa2c0ba Ignore IMAGEFORMAT_WHITELIST warning in tests 2016-09-05 17:01:55 +02:00
Florian Bruhin cf070d48f2 WebEngine: Disable createWindow for Qt < 5.7.1
Fixes #1911.

The bugfix is backported in my qt5-webengine-debug package, and
QUTE_QTBUG54419_PATCHED can be set to force qutebrowser to use
createWindow.
2016-09-05 15:08:00 +02:00
Florian Bruhin 6c6e98aac4 Add a @qtwebkit_skip marker 2016-09-05 15:08:00 +02:00
Florian Bruhin 8d381aaa01 tests: Improve @qtwebengine_* markers
This uses xfail for @qtwebengine_todo and adds a new @qtwebengine_skip
marker.
2016-08-18 18:16:33 +02:00
Florian Bruhin e10b7ba8ab tests: Add @qtwebengine_todo marker 2016-08-18 13:05:37 +02:00
Florian Bruhin dc87e66d75 tests: Ignore "Error when parsing the netrc file"
qutebrowser shows this on an invalid ~/.netrc when testing
authentication, but that shouldn't fail our testsuite.
2016-08-16 19:56:49 +02:00
Florian Bruhin b00e90defb Remove SelectionRequest blacklist for pytest
It's now hidden globally anyways.
See #1287.
2016-08-05 08:32:23 +02:00
Florian Bruhin e5e2a6a943 pytest.ini: Get rid of qt_wait_signal_raising
This is now the default; see #1702
2016-07-29 09:12:06 +02:00
Florian Bruhin 7605a4fb0c tests: Use pytest-warnings to handle warnings 2016-07-27 18:28:08 +02:00
Florian Bruhin 37c6d63ddf tests: Ignore "load glyph failed" warnings
See #1637
2016-07-12 09:45:40 +02:00
Florian Bruhin 8d9a699b5b test requirements: Update to pytest-bdd 2.17.0
This also allows us to have dynamic pyqt>=5.3.1 etc. tags.
2016-06-30 14:02:30 +02:00
Florian Bruhin 87496617a4 Hide QtWebKit image format warning
This was hidden for tests in c390c797b2
but should be hidden for normal usage as well.
2016-06-28 20:46:06 +02:00
Florian Bruhin 522b938974 pytest: Remove unnecessary norecursedirs 2016-06-17 11:56:43 +02:00
Florian Bruhin c390c797b2 tests: Ignore QtWebKit image format warning
In "Cancelling a MHTML download (issue 1535)" (downloads.feature) we
load an invalid page as a fake "image". With Qt 5.6.1, we get this
warning then.
2016-06-09 14:48:38 +02:00
Florian Bruhin 9e1d20017c tests: Mark "History with an error" as flaky
For some reason, sometimes on Travis the history file we read is empty.
I have no idea why though, as we successfully wait until ":save saved
history" is logged, and that is working fine.

Let's just mark the test as flaky for now so we can move on.
2016-06-09 11:17:18 +02:00
Florian Bruhin 97ad808fac Remove unneeded marker definitions from pytest.ini
Those are now defined in pytest core or pytest-rerunfailures
2016-05-31 23:45:12 +02:00
Florian Bruhin 64d4c9f83e Clean up end2end test file structure
This renames tests/integration to tests/end2end and moves some files to
tests/end2end/fixtures.
2016-05-29 18:20:00 +02:00
Florian Bruhin 38ac95d907 Revert "pytest.ini: Remove registration of flaky marker"
This reverts commit 0f5b4d58e2.

Seems this is needed when freezing, otherwise we get a "'flaky' not a
registered marker" error despite the plugin being installed.

Conflicts:
	pytest.ini
2016-03-02 08:05:15 +01:00
Florian Bruhin 4314d6420b pytest: Don't show skipped test summaries by default 2016-03-02 07:27:25 +01:00
Florian Bruhin 9efae021fa Set xfail_strict=true for pytest 2016-03-02 07:14:50 +01:00
Florian Bruhin 48f87d1656 Revert "Use pytest-platform-markers"
This reverts commit 2e12fb3c65.

It seems like it's currently broken...
2016-02-27 02:45:34 +01:00
Florian Bruhin 0f5b4d58e2 pytest.ini: Remove registration of flaky marker
It's already registered by the plugin.
2016-02-27 02:40:30 +01:00
Florian Bruhin 2e12fb3c65 Use pytest-platform-markers 2016-02-27 00:26:24 +01:00
Florian Bruhin f64916b516 Only run geolocation tests on CI
Trying to get the device location while running the tests can trigger all kind
of funny effects.

Since we can't easily mock the GPS responses, we only run those on the CI where
we at least have some predictable setup.

Fixes #1297.
2016-02-21 17:24:33 +01:00
Florian Bruhin 5c617b861c Switch to pytest-xvfb. Fixes #1309. 2016-02-16 20:36:23 +01:00
Florian Bruhin 5ae677376b Rerun TestPyQIODevice.test_qprocess if needed.
This adds a new pytest-rerunfailures dependency. For some reason, that test
sometimes fails with an empty string read, and I can't tell why.
2016-02-08 06:54:47 +01:00
Florian Bruhin 2ba2b38277 tests: Ignore new Qt warnings.
It seems since the recent QClipboard changes we get a new warning
"QXcbClipboard: Cannot transfer data, no data available" in some tests.

This ignores the warning, let's hope the tests still work.

See #1285.
2016-02-03 08:11:18 +01:00
Florian Bruhin e9662b71f0 Move pytest arguments to pytest.ini.
Closes #1260.
2016-01-24 21:10:22 +01:00
Florian Bruhin 44a096012b tests: Ignore another Qt warning. 2016-01-24 19:34:00 +01:00
Florian Bruhin 785e2052f6 Ignore 'Method "GetAll"' Qt warning with escapes.
For some reason, since some time this message appears with those escapes in it.
2016-01-24 19:13:11 +01:00
Florian Bruhin 1952e070fd Initial switch to flake8. 2016-01-22 17:33:58 +01:00
Florian Bruhin d4e2ece38b bdd: Ignore QGeoClue errors.
The geolocation tests emitted those errors on the Archlinux buildbot:

    QGeoclueMaster error creating GeoclueMasterClient.
    Geoclue error: Process org.freedesktop.Geoclue.Master exited with status 127

I don't really know what they mean, but let's see if the test passes now.
2016-01-14 19:06:36 +01:00
Florian Bruhin 14ff684e99 bdd: Add a xfail_norun marker. 2016-01-14 07:53:00 +01:00
Florian Bruhin 22d255f49f bdd: Skip JS prompt() tests on PyQt < 5.3.1.
Those versions had a PyQt bug when overloading javaScriptPrompt, so we don't do
that there.
2016-01-12 09:04:03 +01:00
Florian Bruhin 1fb34331e5 tests: Default to raising=True for qtbot.
- qtbot.waitSignal with raising=True is the default this way, so we remove the
  raising=True.
- qtbot.waitSignal with raising=False stay untouched
- Some qtbot.waitSignal without raising had one added (because we don't want it
  to raise)
- Some qtbot.waitSignal without raising actually should've raised, which they
  do now.
2016-01-08 09:49:06 +01:00
Florian Bruhin 1619b89df7 pytest: Add a skip mark for use with bdd. 2016-01-06 07:14:30 +01:00
Florian Bruhin fc84e58043 tests: Ignore "SelectionRequest too old" globally.
If we use pytestmark, it won't be ignored inside subprocess output, so our fix
from https://github.com/The-Compiler/qutebrowser/issues/1124#issuecomment-158073581
never actually worked.

See #1124 and #1183.
2015-12-17 22:33:07 +01:00
Florian Bruhin 7b5f51b145 tests: Ignore empty $XDG_RUNTIME_DIR error.
For some reason it's unset for the buildbot on Ubuntu Trusty, and it shouldn't
matter.
2015-12-15 17:53:36 +01:00
Artur Shaik 73f999da31 Revert a43c206 and b344f92. 2015-11-28 21:29:54 +06:00
Florian Bruhin a43c206893 Mark some caret tests as xfail on Windows/OS X.
See #1142.
2015-11-27 14:39:33 +01:00
Florian Bruhin 542d13b70d tests: Add a not_xvfb marker. 2015-11-24 16:17:07 +01:00
Florian Bruhin 2727f3c2a8 Hide QObject::connect stateChanged warning. 2015-11-20 22:01:21 +01:00
Florian Bruhin cfea69494a tests: Ignore stateChanged Qt warning. 2015-11-15 16:38:56 +01:00
Florian Bruhin 5e38861649 Fix warning regex in pytest.ini. 2015-11-09 22:12:10 +01:00
Florian Bruhin 41f7c11ab5 tests: Ignore XSETTINGS_S atom warning. 2015-11-09 19:55:32 +01:00
Florian Bruhin f5eb755ef3 tests: Ignore some Qt warnings during teardown. 2015-11-03 06:38:48 +01:00
Florian Bruhin a1b394d373 tests: Ignore "QNetworkReplyImplPrivate::error". 2015-11-02 08:09:07 +01:00
Florian Bruhin c335aff900 Revert "Add pytest-timeout."
This reverts commit 8919a152fe.

Seems to cause more trouble than it's worth... bogus timeouts on OS X and
Windows, with Windows then hanging...
2015-10-26 08:53:55 +01:00
Florian Bruhin 8919a152fe Add pytest-timeout. 2015-10-26 07:33:32 +01:00
Florian Bruhin 228b4104b0 tests: Ignore type conversion messages. 2015-10-05 08:22:53 +02:00
Florian Bruhin b863c9807b Fix warning pattern, take two. 2015-10-02 10:59:11 +02:00
Florian Bruhin 8cdbd2a15f Fix pattern for QSslSocketBackendPrivate warning. 2015-10-02 10:47:44 +02:00
Florian Bruhin b88a22b139 tests: Add a not_osx platform marker. 2015-10-02 08:51:40 +02:00
Florian Bruhin 985c067f90 tests: Ignore another SSL Qt warning on OS X. 2015-09-29 21:31:00 +02:00
Florian Bruhin d887bbeb24 Revert "standarddir: Fix runtime basedir test on OS X."
This reverts commit 46ac1e2bf90f1c74a1cc502e08b717715b90eb39.
2015-09-15 22:31:37 +02:00
Florian Bruhin 89b4adf158 standarddir: Fix runtime basedir test on OS X. 2015-09-15 22:31:37 +02:00
Florian Bruhin c8f69d29a8 tests: Ignore SSLRead warning on OS X, take 3. 2015-09-09 22:05:48 +02:00
Florian Bruhin 7dedf73ea4 tests: Fix ignored SSLRead warning on OS X. 2015-09-09 17:50:09 +02:00
Florian Bruhin 9229957b93 tests: Ignore QSslSocketBackendPrivate warning.
This apparently happens during test_split_hypothesis:test_simple_split[1-True]
for @acogneau.
2015-08-25 22:11:29 +02:00
Florian Bruhin 14545a3a22 Mark some tests as integration and no coverage. 2015-08-11 19:36:27 +02:00
Florian Bruhin 68512ce2cd Ignore DBus warning message for tests. 2015-08-01 13:50:39 +02:00
Florian Bruhin 694fbe053d Fix lint. 2015-07-24 18:11:52 +02:00
Florian Bruhin f19ba277d6 tests: Ignore QProcess warning. 2015-07-24 14:56:00 +02:00
Florian Bruhin 474255cbe7 Move pytest options to pytest.ini. 2015-07-19 21:56:09 +02:00