ceb4626cd6
Use internal unittest mock version
9 years ago
0dfde694a9
make tests/test_* executable
10 years ago
39dc24ec71
Change autopkgtest tests to check YAML instead of HTML
...
Matching the HTML for regexps does not work reliably when we have multiple
unstable packages of which only some are valid candidates but others aren't. It
also imposes a too strict test on the particular formatting when we are only
interested in the actual data and structure.
So move towards checking the machine parseable YAML instead and read that into
a proper Python dict.
This exposed a bug uncovered by test_rdepends_unbuilt() which we previously
missed because we couldn't check triggered tests per package.
10 years ago
32f33baf09
Merge with trunk, port to Python 3
10 years ago
1d4eab951e
Add autopkgtest tests for hints
10 years ago
48905892c8
Drop obsolete adt-britney autopkgtest code
...
Now that we look at autopkgtest results from swift we can drop the
adt-britney/lp:auto-package-testing code from autopkgtest.py.
Note that we still need it for boottest.py.
Adjust TestBoottestEnd2End.test_with_adt() for cloud results.
10 years ago
69bf766a7a
test_boottest.py: PEP-8 fixes
10 years ago
65a1d73164
tests: Don't touch original britney.conf
...
Don't change britney.conf from the source tree and restore it back after the
tests; this is prone to leave a broken config behind if a test gets
interrupted. Instead, copy the file to our temp dir, and let tests hack on it
there.
(Introduced in lp:~canonical-ci-engineering/britney/boottesting-support)
10 years ago
ca1fc41f9e
Refactor the __fetch_manifest() code so that the a successful response is immediately handled and we don't end up with an undefined 'response' on an exception. Also update the tests to return two mocked reponses to match the size of the url_list.
10 years ago
ea6493ae71
Only enable BOOTTEST for testing, so britney.conf is safe on trunk.
10 years ago
c76874fda5
Test ADT & BootTest criteria running simultaneously. Fixed minor issue related to doubling-blocking promotions.
10 years ago
341ec4a3e0
Typo fixed
10 years ago
bf8056a061
Cope with missing/broken results due to outdated apt cache. Britney will not fail, but source promotion will be blocked.
10 years ago
496a2f3134
Suppress boottest SKIPPED notice on excuses, it's unnecessary noise.
10 years ago
b9890e1b7c
Adding links to the boottest jobs (results) in the public and the private servers.
10 years ago
011aa3570e
Stop announcing skipped boottest attempts.
10 years ago
a80a1e4f1c
Boottest integration adjustments.
10 years ago
c3c9005d5f
Restore boottest status lookup by source name & version.
10 years ago
6269f50abc
Don't bother creating another mocked urllib.urlopen.
10 years ago
760d08c459
Fix BootTest.get_status to return status for the latest known version. Boottests results are reported for the current (published) version, not the proposed one.
10 years ago
f0a55936f5
boottest - Add exception message to warning print and fix typo
10 years ago
87ccbfd731
boottest - Add exception handling for manifest fetching
10 years ago
72b01f8cc7
Using addCleanup() for restoring original configuration contents in tests.
10 years ago
6e8e2adc35
Fix autopkgtest tests, extending the current test setup to mangle the shared configuration file appropriately for each test context (autopkgtest & boottest).
10 years ago
df62c7fcf7
solve '~' expansion for tests.
10 years ago
8ffc7049b5
Test fixing (proposal)
10 years ago
01fdb16995
According to cjwatson, cdimage deals with projects, not distribution, fix TouchManifest accordingly.
...
Fix boottest-britney location to match production.
Fix TestTouchManifest test failures, now that we retry on manifest download errors, the tests should inhibit the retries when testing the failures.
5 out of the 8 TestBoottestEnd2End are still failing because the excuse says the tests are skipped instead of running/failing/being in progress, etc.
10 years ago
82b1c1cd83
Adjusting boottest-jenkins arguments to match reality.
10 years ago
436dadae0a
Cleanup the boottest-britney testing script to reflect better its real behavior.
10 years ago
1e8dc398e9
Merge the boottest-jenkins script wrapper into BootTest class for simplicity and extend the API to match what we already for auto-package-testing (ADT).
10 years ago
06ea2ab941
Request boottests for sources, not binaries. Jenkins glue will drive adt properly.
10 years ago
49f0a5b3ff
Wraps 'boottest-britney' script for checking status or submitting new jobs.
10 years ago
37bd9924f7
Introduce BOOTTEST_FETCH configuration option for enabling/disabling TouchManifest auto-fetching feature, for faster and isolated tests.
10 years ago
056a0f6d37
Handle boottest like autopkgtest and remove boottest config file
10 years ago
2e5084ee79
boottest - Fetch manifests dynamically but use cached manifests if the fetch fails
10 years ago
913539ffe9
Allow hints for ignoring boottest results (force and force-skiptest).
10 years ago
eeaf8e3deb
Silently skipping boottesting for sources not yet built on the allowed architectures (all and armhf).
10 years ago
ed31f1129b
Cosmetic changes for adding excuse labels (html) and more readable image manifest path.
10 years ago
cc9097e2ed
Check phone-image presence for all binary files for the give excused sourcename. Tests improved.
10 years ago
599fda8505
Basic (and ugly) phone image manifest wrapper.
10 years ago
f7e1fa67c0
Implementing boottest entry points for checking phone-image presence and test current status.
10 years ago
fe5f4c09ac
Very basic bootstack testing criteria support.
10 years ago
Didier Roche
Martin Pitt
Francis Ginther
Celso Providelo
Joe Talbott
Vincent Ladeuil