931 Commits

Author SHA1 Message Date
Iain Lane
f63ec075f4
Drop ppc64el from results for uninstallable test, not needed 2020-04-16 15:27:03 +01:00
Iain Lane
865ac5d5f1
autopkgtest: If there are unsatisfied deps on non-adt arches, still request the test
We still want to be blocked by other parts of britney, but we can run
the tests to see their results now.
2020-04-16 15:27:03 +01:00
Iain Lane
eee029b353
tests: Allow the same package to be added on different arches
So we can make uninstallable packages on some arches only
2020-04-16 15:27:03 +01:00
Iain Lane
da67cc10b9
autopkgtest: Don't block packages in BREAK_ARCHES
We currently reject packages which have *any* unsatisfiable
dependencies, which is more strict than britney itself.
2020-04-16 15:27:03 +01:00
Iain Lane
648b63cb1e
britney.conf: Add riscv64 to ARCHITECTURES / BREAK_ARCHES / NEW_ARCHES 2020-04-16 11:09:00 +01:00
Steve Langasek
dc624622c1 force harder on sourceppa.
We need the force hinting here to modify the real excuses, otherwise it
comes back around later.
2020-04-13 23:44:12 -07:00
Steve Langasek
79d1bdec0b check for force hints as part of the source ppa policy
If our policy marks a bunch of related packages here as non-candidates, a
force hint processed later for the package which was not a candidate is
insufficient.  Instead, check here for a force hint that would
unconditionally mark a package a candidate before marking related packages
as non-candidates.
2020-04-13 18:56:38 -07:00
Iain Lane
a46ea8d3e5
autopkgtest: Add some retry logic 2020-03-31 09:30:50 +01:00
Iain Lane
63324d48a8
autopkgtest: Re-use the HTTP connection between requests to swift
This requires porting to python3-requests, as requests has built-in
Keep-Alive support.
2020-03-25 12:16:07 +00:00
Iain Lane
b9747f3b23
autopkgtest: Log force-reset-test hints too 2020-02-06 12:13:26 +00:00
Iain Lane
45cc7b4366
force-reset-test tests: Add a test for reset-test with a different trigger 2020-02-06 11:35:16 +00:00
Iain Lane
70ede93f64
force-reset-test: Make the hint apply 'backwards' too
If we're force-reset-test foo/N, we should consider all versions up to
and including N as ALWAYSFAILED.
2020-02-06 11:35:16 +00:00
Iain Lane
9d541b4f5c
bikeshedding: call it force-reset-test 2020-02-06 11:35:16 +00:00
Julian Andres Klode
1f95e65860
Allow marking a version as accepted regression
LP: #1688516
2020-02-06 11:35:16 +00:00
Steve Langasek
2163d2be80 test case for not running tests on dropped arch 2020-01-20 21:37:51 -08:00
Steve Langasek
586083acfa Don't trigger tests on an arch the triggering package has no binaries for
If reverse-dependencies of this package still exist on the architecture, these
would be captured as uninstallables; we don't need to additionally trigger
tests that can never succeed, would tell us nothing about the package if they
did, and will just cause more work to hint away the results.
2020-01-17 09:04:33 -08:00
Iain Lane
858c47ea26
LPExcuseBugs: Don't try to interpolate a string when we didn't want one 2020-01-17 17:00:04 +00:00
Steve Langasek
356d9ceee4 Merge remote-tracking branch 'origin/fix-tests' 2020-01-16 16:16:55 -08:00
Steve Langasek
3c4942fcd2 Minimal fixes to make .travis.yml usable 2020-01-16 16:16:35 -08:00
Iain Lane
177c7a69f7
test_autopkgtest: Strip submit-time
Testsuite regression from 4c27eadffa01bc1c084e947a7fa1e8a7509d1653.

submit-time is the time the request was submitted to amqp. For tests
it's the time the testcase was run. Many of our testcases test the exact
parameters that were passed to amqp, so they now fail because
submit-time is in there but it's not being checked for. It would be
possible to either verify the submit-time too, or switch to fuzzy
matching - but it's actually not very valuable to test submit-time,
since it is only for human readers of autopkgtest-cloud log files or
autopkgtest.ubuntu.com/running.

Instead strip the field from the amqp parameters before any tests see
them.
2020-01-16 10:13:41 +00:00
Iain Lane
d592ee61ae
LPExcuseBugsPolicy: handle the ExcuseBugs file not existing
When we're not run via b1 - for example when running the testsuite -
this file will not have been created.

Treat that as if there are no bugs to note.
2020-01-16 10:12:19 +00:00
Iain Lane
4c27eadffa
autopkgtest: store the submission time when making requests
This is so that we can see more easily see if requests are stuck
2019-11-12 23:46:30 +00:00
Tiago Daitx
da5770559c Link to update-excuse bugs on update_excuses
LP: #1683749
2019-09-17 11:53:07 +02:00
Łukasz 'sil2100' Zemczak
aa880c0d38 SRU ADT regression: add newlines to the list of failures. 2019-08-29 14:30:53 +02:00
Łukasz 'sil2100' Zemczak
36047784d9 SRU ADT regression: use the SRU team special bot-account for sending notifications. 2019-08-29 09:34:43 +02:00
Łukasz 'sil2100' Zemczak
32467742bd SRU ADT regression: use the right policy_info to determine if tests have regressed. 2019-08-28 18:29:45 +02:00
Iain Lane
879e7e1088
email: Add more debugging when sending emails
We're currently spamming an uploader, and it's hard to figure out why.
Let's output why we are deciding to do so.
2019-08-12 15:27:58 +01:00
Łukasz 'sil2100' Zemczak
e51cc58a2b Switch logic of detecting failures to looking for failed tests in policy_info. Explicitly list all failing tests in the bug comment. Change wording. 2019-07-19 15:43:54 +02:00
Steve Langasek
66036553ac Trigger linux rebuild test on upload of gcc-defaults
The update of gcc to gcc-9 introduced a regression in buildability of
anything relying on kernel headers.  This could have been caught by the
kernel's standard rebuild autopkgtest, but we currently only trigger the
linux autopkgtest for source packages named gcc-N, which excludes
gcc-defaults.

Include gcc-defaults in the list of packages that trigger a linux rebuild
test.

Bug-Ubuntu: https://bugs.launchpad.net/bugs/1836100
2019-07-10 14:30:28 -07:00
Łukasz 'sil2100' Zemczak
316fad3442 SRU ADT regression: temporarily use my e-mail in the From: header. 2019-06-25 18:49:38 +02:00
Łukasz 'sil2100' Zemczak
d21bd600cc SRU ADT regression: handle errors in sendmail. 2019-06-25 16:16:26 +02:00
Łukasz 'sil2100' Zemczak
1cbc21d258 SRU ADT regression: Fix state checking as now it again needs to include the info for distro and series. Add unit test. 2019-05-24 16:18:34 +02:00
Łukasz 'sil2100' Zemczak
49e3d7e51c SRU ADT regression: Remove the no-longer-needed state-file backup functionality as currently there's basically low risk that we'd crash mid-state-save. Add a test for this. 2019-05-23 19:08:29 +02:00
Iain Lane
c8492d4cc7
SRU ADT regression: Need to decode the returned bytes from urlopen() 2019-05-23 10:47:59 +01:00
Iain Lane
73dabf2136
SRU ADT tests: Fix tests after the previous changes
This is the problem when implementing to a mock...
2019-05-23 10:38:58 +01:00
Iain Lane
f10caba01d
SRU ADT regression: Handle unset changes_url (e.g. for syncs) 2019-05-23 10:27:24 +01:00
Iain Lane
c49f1ad8d5
SRU ADT regression: src is a dict 2019-05-23 10:26:22 +01:00
Iain Lane
34bd0d2706
Add config entry for SRU regression emails
Also rename the key to SRUREGRESSIONEMAIL_ENABLE, since
SRUREGRESSION_ENABLE sounds like we're turning off the regressions
themselves. If only. 😜
2019-05-23 10:02:33 +01:00
Iain Lane
bb032d98d8
SRU ADT: Be clear when printing log messages in dry-run mode 2019-05-22 17:47:29 +01:00
Iain Lane
c1f8ab2f9c
SRU ADT tests: Be more idiomatic
Use @patch decorator instead of ExitStack context manager. This is more
consistent with the rest of the testsuite we have in britney.

Use some more idiomatic assertions, e.g.
unittest.mock.assert_not_called().
2019-05-22 17:47:18 +01:00
Łukasz 'sil2100' Zemczak
1690624d11
Add a new policy to message bugs on SRU regressions
It works like this. We wait until all tests have finished running. and
then grab their results. If there are any regressions, we mail each bug
with a link to pending-sru.html. There's a state file which records the
mails we've sent out, so that we don't mail the same bug multiple times.
2019-05-22 17:47:17 +01:00
Łukasz 'sil2100' Zemczak
daaadf5bbd Re-add missing SRU members to the britney.conf hint permissions. 2019-02-20 16:09:26 +01:00
Iain Lane
c12d92efa4
autopkgtest: Handle 'blacklisted' version
The apt version comparison sorts 'blacklisted' greater than most version
numbers, which means that we accidentally apply force hints for version
'blacklisted' to all uploads. Since this is the only case of a hacked
version number, let's special case it so that 'blacklisted' hints only
match packages with 'blacklisted' version.
2019-01-24 13:08:03 +00:00
Iain Lane
bbabac140d
Repair requests without testpkg-version
We're supposed to synthesise an "unknown" version for these, but a bug
in the worker meant we didn't do that in some cases and these leaked
into swift. Let's repair it client-side.
2019-01-21 11:20:27 +00:00
Iain Lane
0ff44d90e7
autopkgtest: Handle status '8' as a pass
This means 'all tests were skipped', or 'no tests in this package'. The
former case is new after our recent autopkgtest rebase.

Upstream britney (624b185ba60709f1686fbaa2a7623a94c5cb23ef) handles this
as "neutral", which doesn't influence the result and is a more explicit
(better) way of expressing this situation. Once we rebase, we should
take that approach.
2018-12-11 09:44:55 +00:00
Iain Lane
73b4c3b065
autopkgtest: put delivery_mode in the right place 2018-12-06 14:18:19 +00:00
Iain Lane
f8bfbfe164
autopkgtest: Make pycodestyle clean (--ignore=E501,W504) 2018-12-06 09:48:30 +00:00
Iain Lane
62ca3b16b9
autopkgtest: Publish AMQP messages persistently
We want to ask the broker to write them out to disk, hoepfully
mitigating against it crashing.
2018-12-06 09:35:39 +00:00
Steve Langasek
9f91c536be gzip doesn't use libgcc so is not a useful smoketest. Use doxygen instead. 2018-12-06 11:05:52 +02:00
Steve Langasek
dd815d14fa Replace libreoffice with gzip as the libgcc smoke test for gcc.
Bug-Ubuntu: https://bugs.launchpad.net/bugs/1793260
2018-12-05 16:09:57 +02:00