130 Commits

Author SHA1 Message Date
Steve Langasek
173deaff39 Support setting test results in swift and sqlite3 simultaneously 2021-10-07 00:41:56 +00:00
Steve Langasek
af8890bc4b Preliminary code to make autopkgtest policy download autopkgtest.db
Include test to assert britney failure if the database is unavailable
2021-10-07 00:41:56 +00:00
Steve Langasek
0b4cd56d68 Initial infrastructure for testing db-based autopkgtest results 2021-10-07 00:41:56 +00:00
Iain Lane
e871a3993d autopkgtest: Add back hack to only trigger selected tests for gcc-N
We might want to consider doing this in a more generic way.
2020-11-20 17:37:44 +00:00
Iain Lane
a5828a269e excusefinder: Support not having arch-all buildds
On some distros (Ubuntu), arch:all packages are built along with one of
the architectures. We shouldn't be listing 'all' as its own arch in this
case. Instead we filter out the binaries except for on the
'all_buildarch'.
2020-11-20 17:37:44 +00:00
Iain Lane
15f431d37c autopkgtest: Add new force-reset-test hint type
This allows hinters to reset the baseline for a package/arch, so that
previous failures are ignore and not considered regressions
2020-11-20 17:37:44 +00:00
Iain Lane
e5b7f5f539 autopkgtest: Support autopkgtest.u.c in-progress URL
This is at /running. We use 'are we running on swift?' as a proxy for
deciding which URL format to use
2020-11-20 17:37:44 +00:00
Iain Lane
af085da46e autopkgtest: Handle 'blacklisted' version
The apt version comparison sorts 'blacklisted' greater than most version
numbers, which means that we accidentally apply force hints for version
'blacklisted' to all uploads. Since this is the only case of a hacked
version number, let's special case it so that 'blacklisted' hints only
match packages with 'blacklisted' version.
2020-11-20 17:37:44 +00:00
Iain Lane
34c8b05010 autopkgtest: store the submission time when making requests
This is so that we can see more easily see if requests are stuck
2020-11-20 17:37:44 +00:00
Iain Lane
2623053f82 test_autopkgtest: Re-enable test for package not built on arch
This is a test carried over from Ubuntu which ensures that a package
which builds no binaries on an arch doesn't have tests requested.

It was disabled. Enable it.
2020-11-20 17:37:44 +00:00
Iain Lane
af091a504c autopkgtest: Trigger dkms when there's a dep on dkms
Most DKMS packages do not declare Testsuite: autopkgtest-pkg-dkms, but
we can detect this anyway, and this way we can enforce that the module
is buildable.
2020-11-20 17:37:44 +00:00
Łukasz 'sil2100' Zemczak
d960c15706 Add a new policy to message bugs on SRU regressions
It works like this. We wait until all tests have finished running. and
then grab their results. If there are any regressions, we mail each bug
with a link to pending-sru.html. There's a state file which records the
mails we've sent out, so that we don't mail the same bug multiple times.
2020-11-20 17:37:44 +00:00
Tiago Daitx
256a48a4ad Link to update-excuse bugs on update_excuses
LP: #1683749
2020-11-20 17:37:44 +00:00
Iain Lane
bae4fdbd45 LinuxPolicy: Make linux* wait on corresponding -meta package
We want to treat linux-$flavor and linux-meta-$flavor as one set in
britney which goes in together or not at all. We never want to promote
linux-$flavor without the accompanying linux-meta-$flavor.

Add a new LinuxPolicy which runs after most of the other policies, which
invalidates linux-foo if linux-meta-foo is invalid.
2020-11-20 17:37:44 +00:00
Robert Bruce Park
36e8b65c8b Email Policy, send emails when packages are rejected. 2020-11-20 17:37:44 +00:00
Robert Bruce Park
9c777eac1b Reject packages if entire source ppa won't migrate 2020-11-11 09:41:40 +00:00
Iain Lane
d2dbdadf1f autopkgtest: Hardcode some linux-meta tests
We should really fix this to use Testsuite-Triggers / hint-testsuite-triggers
2020-11-11 09:41:40 +00:00
Iain Lane
7ed335893e Implement Ubuntu component relationship constraints (ogre model) 2020-11-11 09:41:40 +00:00
Iain Lane
3fa9eceb89 Store the component in BinaryPackage and SourcePackage 2020-11-11 09:41:40 +00:00
Colin Watson
4f9a33ddab Allow blocking uploads by way of bugs with the block-proposed tag set 2020-11-11 09:41:40 +00:00
Iain Lane
1487096a15 test_autopkgtest: Split setup commands into a separate class
This lets other policies share this code for their integration tests
2020-10-20 14:57:51 +01:00
Colin Watson
4e59e3fb6a Change date format to seconds-since-epoch 2020-10-20 14:57:51 +01:00
Paul Gevers
dc4ea6ca2c
autopkgtest: remember old results instead of discarting them
For packages with lots of reverse dependencies, new versions of those reverse
dependencies may keep on showing up in testing. If migration is blocked until
the results for these new version, migration may take extremely long. If there
are results for the current trigger but for the previous version of the reverse
dependency, use those until the fresh resuts are available.

Similar for the reference runs.
2020-05-01 21:34:30 +02:00
Paul Gevers
ea6d65f657
Let britney reschedule migration-reference/0 runs when they are too old
Currently, britney only schedules reference runs when they don't exist. It does
strip out runs against older versions of the autopkgtest, but the current version
may exist for a while and the reference run can be old. So, add an option to
ignore old results.
2020-02-20 13:21:36 +01:00
Paul Gevers
aa8b84f4b8
Drop the special case that gcc has; it's just a package 2020-02-20 11:24:27 +01:00
Paul Gevers
56babea058
Don't run autopkgtest on architectures where the triggering package doesn't exist 2020-02-14 22:47:03 +01:00
Ivo De Decker
237c5d7357 fix test_autopkgtest tests 2020-01-30 18:41:39 +01:00
Ivo De Decker
dfd0973a64 fix test_policy tests 2020-01-30 18:41:39 +01:00
Ivo De Decker
001e18a2f4 fix test_yaml tests 2020-01-30 18:41:39 +01:00
Ivo De Decker
1a33ee9ebc installability/tester.py codestyle fixes 2020-01-30 18:41:39 +01:00
Ivo De Decker
0c66464fd5 hints.py codestyle fixes 2020-01-30 18:41:39 +01:00
Paul Gevers
455d962ebd Update test_autopkgtest.py for previous commit 2020-01-30 18:41:39 +01:00
Paul Gevers
b380508635
Drop dkms auto-detection for autodep8 as it isn't opt-in
Because autopkgtest failure in a package is now a serious bug (RC), packages
that don't opt-in should not be tested. Due to the way autopkgtest and autodep8
work together, package that don't declare they have an autopkgtest can still be
tested. However, maintainers should not be force to say their package doesn't
work with autodep8 by introducing a fake test.
2019-11-18 20:48:49 +01:00
Ivo De Decker
f202601b81 fix codestyle issue in test_autopkgtest.py
This issue only shows up in the bullseye test.
2019-09-04 12:02:52 +00:00
Ivo De Decker
2bde180d18 fix codestyle issues in policies/__init_.py 2019-09-04 11:44:15 +00:00
Ivo De Decker
a1debec1a8 fix codestyle issues in excusefinder.py 2019-09-04 11:44:15 +00:00
Ivo De Decker
3f9092f94b fix codestyle issues in excuse.py 2019-09-04 11:44:14 +00:00
Ivo De Decker
19392f63c2 fix codestyle issues in policy_.py 2019-09-03 23:50:00 +02:00
Ivo De Decker
5890cb914e Fix codestyle issues is britney.py
Signed-off-by: Ivo De Decker <ivodd@debian.org>
2019-09-02 22:22:04 +00:00
Paul Gevers
747c67854a
tests: use yaml.safe_load as yaml.load is deprecated 2019-08-25 20:47:14 +02:00
Paul Gevers
964ecaf045
tests: add the suite to debci results 2019-05-18 21:40:26 +02:00
Niels Thykier
c741b03aaf
Make PolicyVerdict ordered/comparable
This shortens the annyoing "a.value < b.value" to "a < b".

Signed-off-by: Niels Thykier <niels@thykier.net>
2019-03-06 19:07:17 +00:00
Paul Gevers
ccc1c25f61
Fix pycodestyle issues in test_policy.py 2019-02-07 19:46:37 +01:00
Paul Gevers
e8b5f5e631
Fix loads of pycodestyle issues in test_autopkgtest 2019-02-07 19:17:16 +01:00
Paul Gevers
7611231ee2
Fix all pycodestyle issues in b/p/autopkgtest.py 2019-02-07 13:35:52 +01:00
Paul Gevers
992b27abb3
autopkgtest: retrigger old failures 2019-02-07 13:35:52 +01:00
Paul Gevers
42ac9c34a1
autopkgtest: add timestamp to results 2019-01-31 15:37:13 +01:00
Niels Thykier
f4ecd86000
Pass migration items to policies (instead of src + suite)
Signed-off-by: Niels Thykier <niels@thykier.net>
2019-01-27 09:52:33 +00:00
Niels Thykier
6dde43a339
Create an ExcuseFinder class for computing relevant excuses
Signed-off-by: Niels Thykier <niels@thykier.net>
2019-01-27 06:58:00 +00:00
Niels Thykier
3de7816fd2
tests: Fix test broken by refactoring
Signed-off-by: Niels Thykier <niels@thykier.net>
2019-01-19 22:22:42 +00:00