Niels Thykier
97d707e5c0
britney: Avoid some references to britney.{sources,binaries}
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-07-29 09:27:20 +00:00
Niels Thykier
6c6b8fcb96
policies: Make policies suite name agnostic
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-07-29 09:23:12 +00:00
Niels Thykier
54e5eb0e74
policies: Use suite class instead of suite name
...
When determining whether a policy applies to a given item, use the
suite class rather than the suite name.
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-07-29 09:23:12 +00:00
Niels Thykier
37f02d611c
Revert "Rename autopkgtest related hints"
...
This reverts commit a07fa9f9070fc9c328021db5cc3e4c4f3063798e.
The new names are just as unhelpful and confusing as the old ones.
Undo for now.
2018-07-25 18:17:36 +00:00
Niels Thykier
a07fa9f907
Rename autopkgtest related hints
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-07-25 16:51:03 +00:00
Paul Gevers
bfa5c9f191
Don't show excuses for packages that are PASS, NEUTRAL, RUNNING-ALWAYSFAIL or ALWAYSFAIL
2018-07-25 18:06:29 +02:00
Paul Gevers
0da1e4d589
autopkgtest: Drop broken reference update
...
1) the update didn't happen for all but the first
2) we don't want a package that fixes a regression in unstable to influence the
reference for another package until it actually migrates, so this updating
is flawed.
2018-07-21 13:21:39 +02:00
Paul Gevers
624b185ba6
autopkgtest: enable NEUTRAL state for the case where all tests were skipped (or none available)
...
Closes : #901847
2018-07-21 13:21:39 +02:00
Paul Gevers
8bbe112735
Rephrase 'Always failed' as it is confusing in Debian
2018-07-21 10:28:17 +02:00
Niels Thykier
e51a3b91ff
autopkgtest.py: Avoid unnecessary indirection
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-05-06 06:51:47 +00:00
Niels Thykier
d3638cc08f
Make adt_baseline config optional
...
Given that only one value is defined ("reference"), it is a better
option to allow the config to be unset when one does not want to have
adt_baseline set to "reference".
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-29 07:19:02 +00:00
Paul Gevers
a4d0c4a854
Don't start the tests before arch:all has been build (if applicable)
2018-04-25 21:50:46 +02:00
Paul Gevers
022d6ed564
Packages need passing tests on all tested architectures to receive the bounty
2018-04-16 21:37:30 +02:00
Paul Gevers
7e8ec20bc1
Put autopkgtest state files in their own namespace
2018-04-16 20:52:24 +02:00
Paul Gevers
575993d77b
Drop some linux-meta hardcoded stuff; not in Debian and bug 779559 is fixed long time
2018-04-16 20:52:24 +02:00
Niels Thykier
d7045af2b7
Leverage defaultdict to simplify some code
...
Notable omissions are "pending_tests" and "tests_results". This is
omission is due to these (some times) being initialized from the
output of "json.load" (so we cannot assume defaultdict semantics
without manually imported the data into one).
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:25:06 +00:00
Niels Thykier
641df09570
Fix typo in a comment
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:14:24 +00:00
Niels Thykier
686721e91f
Rewrite some set constructs
...
The first case is to avoid a creating a list, which is then converted
to a set only to throw away the list again. Here we can just create
the set right away without a list inbetween.
The second case is "if x in [...]:" is better written as "if x in
{...}:" as sets provides faster "__contains__" (assuming you are on a
"recent enough python3", which britney is).
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:11:54 +00:00
Niels Thykier
77ec8a34f9
Optimize some hash lookups
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:11:32 +00:00
Niels Thykier
499f7d993c
Move loop-invariant out of loop
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:11:02 +00:00
Niels Thykier
74fe0c8b8e
Use finally to close handles from urlopen
...
Arguable, this is not a problem in the code as the failure case
invokes sys.exit. However, this is more future proof as the sys.exit
may be replaced (or we may later catch another exception that is
"recoverable").
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:08:36 +00:00
Niels Thykier
2c34b70492
Remove unused import
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-04-15 10:07:52 +00:00
Paul Gevers
def9d81c76
Make retry URL configurable (two flavors)
2018-04-11 11:17:00 +02:00
Paul Gevers
9a28ec184b
Revert "autopkgtest: Drop retry_url from the excuses as this works different in Debian"
...
This reverts commit 054830d03f0a04c0306e5e71752646c2f2de2626.
2018-04-11 11:17:00 +02:00
Paul Gevers
cb716e3186
Don't excuse.force() on skiptest hint
2018-04-11 11:16:59 +02:00
Paul Gevers
6252826fad
autopkgtest: add adt_baseline = reference option
...
- revert most of commit adbe6d5 as checking the version in testing doesn't work
when other packages migrate and cause regressions
- Alternative way of determining if a package is regressing, by comparison to a
reference set. The reference set is to be created by a holy trigger that
doesn't take packages from the base suite, but instead tests in the testing
suite. This reference needs a retry when a package causing regression
migrates nevertheless, e.g. due to hints or to bounty/penalty policy.
2018-04-11 11:16:59 +02:00
Niels Thykier
8eaee4309e
Rewrite "self.log -> self.logger.<severity>" for autopkgtest
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2018-03-31 05:57:43 +00:00
Paul Gevers
5dfde99fe6
sources is a proper class with a version method
...
Thank nthykier
2018-03-21 20:20:11 +01:00
Paul Gevers
c7107d1fd4
autopkgtest: rewrite processing of debci2britney data
2018-03-21 12:19:28 +01:00
Paul Gevers
12e2cb7596
autopkgtest: don't log a very much occuring ignored situation
2018-03-19 20:24:22 +01:00
Paul Gevers
67becb2aec
autopkgtest: in the final API, run_id is a number, convert it to string internally
2018-03-19 20:23:26 +01:00
Paul Gevers
d0fd1872d4
autopkgtest: give blacklisted packages a version of 'blacklisted'
2018-03-19 20:22:35 +01:00
Paul Gevers
df17112bbe
autopkgtest: ignore results without trigger
2018-03-19 19:39:33 +01:00
Paul Gevers
adbe6d5f67
autopkgtest: redefine regression, if possible, only take test results in testing into account
2018-03-15 11:38:47 +01:00
Paul Gevers
054830d03f
autopkgtest: Drop retry_url from the excuses as this works different in Debian
2018-03-15 11:38:47 +01:00
Paul Gevers
fc5eacf7d1
autopkgtest: minor change
...
reorder adding trigger vs removing
making two stings in the code more readable
2018-03-05 21:29:58 +01:00
Paul Gevers
d59538a514
Enable correct result file url for Debian
2018-03-05 21:09:59 +01:00
Paul Gevers
93ca29c3aa
Load the debci API status file directly
2018-03-05 21:09:59 +01:00
Paul Gevers
03292d1df4
On ci.d.n the running test page is under status/pending
2018-03-05 21:09:59 +01:00
Paul Gevers
1e022af99e
Minor enhancement of log message as in Debian a package can be in unstable without being in testing.
2018-03-05 21:09:59 +01:00
Paul Gevers
9790dbf7c2
Don't reward bounty while tests are running or are always-failed
2018-03-05 21:09:58 +01:00
Paul Gevers
44f983dc63
autopkgtest: Remove hack for gccgo-5/6
2018-03-05 21:09:50 +01:00
Niels Thykier
b82f4fc632
autopkgtests policy: only load amqplib if needed
...
Signed-off-by: Niels Thykier <niels@thykier.net>
2017-11-28 18:54:11 +00:00
Paul Gevers
f03f59548d
Fix logic in exception handling of unknown autopkgtest results
2017-10-25 21:46:53 +02:00
Paul Gevers
089c4f6e57
Rename new excuse field and method to unsatisfiable_on_archs and add_unsatisfiable_on_arch
2017-10-24 22:06:35 +02:00
Paul Gevers
a16e4e5a55
Enable autopkgtesting on built arches when not all have been built yet
...
- autopkgtest now honors break_arches option
- incomplete testing is now treated with penalty behavior
2017-10-24 20:46:21 +02:00
Paul Gevers
41c4729506
Only give bounty on passing packages if the package has a test suite itself
2017-10-21 21:10:41 +02:00
Paul Gevers
d975b2fc39
Make the huge queue in autopkgtest optional
2017-10-19 21:50:56 +02:00
Paul Gevers
287a9d328c
os.path.join(options.unstable, 'autopkgtest') isn't writable in the Debian setup and we have options.state_dir already
2017-10-18 19:54:57 +02:00
Paul Gevers
eb60fc557e
Implement bounty/penalty system for autopkgtest
2017-10-15 21:42:51 +02:00