Due to the number of hints in standing use in Ubuntu, hints.search() is an expensive operation, and we call it once for *every single test* referenced from -proposed. Since force-reset-test are a small proportion of the hints in use, searching once for all the hints of this type and only searching this subset for each autopkgtest improves performance (with 23000 autopkgtests referenced in -proposed, this saves roughly 1 minute of runtime, or 11% on a 9-minute britney run; the number of packages in -proposed is typically much higher at other points in the release cycle, therefore the absolute improvement in performance is expected to be greater.) The force-reset-test hints are an Ubuntu delta so this is not expected to be upstreamed; and it could eventually be dropped if and when baseline retesting is implemented in Ubuntu and the number of hints required drops. This could be implemented with a more generic, elegant solution in HintsCollection, but again, the scalability problem of hints is hopefully short-lived so I didn't consider it worth the investment here.
Britney - Keeps suites installable and up to date
Britney is a program to compute an update of a Debian-based package suite by feeding it updates from (one or more) source-suite(s). A few known use cases:
- Debian uses it to update testing based on unstable
- Ubuntu uses it to update their latest development suite using a "hidden" -proposed-updates suite as source
Britney's primary goal is too keep packages in the target suite installable (e.g. Debian testing) while keeping it up to date with its primary source suite (e.g. Debian unstable).
Installing, configuring and using Britney
Please see [doc/setting-up-britney.rst].
Migration items
Britney generally works with a "migration item", which is a group of binary packages (and possibly a source package). Packages are bundled into these migration items under the following rules:
- "source migration": An update of the source package. This will include all the binary packages built from that source version (regardless of architecture).
- Can contain binaries built from earlier source version depending on the setting of "IGNORE_CRUFT"
- Britney refers to these as "${SOURCE_NAME}"
- "binary migration": An update of binary packages on a given architecture to an existing source package in the target suite.
- Two common cases: Built for the first time on a new architecture and binNMUs
- Britney refers to all cases of these as "${SOURCE_NAME}/${ARCHITECTURE}"
- "removal item": A removal of a source or binary package.
- Note that it is only possible to trigger "source" removals via hints. Binary removals are items generated by Britney to clean up the target suite.
- Britney refers to these as "-${SOURCE_NAME}" or "-${BINARY_NAME}/${ARCHITECTURE}" depending on the case.
Migration rules (excuses/policies)
Britney applies a number of policies to migration items before attempting to migrate them to the target suite. These policies can "reject" a package and prevent it from migrating. Some policies/built-in rules:
- Age policy: Lets source migrations age a bit before they are allowed to migrate
- Supports variable length based on package urgency
- RC Bug policy: Rejects packages with regressions in RC bugs
- Requires an external tool to keep the bug lists up to date
- Keeps architectures in sync: Source migrations updating existing packages only occur if architectures are up to date
- Can be configured to ignore certain architectures.