Steve Langasek d5040afb84 Fix up handling of email cache
We were checkpointing after each email was sent to ensure that an aborted
p-m run didn't result in double emails; however, because the new cache only
contains records for packages we've seen so far during this run (to avoid
the cache growing without bounds over time), that means an aborted p-m run
*still* throws away records for all packages still waiting to be processed.

To fix this, we:
 - only checkpoint records of writing emails during this in-progress run to
   a temp file
 - check for this temp file on britney startup, and if present, merge the
   results into the current state
 - move this temp file into the final cache location only at the end of the
   britney run

Along the way, fix up a bug introduced in the previous commit that would have
us only saving state for those packages for which we sent email during the
current run, which would have quite bad effects.
2017-07-06 17:36:57 -07:00
2017-07-06 17:36:57 -07:00
2016-11-22 20:21:01 +00:00
2011-12-23 11:16:32 +01:00
2016-11-22 20:21:01 +00:00
2008-05-20 17:37:56 +02:00
2016-11-22 20:21:01 +00:00
2017-03-09 18:02:59 +00:00
2017-03-09 18:02:59 +00:00
2016-11-22 20:21:01 +00:00
2011-07-06 18:31:45 +00:00

Britney - Keeps suites installable and up to date

Britney is a program to compute an update of a Debian-based package suite by feeding it updates from (one or more) source-suite(s). A few known use cases:

  • Debian uses it to update testing based on unstable
  • Ubuntu uses it to update their latest development suite using a "hidden" -proposed-updates suite as source

Britney's primary goal is too keep packages in the target suite installable (e.g. Debian testing) while keeping it up to date with its primary source suite (e.g. Debian unstable).

Quick setup guide

This is a very brief intro to the steps required to setup a Britney instance.

  • Copy "britney.conf.template" and edit it to suit your purpose
    • If you want Britney to bootstrap your target suite, you probably want to add all architectures to "NEW_ARCHES" and "BREAK_ARCHES" for a few runs
  • Create the following files (they can be empty):
    • $STATE_DIR/age-policy-dates
    • $STATE_DIR/age-policy-urgencies
    • $STATE_DIR/rc-bugs-unstable
    • $STATE_DIR/rc-bugs-testing
  • Run ./britney.py -c $BRITNEY_CONF -v [--dry-run] to test the run
  • Use the resulting $HEIDI_OUTPUT (or $HEIDI_DELTA_OUTPUT) to update your target suite.
    • With dak, cut -d" " -f1-3 < ${HEIDI_OUTPUT} | dak control-suite --set ${TARGET_SUITE} [--britney]
  • Setup a cron-/batch-job that:
    • (Optionally) Updates the rc-bugs files
    • (Optionally) Updates the $STATE_DIR/age-policy-urgencies
    • Runs Britney
    • Imports the result into your target suite

Migration items

Britney generally works with a "migration item", which is a group of binary packages (and possibly a source package). Packages are bundled into these migration items under the following rules:

  1. "source migration": An update of the source package. This will include all the binary packages built from that source version (regardless of architecture).
    • Can contain binaries built from earlier source version depending on the setting of "IGNORE_CRUFT"
    • Britney refers to these as "${SOURCE_NAME}"
  2. "binary migration": An update of binary packages on a given architecture to an existing source package in the target suite.
    • Two common cases: Built for the first time on a new architecture and binNMUs
    • Britney refers to all cases of these as "${SOURCE_NAME}/${ARCHITECTURE}"
  3. "removal item": A removal of a source or binary package.
    • Note that it is only possible to trigger "source" removals via hints. Binary removals are items generated by Britney to clean up the target suite.
    • Britney refers to these as "-${SOURCE_NAME}" or "-${BINARY_NAME}/${ARCHITECTURE}" depending on the case.

Migration rules (excuses/policies)

Britney applies a number of policies to migration items before attempting to migrate them to the target suite. These policies can "reject" a package and prevent it from migrating. Some policies/built-in rules:

  • Age policy: Lets source migrations age a bit before they are allowed to migrate
    • Supports variable length based on package urgency
  • RC Bug policy: Rejects packages with regressions in RC bugs
    • Requires an external tool to keep the bug lists up to date
  • Keeps architectures in sync: Source migrations updating existing packages only occur if architectures are up to date
    • Can be configured to ignore certain architectures.
Description
britney2-ubuntu fork which runs on ci.lubuntu.me
Readme GPL-2.0 9.4 MiB
Languages
Python 99.6%
Shell 0.3%