342 Commits

Author SHA1 Message Date
Robert C Jennings
620e17d2b7
ubuntu-cpc: parallel builds
* Replace "snap download" with tool that uses snap store's coherence feature

    This is important for parallel image builds to ensure all pre-seeded snaps
    have the same versions across image variants.

* Inject a proxy into the build providing a snapshot view of the package repo.

    When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
    to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
    redirect all outgoing HTTP requests to this proxy.

    The proxy, contained in the `magic-proxy` Python script, examines each request
    and silently overrides those pointing to InRelease files or files that are
    listed in InRelease files. It will instead provide the contents of the requested
    file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
    "by hash".

* Use series files with dependency handling to generate hook symlinks dynamically

    This patch currently only applies to the "ubuntu-cpc" project.

    More and more logic has been going into the hook scripts to decide
    under which conditions they should run or not. As we are moving
    to parallelized builds of image sets, this will get even more
    complicated. Base hooks will have to know which image sets they
    belong to and modification of the dependency chain between scripts
    will become more complicated and prone to errors, as the number of
    image sets grows.

    This patch introduces explicit ordering and dependency handling for
    scripts through the use of `series` files and an explicit syntax
    for dependency specification.
2019-05-21 17:32:47 -05:00
Cody Shepherd
5bee1ade70 Ensure pre-seeded snaps are now published in the image manifests. 2018-10-22 10:21:50 -07:00
Łukasz 'sil2100' Zemczak
4f6e5dc11e For the pc model, the name changed so we need to special case it a bit. 2018-10-11 17:12:50 +02:00
Łukasz 'sil2100' Zemczak
1498baada5 The model assertions for 18 don't actually use series=18 because that would be too logical. 2018-10-10 21:57:55 +02:00
Łukasz 'sil2100' Zemczak
c184977a90 Decide what model assertion series to fetch depending on the suite. For xenial use 16 and for others (so bionic+): 18. 2018-10-03 11:51:49 +02:00
Robert C Jennings
9f96dcb4de Add the server snap seed to the ubuntu-cpc project 2018-09-27 11:36:01 -05:00
Colin Watson
bb652c238f Merge trunk. 2018-09-19 16:24:26 +02:00
Michael Hudson-Doyle
e804cc4e00 a less hackish approach 2018-08-17 12:01:27 +12:00
Michael Hudson-Doyle
a261471969 a less hackish approach 2018-08-17 12:00:41 +12:00
Michael Hudson-Doyle
1aa8b9d882 ffs 2018-08-17 10:09:57 +12:00
Michael Hudson-Doyle
00151c5e0b Set PREINSTALLED=true for live-server so that universe ends up being
enabled in the image.
2018-08-16 21:28:52 +12:00
Robert C Jennings
c3f5ee6716 Disable checksum generation
These checksums are unused, integrity checking in launchpad is performed
separately.
2018-07-11 15:06:16 -05:00
Colin Watson
1e6563aa79 Merge trunk. 2018-06-29 22:07:49 +01:00
Colin Watson
baee4ed403 We know cosmic's name now. 2018-06-29 21:57:15 +01:00
Colin Watson
8b1970f661 live-build/auto/config: Drop "lp-*" hostname filter for Launchpad
builders, since LP #1747015 is now fixed; "*.buildd" should be enough.
2018-06-14 12:41:46 +01:00
Daniel Watkins
80459b6c1b ubuntu-cpc: Use linux-kvm for all amd64 minimized builds (LP: #1775472). 2018-06-06 17:19:17 -07:00
Simon Quigley
9ba04172d4 Completely drop Lubuntu Next. 2018-05-08 21:12:15 -05:00
Simon Quigley
382f17b08c Don't follow recommends. 2018-05-03 23:23:30 -05:00
Simon Quigley
480e02443e Drop seed workarounds for unbuilt Lubuntu Next. 2018-05-03 23:08:44 -05:00
Colin Watson
1fab544a84 Add init to buildd chroots, since it's needed for LXD-based builds. 2018-04-30 16:39:01 +01:00
Colin Watson
b77de06bfd Remove some unnecessary buildd configuration. 2018-04-30 09:54:28 +01:00
Colin Watson
416093beec Use a public-facing mirror URL in the final buildd /etc/apt/sources.list. 2018-04-29 21:42:41 +01:00
Colin Watson
cb22177287 Add a buildd subproject. 2018-04-27 16:07:44 +01:00
Michael Hudson-Doyle
65dd7df171 last minute pre-upload typo fix 2018-04-11 19:18:47 +12:00
Michael Hudson-Doyle
aacb8daaee merge trunk 2018-04-11 19:10:32 +12:00
Steve Langasek
c46962ca2e Refactor snap preseeding to allow additional snaps to be preseeded from
hooks
2018-04-10 15:59:31 -07:00
Robert C Jennings
73dba1f31a snap preseeding: capture Ubuntu snap seeding policy in code
When no channel is given for a pre-seeded snap, the channel
should be stable/ubuntu-XX.YY to match Ubuntu policy.

This patch adds the LB_DISTRIBUTION var to config/{binary,chroot}
to have a common way of determining the Ubuntu XX.YY version
number between hooks and auto/build.
2018-04-10 11:59:19 -05:00
Iain Lane
e68923777e merge lp:~tsimonq2/livecd-rootfs/lubuntu-seed-mangling 2018-04-03 11:56:28 +01:00
Simon Quigley
e4151ca741 Proper bash is rad, let's do it. 2018-03-25 10:10:39 -05:00
Simon Quigley
10ebe98d84 Special-case Lubuntu's seeds so that the minimal install works. 2018-03-25 10:06:13 -05:00
Dimitri John Ledkov
bfa43c1c5c On amd64, if building minimal images for bionic, xenial, or extra ppa,
use kvm kernel, otherwise fallback to virtual.
2018-03-21 11:05:46 +00:00
Michael Hudson-Doyle
c787069c5c do not set INITRAMFS_COMPRESSION for projects that end up passing --initramfs=none to lb config 2018-03-15 10:17:40 +13:00
Michael Hudson-Doyle
d46edbffdb reduce duplication somewhat 2018-03-15 09:48:10 +13:00
Michael Hudson-Doyle
b7f3ec398b Make lzma initramfs compression opt-in rather than opt-out, and do not
opt-in to it for live-server builds to speed up the boot. (LP: #1750873)
2018-03-14 15:54:06 +13:00
Michael Hudson-Doyle
0d750f78bc Set INITRAMFS_COMPRESSION to gzip for live-server builds to speed up the
boot. (LP: #1750873)
2018-03-13 21:37:06 +13:00
Iain Lane
ba4b16626f live-build-auto/{build,config}: Support fetching a file from the seed
mirror (BASE_SEED.minimal-remove) and putting it into the livefs build as
filesystem.manifest-minimal-remove. It's intended for ubiquity to read
this file as a list of packages to remove when doing a 'minimal' desktop
installation.
2018-02-23 12:08:17 +00:00
Michael Hudson-Doyle
57200eaa01 tyop 2018-02-23 16:53:20 +13:00
Michael Hudson-Doyle
4b66f89e56 move skip_lb_stage to config 2018-02-23 09:37:51 +13:00
Michael Hudson-Doyle
c85cae9bfe respond to some review feedback 2018-02-23 09:18:33 +13:00
Michael Hudson-Doyle
d46e397b24 merge trunk 2018-02-22 13:58:12 +13:00
Michael Hudson-Doyle
15d9269e57 Install linux-signed-generic in the live-server image. (LP: #1749065) 2018-02-15 09:31:07 +13:00
Mathieu Trudel-Lapierre
762536b5bf live-build/auto/config: Take into account SUBPROJECT when setting seeded
snaps, and also make sure we can work with snaps seeded in project hooks.
2018-02-06 23:37:28 -05:00
Iain Lane
301fdd2e02 Don't write config/seeded-snaps if no snaps have been seeded. 2018-02-01 11:52:41 +00:00
Adam Conrad
2219f62998 * live-build/auto/config: Clean out unused hostname matches and fix indenting.
* live-build/auto/config: Reinstate hostname filtering for "*.buildd", which
  is the correct match for non-lxd builders, and add "lp-*" for the lxd ones.
* live-build/auto/config: Fix incorrect quoting causing a skipped if statement
  in non-live ubuntu-server builds since sometime in mid-October of last year.
2018-01-31 21:00:49 -07:00
Adam Conrad
925e470693 Fix incorrect shell variable quoting. 2018-01-31 20:38:11 -07:00
Steve Langasek
2c40db69bc Update hostname matches for launchpad buildds to match current practice,
fixing build failures due to LP being unable to reach
people.canonical.com.
2018-01-31 16:41:21 -08:00
Iain Lane
72edc20589 Set ports/archive as appropriate for default mirror - should fix
autopkgtests.
2018-01-31 09:38:05 +00:00
Iain Lane
9e09b3172c Set a default archive mirror - needed for germinate. 2018-01-31 02:26:10 -07:00
Iain Lane
42a6450584 Oops. I shouldn't reference my private stuff. 2018-01-30 11:51:23 +00:00
Iain Lane
284240feb5 releasing package livecd-rootfs version 2.491 2018-01-30 11:20:34 +00:00