3142 Commits

Author SHA1 Message Date
Balint Reczey
039ed8ec31 Merge fixing minimized text spacing 2019-02-06 17:55:10 +07:00
Balint Reczey
3cf7de97cc Update changelog 2.560 2019-02-05 19:51:38 +07:00
Balint Reczey
0182d380ca Nicely separate motd text about minimizing from texts above 2019-02-05 17:24:09 +07:00
Balint Reczey
8a78ab4021 Merge make-rprivate-before-umount 2019-02-05 17:10:49 +07:00
Balint Reczey
96cc185813 Merge feature/parallelization-snap-version-fixing 2019-02-05 17:06:24 +07:00
Balint Reczey
9f532ad4cf Update changelog 2019-02-05 17:04:08 +07:00
Didier Roche
1c435c03d2 Fix customized images with multiple brand/models
Some customized images are built from the same chroot, but need to
override brands and models.
2019-02-05 10:13:37 +01:00
Tobias Koch
eabe867003 Bugfix: specify channel when requesting snap info 2019-02-05 10:05:15 +01:00
Tobias Koch
654fcae467 Replace "snap download" with tool that uses snap store's coherence feature
This is important for parallel image builds to ensure all pre-seeded snaps
have the same versions across image variants.
2019-02-05 10:04:40 +01:00
Balint Reczey
33c5ad0b19 live-build/functions: Always use mount --make-private before umount
Util-linux 2.33 fixed mount --rbind --make-rslave which did not pass MS_REC
with MS_BIND and livecd-rootfs did only --bind --make-rslave effectively with
prior mount versions.
While mount --rbind --rslave are properly passed the flags to mount()
unmounting did not work cleanly with --make-rslave.

To clearly stop propagation of umount, --make-private is used instead of
--make-rslave and it is always set before umounts. Umount -R is replaced
with a simple umount since submounts are tore down in teardown_mountpoint()
earlier.

LP: #1813730
2019-02-05 07:54:37 +07:00
Balint Reczey
a06d208871 Merge branch feature/parallelization-pkg-version-fixing 2019-02-04 23:03:56 +07:00
Colin Watson
305d5cef50 Drop code to handle buildd images for <disco
We'll deal with those in stable updates instead.
2019-02-01 18:07:58 +00:00
Colin Watson
36af2769dc Disable merged /usr in buildd images
Otherwise we might end up building packages with hardcoded paths that
assume a merged /usr.
2019-02-01 18:03:20 +00:00
Colin Watson
fe59f6fce8 Add ubuntu-base:buildd: to ALL_TRIPLETS 2019-02-01 18:03:15 +00:00
Tobias Koch
5b70d86f5c Inject a proxy into the build providing a snapshot view of the package repo.
When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
redirect all outgoing HTTP requests to this proxy.

The proxy, contained in the `magic-proxy` Python script, examines each request
and silently overrides those pointing to InRelease files or files that are
listed in InRelease files. It will instead provide the contents of the requested
file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
"by hash".
2019-02-01 11:26:20 +01:00
Didier Roche
7d42c3f4b4 releasing package livecd-rootfs version 2.559 2.559 2019-02-01 08:05:48 +01:00
Michael Hudson-Doyle
211213216d Merge branch 'jibel-layers' into ubuntu/master 2019-02-01 17:22:35 +13:00
Michael Hudson-Doyle
ae04fee7c2 changelog entry 2019-02-01 17:22:25 +13:00
Michael Hudson-Doyle
a9991a908e revert change to ubuntu-server:live snap seeding 2019-02-01 17:22:25 +13:00
Jean-Baptiste Lallement
3dce125d72 Remove inidrd and vmlinuz from live layers after they've been moved to casper 2019-01-31 12:16:07 +01:00
Jean-Baptiste Lallement
f5d3233c64 Fixed wonky indentation 2019-01-31 09:39:22 +01:00
Jean-Baptiste Lallement
f84d92d76f Calculate total size of the image + typos 2019-01-30 12:29:57 +01:00
Jean-Baptiste Lallement
3db920c40c Fixed quoting of subproject variable 2019-01-30 12:29:57 +01:00
Jean-Baptiste Lallement
52d9bd3ead Run live specific scripts on non live layers
Allow execution of lb_binary_linux-image and lb_chroot_live-packages on
any layer by setting LIVE_PASSES.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
d1a2e24c41 Adds reduce_pass_size
Adds a function reduce_pass_size which removes duplicated files between
layers. A duplicate file is a file with same path, size, mode, owners
and content on 2 related layers.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
402cdd15be Adds is_root_layer
Factored the code to detect if a layer is a root layer in function
is_root_layer and execute lb_chroot_archives only on root layers.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
283871573d Changed the naming scheme for multi layer images to dot format 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
addef92e23 Decouple from ubuntu-cdimage & debian-cd landings
We don't want to regress the ubuntu desktop traditional image when
livecd-rootfs lands uncordinated with ubuntu-cdimage & debian-cd.
Decoupling enables us to:
- land livecd-rootfs (no change for ubuntu-desktop project,
ubuntu-desktop:ubiquity-ng can be tested once the 2 others branches
lands)
- land ubuntu-cdimage & debian-cd for publishing any arbitrary squashfs
names
- finally, revert that commit and land it in livecd-rootfs to transform
the traditional ubuntu-desktop image to a layered approach.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
2d2ce6eea4 Rename chroot.$PASS -> overlay.$PASS 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
e0d30dd2d3 Fixed substract -> subtract 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
15cacaee96 configure network manager _after_ installing network-manager 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
1bfac23725 Add ubiquity-ng image autopkgtest 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
41becb0af7 Ensure snaps are available on ubuntu-server live 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
e0ed85c400 Fixed pattern for matching manifest 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
3075d65578 Cleanup and handle manifest-remove files
manifest-remove files are generated in all cases and removed for
projects/subprojects that don't need it like the new ubiquity.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
9dba350834 Added lb_binary_layered
Created lb_binary_layered based on lb_binary
Factorized several helpers
These helpers are called from lb_chroot
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
43ec452fa0 Moved reusable functions to functions
Moved functions to reuse in lb_binary and lb_chroot to functions
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
693e0a7360 Clean up chroot helpers
Removed obsolete chroot helpers on Disco+:
 - selinux
 - sysv-rc
 - upstart

Added a note about needlessly triggering chroot_archives on each pass.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
047f883e92 Various fixes
Fixed prefix for passes to not conflict with global prefix
Set layer to none for layer without language packs
Copy size and manifest to the target directory
Make sure the diff always diffes existing manifests
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
9077289332 Add includes by pass
lb_chroot_includes now takes the name of the pass as first argument and
will includes files for the corresponding pass from the directory
include.chroot.<pass>
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
3b21bd9a2e Moved back config helper functions to config
Moved back config specific functions from functions to config
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
42d1d77612 Layered Ubuntu desktop by default
Default Ubuntu desktop to the layered format
Remove the requirement on setting IMAGEFORMAT to layered to build a
layered image and relies on PASSED instead.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
f3dadf1091 Support for positive and negative sublayers
Calculate positive and negative package lists for sublayers
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
a9908e0c9d Add support for negative package lists 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
53b06af931 Added sublayers support
Adds support for sublayers by defining package lists corresponding to
each sublayer. The name of the package list defines the name of the
layer.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
78c196031b Add snaps to manifest
Make sure that all the snaps are listed in the full manifest of each
layer and as delta in the delta manifest.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
903ba3b276 Actually install snap for each layer. 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
1ab78e783b Generate snap list from task 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
00e474e2ff Make snap functions idempotent
_snap_preseed and snap_prepare_assertions can be called several times
with the same snap and will only provision it once.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
ef72cf5fe8 Code refactoring:
* Moved *inheritance functions from config to functions
 * Moved code to extract snap from seed to snap_from_seed function
2019-01-30 12:29:56 +01:00