96cc185813
Merge feature/parallelization-snap-version-fixing
6 years ago
1c435c03d2
Fix customized images with multiple brand/models
...
Some customized images are built from the same chroot, but need to
override brands and models.
6 years ago
654fcae467
Replace "snap download" with tool that uses snap store's coherence feature
...
This is important for parallel image builds to ensure all pre-seeded snaps
have the same versions across image variants.
6 years ago
33c5ad0b19
live-build/functions: Always use mount --make-private before umount
...
Util-linux 2.33 fixed mount --rbind --make-rslave which did not pass MS_REC
with MS_BIND and livecd-rootfs did only --bind --make-rslave effectively with
prior mount versions.
While mount --rbind --rslave are properly passed the flags to mount()
unmounting did not work cleanly with --make-rslave.
To clearly stop propagation of umount, --make-private is used instead of
--make-rslave and it is always set before umounts. Umount -R is replaced
with a simple umount since submounts are tore down in teardown_mountpoint()
earlier.
LP: #1813730
6 years ago
a06d208871
Merge branch feature/parallelization-pkg-version-fixing
6 years ago
305d5cef50
Drop code to handle buildd images for <disco
...
We'll deal with those in stable updates instead.
6 years ago
36af2769dc
Disable merged /usr in buildd images
...
Otherwise we might end up building packages with hardcoded paths that
assume a merged /usr.
6 years ago
5b70d86f5c
Inject a proxy into the build providing a snapshot view of the package repo.
...
When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
redirect all outgoing HTTP requests to this proxy.
The proxy, contained in the `magic-proxy` Python script, examines each request
and silently overrides those pointing to InRelease files or files that are
listed in InRelease files. It will instead provide the contents of the requested
file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
"by hash".
6 years ago
a9991a908e
revert change to ubuntu-server:live snap seeding
6 years ago
3dce125d72
Remove inidrd and vmlinuz from live layers after they've been moved to casper
6 years ago
f5d3233c64
Fixed wonky indentation
6 years ago
f84d92d76f
Calculate total size of the image + typos
6 years ago
3db920c40c
Fixed quoting of subproject variable
6 years ago
52d9bd3ead
Run live specific scripts on non live layers
...
Allow execution of lb_binary_linux-image and lb_chroot_live-packages on
any layer by setting LIVE_PASSES.
6 years ago
d1a2e24c41
Adds reduce_pass_size
...
Adds a function reduce_pass_size which removes duplicated files between
layers. A duplicate file is a file with same path, size, mode, owners
and content on 2 related layers.
6 years ago
402cdd15be
Adds is_root_layer
...
Factored the code to detect if a layer is a root layer in function
is_root_layer and execute lb_chroot_archives only on root layers.
6 years ago
283871573d
Changed the naming scheme for multi layer images to dot format
6 years ago
addef92e23
Decouple from ubuntu-cdimage & debian-cd landings
...
We don't want to regress the ubuntu desktop traditional image when
livecd-rootfs lands uncordinated with ubuntu-cdimage & debian-cd.
Decoupling enables us to:
- land livecd-rootfs (no change for ubuntu-desktop project,
ubuntu-desktop:ubiquity-ng can be tested once the 2 others branches
lands)
- land ubuntu-cdimage & debian-cd for publishing any arbitrary squashfs
names
- finally, revert that commit and land it in livecd-rootfs to transform
the traditional ubuntu-desktop image to a layered approach.
6 years ago
2d2ce6eea4
Rename chroot.$PASS -> overlay.$PASS
6 years ago
e0d30dd2d3
Fixed substract -> subtract
6 years ago
15cacaee96
configure network manager _after_ installing network-manager
6 years ago
41becb0af7
Ensure snaps are available on ubuntu-server live
6 years ago
e0ed85c400
Fixed pattern for matching manifest
6 years ago
3075d65578
Cleanup and handle manifest-remove files
...
manifest-remove files are generated in all cases and removed for
projects/subprojects that don't need it like the new ubiquity.
6 years ago
9dba350834
Added lb_binary_layered
...
Created lb_binary_layered based on lb_binary
Factorized several helpers
These helpers are called from lb_chroot
6 years ago
43ec452fa0
Moved reusable functions to functions
...
Moved functions to reuse in lb_binary and lb_chroot to functions
6 years ago
693e0a7360
Clean up chroot helpers
...
Removed obsolete chroot helpers on Disco+:
- selinux
- sysv-rc
- upstart
Added a note about needlessly triggering chroot_archives on each pass.
6 years ago
047f883e92
Various fixes
...
Fixed prefix for passes to not conflict with global prefix
Set layer to none for layer without language packs
Copy size and manifest to the target directory
Make sure the diff always diffes existing manifests
6 years ago
9077289332
Add includes by pass
...
lb_chroot_includes now takes the name of the pass as first argument and
will includes files for the corresponding pass from the directory
include.chroot.<pass>
6 years ago
3b21bd9a2e
Moved back config helper functions to config
...
Moved back config specific functions from functions to config
6 years ago
42d1d77612
Layered Ubuntu desktop by default
...
Default Ubuntu desktop to the layered format
Remove the requirement on setting IMAGEFORMAT to layered to build a
layered image and relies on PASSED instead.
6 years ago
f3dadf1091
Support for positive and negative sublayers
...
Calculate positive and negative package lists for sublayers
6 years ago
a9908e0c9d
Add support for negative package lists
6 years ago
53b06af931
Added sublayers support
...
Adds support for sublayers by defining package lists corresponding to
each sublayer. The name of the package list defines the name of the
layer.
6 years ago
78c196031b
Add snaps to manifest
...
Make sure that all the snaps are listed in the full manifest of each
layer and as delta in the delta manifest.
6 years ago
903ba3b276
Actually install snap for each layer.
6 years ago
1ab78e783b
Generate snap list from task
6 years ago
00e474e2ff
Make snap functions idempotent
...
_snap_preseed and snap_prepare_assertions can be called several times
with the same snap and will only provision it once.
6 years ago
ef72cf5fe8
Code refactoring:
...
* Moved *inheritance functions from config to functions
* Moved code to extract snap from seed to snap_from_seed function
6 years ago
6a7368bf95
Clean-up dead code for server live builds.
6 years ago
d4f7a0b23d
live-build/auto/config: Added ubuntu-desktop-minimal to install-minimal task
6 years ago
0f4fcbc7d3
lb_chroot_layered: Export _PASS as PASS to be available in hooks
6 years ago
d5a16296f4
live-build/auto/build: Create one manifest by layer in diff format and one full manifest with all the layers in standard format
6 years ago
ca63d43696
live-build/auto/build: Add size of the filesystems. This is used by the installer to calculate the minimum partition size to reserve for installation. The installer will have to sum all the sizes to compute the final size. Thank didrocks
6 years ago
7e2f4d4304
live-build/lb_chroot_layered: removed useless comment
6 years ago
940873e6cb
live-build/lb_chroot_layered: overlayfs supports only 2 stacked layers. Changed the code to use several lower dirs instead like casper does
6 years ago
b6287916c2
auto/build: Order generated squashfs filesystems
6 years ago
ce973ba07b
auto/build: Removed useless comment
6 years ago
7b4acba31d
* Added lb_chroot_layered to add support for multi layered squashfs images
...
* auto/*: Added live-layered image format
6 years ago
3e34faaa70
Moved add_task and add_package to functions in order to be available in hooks
6 years ago
b3dd27aedd
Use linux-firmware-raspi2 instead of raspi3-firmware.
6 years ago
2b15590f3b
Fix buildd images for series earlier than bionic
...
Don't install gpg or gpg-agent when building buildd images for series
earlier than bionic. (In earlier series, those packages didn't exist
and gnupg was build-essential.)
6 years ago
bf61fdecf3
Merge branch 'ubuntu/master' of git+ssh://git.launchpad.net/livecd-rootfs into sil2100/raspi-wpasupplicant
6 years ago
abec4f4c1d
Link to the proper name instead.
6 years ago
e60bcbaecd
Add proper IMAGAFORMAT for raspi3 classic builds, output the images with the expected naming.
6 years ago
46942330d8
Move buildd image building to binary hooks
6 years ago
082a2046e7
Add a LXD image to builds for the buildd subproject
6 years ago
625ace8483
Do not include curtin in the live-server installer.squashfs as the version of subiquity that includes it in the snap has now been released to stable.
6 years ago
85eed4a91d
Add wpasupplicant to the additional packages installed for the raspi2 and raspi3 targets.
6 years ago
1b93df3ae8
A few simple tweaks to reduce size of live servers installer.squashfs
...
- Do not run apt-get update (which can bring in package lists if we are
unlikely wrt publisher schedules).
- Run apt-get clean to clear out downloaded debs of curtin/casper and
dependencies.
- Do not install user-setup.
- Use the core snap from the base filesystem if present.
6 years ago
1e9fc65863
Use right lsb_release argument for HWE kernel name (-sc -> bionic, need -sr -> 18.04).
6 years ago
f81fb59a00
Do no install openssh-server in the base filsystem for the live server installer.
6 years ago
460332296b
remove cloud-initramfs-copymods before installing kernel
6 years ago
7167e3718b
add initramfs hook to record kernel metapackage & mount modules
6 years ago
5565e3a3d8
add hook to create kernel/initrd/modules for ISO
6 years ago
e3e2e5f9ff
do not unmount the installer overlay in 032-installer-squashfs.binary
...
so that a new hook can create yet further overlays on top of it
6 years ago
c4e5659217
do not include kernel in base install for ubuntu-server:live
...
this actually makes things closer to the non-live server build and so
makes things a bit simpler
6 years ago
73409ddb77
Add .keep files to preserve empty directories
6 years ago
4b01505952
Fix typo preventing builds of ubuntu-core images.
6 years ago
cbd4eb5717
Use series files with dependency handling to generate hook symlinks dynamically
...
This patch currently only applies to the "ubuntu-cpc" project.
More and more logic has been going into the hook scripts to decide under which conditions they should run or not. As we are moving to parallelized builds of image sets, this will get even more complicated. Base hooks will have to know which image sets they belong to and modification of the dependency chain between scripts will become more complicated and prone to errors, as the number of image sets grows.
This patch introduces explicit ordering and dependency handling for scripts through the use of `series` files and an explicit syntax for dependency specification.
6 years ago
5300bb9eb7
Key netplan delegation to NetworkManager on presence of
...
/usr/sbin/NetworkManager, not on /usr/lib/NetworkManager which may have
hooks from other packages (i.e., wpasupplicant).
6 years ago
6345ccd34c
Add a few minor fixes for raspi3 builds.
6 years ago
d3eb3dd0ac
Add missing arguments to ubuntu-image classic calls.
6 years ago
c229012efb
Add raspi3 arm64 rootfs build support.
6 years ago
65d907268a
raspi3 support: be sure to create /boot/firmware during pi3 rootfs builds. Also, for the raspi3 we need to explicitly specify the kernel flavor to raspi2. We also switch to using raspi3-firmware instead of linux-firmware-raspi2 because the latter is not available for arm64.
6 years ago
6ee39485dd
Merge lp:~sil2100/livecd-rootfs/use-ubuntu-image-classic
6 years ago
05a8be839f
Do the same for ubuntu-image snap builds.
6 years ago
8a33b23dd0
Use -O instead of -o for ubuntu-image classic builds.
6 years ago
2947cdbe60
First batch of obvious changes - use better shellism, only call make (without make install).
6 years ago
f2f3512339
Merge lp:~mzanetti/livecd-rootfs/drop-sf-support
6 years ago
b3c9d8bac8
Merge lp:~sil2100/livecd-rootfs/raspi3-u-i-classic
6 years ago
77c44167df
Delete no longer accurate comments
6 years ago
75b9ab1664
Move overlay include.binary /lib to /usr/lib.
6 years ago
93df6705a0
Revert "Do not mount result, on top of lowerdir, appears to fail in
...
disco." the actual problem is in live-build with merged-usr and
copying over chroot/binary includes.
6 years ago
9a8d7117e3
Also strip duplicate \n from the below.
6 years ago
0c2e3c1342
Fix snap-seed-parse to take filename argument instead of printing to
...
stdout
6 years ago
c7e0c27607
[ Cody Shepherd ]
...
Fix snap-seed-parse to take filename argument instead of printing to
stdout
6 years ago
8868522e78
When calling snap-seed-parse append stdout to file, but redirect
...
stderr to stdout, thus unbreak autopkgtests.
6 years ago
1b424926db
Do not mount result, on top of lowerdir, appears to fail in disco.
6 years ago
e24dccadcc
mount_overlay only takes 3 args
6 years ago
1e1c6a8572
Properly fix the hard-linking of vmlinuz, taken astray by my misguided
...
merge review.
6 years ago
8f910aab4b
Merge lp:~vorlon/livecd-rootfs/initramfsless-everywhere
6 years ago
a3a9b2ab60
Merge latest prerequisite branch.
6 years ago
b0910cbe50
Remove more unneeded raspi3 conditionals.
6 years ago
37f3cb1714
Merge latest prerequisite branch.
6 years ago
2e3c7d050c
Remove unneeded code and code duplication, add comments.
6 years ago
6ac3384f34
Merge latest prerequisite branch
6 years ago
a274206e1a
Don't overcomplicate bash conditionals.
6 years ago
cc5d39b93d
Merge latest prerequisite branches.
6 years ago
501afa0783
Merge latest prerequisite branch
6 years ago
61ba85df21
Merge trunk
6 years ago
f8529c9038
Add support for building classic images using makefile-based gadget trees.
6 years ago
41382692ba
Merge lp:~codyshepherd/livecd-rootfs/uefi-manifests-cosmic
6 years ago
a9935923f8
Changes to include grub efi packages and dependencies in uefi image manifests.
6 years ago
840015fbbe
Merge lp:~aleks.bogdanov/livecd-rootfs/remove-vagrant-console-log
6 years ago
2819290352
Changed absoluted paths to relative; set changelog message to UNRELEASED
6 years ago
5bee1ade70
Ensure pre-seeded snaps are now published in the image manifests.
6 years ago
41b4130759
* Add support for raspi3 rootfs builds (based on Ryan Finnie).
...
* For ubuntu-image consumption, export the kernel and initrd to
image/boot/uboot for raspi*.
6 years ago
e115b2cbe7
Avoid issues of hard-linking to a symbolic vmlinuz as this can lead to a
...
dangling symlink.
6 years ago
4f6e5dc11e
For the pc model, the name changed so we need to special case it a bit.
6 years ago
aba10dc702
vagrant: disabling automatic console log file
6 years ago
1498baada5
The model assertions for 18 don't actually use series=18 because that would be too logical.
6 years ago
b6dedb62ce
Unconditionally set GRUB_FORCE_PARTUUID in cloud images; as of version
...
2.02+dfsg1-5ubuntu5 grub will automatically fall back to booting with an
initrd if one is available, so we can now always attempt initramfsless
boot for cloud images which almost always works and causes only minimal
increase in boot speed for cases where it does not.
6 years ago
c184977a90
Decide what model assertion series to fetch depending on the suite. For xenial use 16 and for others (so bionic+): 18.
6 years ago
5bbb8e6b3f
Improve snap model assertion code for readability
6 years ago
0e00214cc6
Ensure snap models have been added prior to snap preseeding
6 years ago
8d603cc87f
Simplify snap model assertion customization
6 years ago
97b0bbeed3
Add logging when snap assertions are not replaced
6 years ago
52e5a2b25b
Allow hooks to replace generic snap assertion
...
The generic assertion will be put in place if there are preseeded snaps.
A hook that wants to add its own model should be able to overwrite
the generic assertion. This patch allows a hook to continue unchanged
calling snap_prepare_assertions with a custom brand/model. The patch
will replace the generic brand/model if a custom brand/model is specified.
Prior to this patch the generic brand/model would remain in place.
6 years ago
9f96dcb4de
Add the server snap seed to the ubuntu-cpc project
6 years ago
791d2adfd8
merge trunk
6 years ago
08c9c26e58
Ensure /lib/modules exists in root tarballs and sqashfs.
...
(LP: #1792905 )
6 years ago
94230324e0
Stop building buildd chroots with --xattrs until we move to python3.
6 years ago
bb652c238f
Merge trunk.
6 years ago
c4c5c1f349
Generate tar file with --xattrs.
6 years ago
1746e65953
Reorganize minimal-manual file location.
...
This also gets rid of the change to debian/rules
6 years ago
e547599e5a
Add support for raspi3 rootfs generation for ubuntu-image consumption with all the additional changes required.
6 years ago
97fcf09972
Merge trunk
6 years ago
fc6907b701
fixup: Do not assume current directory
6 years ago
2e9349c543
minimize-manual.py: Followup with some cleanup, correct permissions
6 years ago
9360135b2c
Minimize the number of manually installed packages in images by marking
...
dependencies of metapackages as automatically installed.
6 years ago
ae4a760edb
Fix live-server journald config snippet to actually disable journald rate
...
limiting.
6 years ago
e804cc4e00
a less hackish approach
6 years ago
a261471969
a less hackish approach
6 years ago
1aa8b9d882
ffs
6 years ago
00151c5e0b
Set PREINSTALLED=true for live-server so that universe ends up being
...
enabled in the image.
6 years ago
c7ca0a77c8
Merge lp:~vorlon/livecd-rootfs/lp.1302192
6 years ago
7d16b0d40a
Merge lp:~mwhudson/livecd-rootfs/lp-1776891
6 years ago
3db2340c54
generate all tar files with --xattrs. LP: #1302192 .
6 years ago
333a3e2b1b
moderate comment
7 years ago
092b316357
add a comment explaining why /dev cleaning is docker-only
7 years ago
013dff431e
Remove device nodes from Docker images. (LP: #1645468 )
7 years ago
c3f5ee6716
Disable checksum generation
...
These checksums are unused, integrity checking in launchpad is performed
separately.
7 years ago
b7403fabf1
Update unminimize script text and install ubuntu-standard when unminimizing a minimal image (LP: #1778777 )
7 years ago
1e6563aa79
Merge trunk.
7 years ago
baee4ed403
We know cosmic's name now.
7 years ago
c9aaddd56a
Disable journald rate limiting in the live-server live session.
...
(LP: #1776891 )
7 years ago
8b1970f661
live-build/auto/config: Drop "lp-*" hostname filter for Launchpad
...
builders, since LP #1747015 is now fixed; "*.buildd" should be enough.
7 years ago
58b510cf99
ubuntu-cpc: Remove git-man for minimized images
7 years ago
f9cae3ff7f
Restore removal of /boot/grub from rootfs artifacts
7 years ago
Balint Reczey
Didier Roche
Tobias Koch
Colin Watson
Michael Hudson-Doyle
Jean-Baptiste Lallement
Jean-Baptiste Lallement
Łukasz 'sil2100' Zemczak
Colin Watson
Steve Langasek
Dimitri John Ledkov
Cody Shepherd
Steve Langasek
Aleksandr Bogdanov
Robert C Jennings
Adam Conrad
Colin Watson
Julian Andres Klode
Julian Andres Klode
Phil Roche
Daniel Watkins