Colin Watson
3b22ad381a
Make sure buildd images have a /usr/sbin/policy-rc.d symlink
...
Installing policyrcd-script-zg2 doesn't quite do this because of the way
that live-build installs its own temporary version of policy-rc.d. The
only remotely sensible way I can see to deal with this is to create the
symlink manually.
6 years ago
Dimitri John Ledkov
a77ec4a9df
Add python3 vmdkstream support
6 years ago
Dimitri John Ledkov
37d9b77b95
subiquity: make subiqutiy_config.mount optional
...
Remove wants from local-fs.target, add wants from the uuid device instead.
Tested by applying these changes from pre-pivot-root by modifying
/root files in place whilst booting with break=bottom.
6 years ago
Łukasz 'sil2100' Zemczak
8c8b7164d4
Support building pi3-arm64 core18 images. At the same time, make sure we still use the right gadget tree repository for the classic arm64 pi3 image.
6 years ago
Balint Reczey
039ed8ec31
Merge fixing minimized text spacing
6 years ago
Balint Reczey
0182d380ca
Nicely separate motd text about minimizing from texts above
6 years ago
Balint Reczey
8a78ab4021
Merge make-rprivate-before-umount
6 years ago
Balint Reczey
96cc185813
Merge feature/parallelization-snap-version-fixing
6 years ago
Didier Roche
1c435c03d2
Fix customized images with multiple brand/models
...
Some customized images are built from the same chroot, but need to
override brands and models.
6 years ago
Tobias Koch
654fcae467
Replace "snap download" with tool that uses snap store's coherence feature
...
This is important for parallel image builds to ensure all pre-seeded snaps
have the same versions across image variants.
6 years ago
Balint Reczey
33c5ad0b19
live-build/functions: Always use mount --make-private before umount
...
Util-linux 2.33 fixed mount --rbind --make-rslave which did not pass MS_REC
with MS_BIND and livecd-rootfs did only --bind --make-rslave effectively with
prior mount versions.
While mount --rbind --rslave are properly passed the flags to mount()
unmounting did not work cleanly with --make-rslave.
To clearly stop propagation of umount, --make-private is used instead of
--make-rslave and it is always set before umounts. Umount -R is replaced
with a simple umount since submounts are tore down in teardown_mountpoint()
earlier.
LP: #1813730
6 years ago
Balint Reczey
a06d208871
Merge branch feature/parallelization-pkg-version-fixing
6 years ago
Colin Watson
305d5cef50
Drop code to handle buildd images for <disco
...
We'll deal with those in stable updates instead.
6 years ago
Colin Watson
36af2769dc
Disable merged /usr in buildd images
...
Otherwise we might end up building packages with hardcoded paths that
assume a merged /usr.
6 years ago
Tobias Koch
5b70d86f5c
Inject a proxy into the build providing a snapshot view of the package repo.
...
When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
redirect all outgoing HTTP requests to this proxy.
The proxy, contained in the `magic-proxy` Python script, examines each request
and silently overrides those pointing to InRelease files or files that are
listed in InRelease files. It will instead provide the contents of the requested
file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
"by hash".
6 years ago
Michael Hudson-Doyle
a9991a908e
revert change to ubuntu-server:live snap seeding
6 years ago
Jean-Baptiste Lallement
3dce125d72
Remove inidrd and vmlinuz from live layers after they've been moved to casper
6 years ago
Jean-Baptiste Lallement
f5d3233c64
Fixed wonky indentation
6 years ago
Jean-Baptiste Lallement
f84d92d76f
Calculate total size of the image + typos
6 years ago
Jean-Baptiste Lallement
3db920c40c
Fixed quoting of subproject variable
6 years ago
Jean-Baptiste Lallement
52d9bd3ead
Run live specific scripts on non live layers
...
Allow execution of lb_binary_linux-image and lb_chroot_live-packages on
any layer by setting LIVE_PASSES.
6 years ago
Jean-Baptiste Lallement
d1a2e24c41
Adds reduce_pass_size
...
Adds a function reduce_pass_size which removes duplicated files between
layers. A duplicate file is a file with same path, size, mode, owners
and content on 2 related layers.
6 years ago
Jean-Baptiste Lallement
402cdd15be
Adds is_root_layer
...
Factored the code to detect if a layer is a root layer in function
is_root_layer and execute lb_chroot_archives only on root layers.
6 years ago
Jean-Baptiste Lallement
283871573d
Changed the naming scheme for multi layer images to dot format
6 years ago
Jean-Baptiste Lallement
addef92e23
Decouple from ubuntu-cdimage & debian-cd landings
...
We don't want to regress the ubuntu desktop traditional image when
livecd-rootfs lands uncordinated with ubuntu-cdimage & debian-cd.
Decoupling enables us to:
- land livecd-rootfs (no change for ubuntu-desktop project,
ubuntu-desktop:ubiquity-ng can be tested once the 2 others branches
lands)
- land ubuntu-cdimage & debian-cd for publishing any arbitrary squashfs
names
- finally, revert that commit and land it in livecd-rootfs to transform
the traditional ubuntu-desktop image to a layered approach.
6 years ago
Jean-Baptiste Lallement
2d2ce6eea4
Rename chroot.$PASS -> overlay.$PASS
6 years ago
Jean-Baptiste Lallement
e0d30dd2d3
Fixed substract -> subtract
6 years ago
Jean-Baptiste Lallement
15cacaee96
configure network manager _after_ installing network-manager
6 years ago
Jean-Baptiste Lallement
41becb0af7
Ensure snaps are available on ubuntu-server live
6 years ago
Jean-Baptiste Lallement
e0ed85c400
Fixed pattern for matching manifest
6 years ago
Jean-Baptiste Lallement
3075d65578
Cleanup and handle manifest-remove files
...
manifest-remove files are generated in all cases and removed for
projects/subprojects that don't need it like the new ubiquity.
6 years ago
Jean-Baptiste Lallement
9dba350834
Added lb_binary_layered
...
Created lb_binary_layered based on lb_binary
Factorized several helpers
These helpers are called from lb_chroot
6 years ago
Jean-Baptiste Lallement
43ec452fa0
Moved reusable functions to functions
...
Moved functions to reuse in lb_binary and lb_chroot to functions
6 years ago
Jean-Baptiste Lallement
693e0a7360
Clean up chroot helpers
...
Removed obsolete chroot helpers on Disco+:
- selinux
- sysv-rc
- upstart
Added a note about needlessly triggering chroot_archives on each pass.
6 years ago
Jean-Baptiste Lallement
047f883e92
Various fixes
...
Fixed prefix for passes to not conflict with global prefix
Set layer to none for layer without language packs
Copy size and manifest to the target directory
Make sure the diff always diffes existing manifests
6 years ago
Jean-Baptiste Lallement
9077289332
Add includes by pass
...
lb_chroot_includes now takes the name of the pass as first argument and
will includes files for the corresponding pass from the directory
include.chroot.<pass>
6 years ago
Jean-Baptiste Lallement
3b21bd9a2e
Moved back config helper functions to config
...
Moved back config specific functions from functions to config
6 years ago
Jean-Baptiste Lallement
42d1d77612
Layered Ubuntu desktop by default
...
Default Ubuntu desktop to the layered format
Remove the requirement on setting IMAGEFORMAT to layered to build a
layered image and relies on PASSED instead.
6 years ago
Jean-Baptiste Lallement
f3dadf1091
Support for positive and negative sublayers
...
Calculate positive and negative package lists for sublayers
6 years ago
Jean-Baptiste Lallement
a9908e0c9d
Add support for negative package lists
6 years ago
Jean-Baptiste Lallement
53b06af931
Added sublayers support
...
Adds support for sublayers by defining package lists corresponding to
each sublayer. The name of the package list defines the name of the
layer.
6 years ago
Jean-Baptiste Lallement
78c196031b
Add snaps to manifest
...
Make sure that all the snaps are listed in the full manifest of each
layer and as delta in the delta manifest.
6 years ago
Jean-Baptiste Lallement
903ba3b276
Actually install snap for each layer.
6 years ago
Jean-Baptiste Lallement
1ab78e783b
Generate snap list from task
6 years ago
Jean-Baptiste Lallement
00e474e2ff
Make snap functions idempotent
...
_snap_preseed and snap_prepare_assertions can be called several times
with the same snap and will only provision it once.
6 years ago
Jean-Baptiste Lallement
ef72cf5fe8
Code refactoring:
...
* Moved *inheritance functions from config to functions
* Moved code to extract snap from seed to snap_from_seed function
6 years ago
Jean-Baptiste Lallement
6a7368bf95
Clean-up dead code for server live builds.
6 years ago
Jean-Baptiste Lallement
d4f7a0b23d
live-build/auto/config: Added ubuntu-desktop-minimal to install-minimal task
6 years ago
Jean-Baptiste Lallement
0f4fcbc7d3
lb_chroot_layered: Export _PASS as PASS to be available in hooks
6 years ago
Jean-Baptiste Lallement
d5a16296f4
live-build/auto/build: Create one manifest by layer in diff format and one full manifest with all the layers in standard format
6 years ago
Jean-Baptiste Lallement
ca63d43696
live-build/auto/build: Add size of the filesystems. This is used by the installer to calculate the minimum partition size to reserve for installation. The installer will have to sum all the sizes to compute the final size. Thank didrocks
6 years ago
Jean-Baptiste Lallement
7e2f4d4304
live-build/lb_chroot_layered: removed useless comment
6 years ago
Jean-Baptiste Lallement
940873e6cb
live-build/lb_chroot_layered: overlayfs supports only 2 stacked layers. Changed the code to use several lower dirs instead like casper does
6 years ago
Jean-Baptiste Lallement
b6287916c2
auto/build: Order generated squashfs filesystems
6 years ago
Jean-Baptiste Lallement
ce973ba07b
auto/build: Removed useless comment
6 years ago
Jean-Baptiste Lallement
7b4acba31d
* Added lb_chroot_layered to add support for multi layered squashfs images
...
* auto/*: Added live-layered image format
6 years ago
Jean-Baptiste Lallement
3e34faaa70
Moved add_task and add_package to functions in order to be available in hooks
6 years ago
Łukasz 'sil2100' Zemczak
b3dd27aedd
Use linux-firmware-raspi2 instead of raspi3-firmware.
6 years ago
Colin Watson
2b15590f3b
Fix buildd images for series earlier than bionic
...
Don't install gpg or gpg-agent when building buildd images for series
earlier than bionic. (In earlier series, those packages didn't exist
and gnupg was build-essential.)
6 years ago
Łukasz 'sil2100' Zemczak
bf61fdecf3
Merge branch 'ubuntu/master' of git+ssh://git.launchpad.net/livecd-rootfs into sil2100/raspi-wpasupplicant
6 years ago
Łukasz 'sil2100' Zemczak
abec4f4c1d
Link to the proper name instead.
6 years ago
Łukasz 'sil2100' Zemczak
e60bcbaecd
Add proper IMAGAFORMAT for raspi3 classic builds, output the images with the expected naming.
6 years ago
Colin Watson
46942330d8
Move buildd image building to binary hooks
6 years ago
Colin Watson
082a2046e7
Add a LXD image to builds for the buildd subproject
6 years ago
Michael Hudson-Doyle
625ace8483
Do not include curtin in the live-server installer.squashfs as the version of subiquity that includes it in the snap has now been released to stable.
6 years ago
Łukasz 'sil2100' Zemczak
85eed4a91d
Add wpasupplicant to the additional packages installed for the raspi2 and raspi3 targets.
6 years ago
Michael Hudson-Doyle
1b93df3ae8
A few simple tweaks to reduce size of live servers installer.squashfs
...
- Do not run apt-get update (which can bring in package lists if we are
unlikely wrt publisher schedules).
- Run apt-get clean to clear out downloaded debs of curtin/casper and
dependencies.
- Do not install user-setup.
- Use the core snap from the base filesystem if present.
6 years ago
Michael Hudson-Doyle
1e9fc65863
Use right lsb_release argument for HWE kernel name (-sc -> bionic, need -sr -> 18.04).
6 years ago
Michael Hudson-Doyle
f81fb59a00
Do no install openssh-server in the base filsystem for the live server installer.
6 years ago
Michael Hudson-Doyle
460332296b
remove cloud-initramfs-copymods before installing kernel
6 years ago
Michael Hudson-Doyle
7167e3718b
add initramfs hook to record kernel metapackage & mount modules
6 years ago
Michael Hudson-Doyle
5565e3a3d8
add hook to create kernel/initrd/modules for ISO
6 years ago
Michael Hudson-Doyle
e3e2e5f9ff
do not unmount the installer overlay in 032-installer-squashfs.binary
...
so that a new hook can create yet further overlays on top of it
6 years ago
Michael Hudson-Doyle
c4e5659217
do not include kernel in base install for ubuntu-server:live
...
this actually makes things closer to the non-live server build and so
makes things a bit simpler
6 years ago
Balint Reczey
73409ddb77
Add .keep files to preserve empty directories
6 years ago
Michael Hudson-Doyle
4b01505952
Fix typo preventing builds of ubuntu-core images.
6 years ago
Tobias Koch
cbd4eb5717
Use series files with dependency handling to generate hook symlinks dynamically
...
This patch currently only applies to the "ubuntu-cpc" project.
More and more logic has been going into the hook scripts to decide under which conditions they should run or not. As we are moving to parallelized builds of image sets, this will get even more complicated. Base hooks will have to know which image sets they belong to and modification of the dependency chain between scripts will become more complicated and prone to errors, as the number of image sets grows.
This patch introduces explicit ordering and dependency handling for scripts through the use of `series` files and an explicit syntax for dependency specification.
6 years ago
Steve Langasek
5300bb9eb7
Key netplan delegation to NetworkManager on presence of
...
/usr/sbin/NetworkManager, not on /usr/lib/NetworkManager which may have
hooks from other packages (i.e., wpasupplicant).
6 years ago
Łukasz 'sil2100' Zemczak
6345ccd34c
Add a few minor fixes for raspi3 builds.
6 years ago
Łukasz 'sil2100' Zemczak
d3eb3dd0ac
Add missing arguments to ubuntu-image classic calls.
6 years ago
Łukasz 'sil2100' Zemczak
c229012efb
Add raspi3 arm64 rootfs build support.
6 years ago
Łukasz 'sil2100' Zemczak
65d907268a
raspi3 support: be sure to create /boot/firmware during pi3 rootfs builds. Also, for the raspi3 we need to explicitly specify the kernel flavor to raspi2. We also switch to using raspi3-firmware instead of linux-firmware-raspi2 because the latter is not available for arm64.
6 years ago
Steve Langasek
6ee39485dd
Merge lp:~sil2100/livecd-rootfs/use-ubuntu-image-classic
6 years ago
Łukasz 'sil2100' Zemczak
05a8be839f
Do the same for ubuntu-image snap builds.
6 years ago
Łukasz 'sil2100' Zemczak
8a33b23dd0
Use -O instead of -o for ubuntu-image classic builds.
6 years ago
Łukasz 'sil2100' Zemczak
2947cdbe60
First batch of obvious changes - use better shellism, only call make (without make install).
6 years ago
Steve Langasek
f2f3512339
Merge lp:~mzanetti/livecd-rootfs/drop-sf-support
6 years ago
Steve Langasek
b3c9d8bac8
Merge lp:~sil2100/livecd-rootfs/raspi3-u-i-classic
6 years ago
Steve Langasek
77c44167df
Delete no longer accurate comments
6 years ago
Dimitri John Ledkov
75b9ab1664
Move overlay include.binary /lib to /usr/lib.
6 years ago
Dimitri John Ledkov
93df6705a0
Revert "Do not mount result, on top of lowerdir, appears to fail in
...
disco." the actual problem is in live-build with merged-usr and
copying over chroot/binary includes.
6 years ago
Dimitri John Ledkov
9a8d7117e3
Also strip duplicate \n from the below.
6 years ago
Dimitri John Ledkov
0c2e3c1342
Fix snap-seed-parse to take filename argument instead of printing to
...
stdout
6 years ago
Cody Shepherd
c7e0c27607
[ Cody Shepherd ]
...
Fix snap-seed-parse to take filename argument instead of printing to
stdout
6 years ago
Dimitri John Ledkov
8868522e78
When calling snap-seed-parse append stdout to file, but redirect
...
stderr to stdout, thus unbreak autopkgtests.
6 years ago
Dimitri John Ledkov
1b424926db
Do not mount result, on top of lowerdir, appears to fail in disco.
6 years ago
Dimitri John Ledkov
e24dccadcc
mount_overlay only takes 3 args
6 years ago
Steve Langasek
1e1c6a8572
Properly fix the hard-linking of vmlinuz, taken astray by my misguided
...
merge review.
6 years ago
Steve Langasek
8f910aab4b
Merge lp:~vorlon/livecd-rootfs/initramfsless-everywhere
6 years ago
Łukasz 'sil2100' Zemczak
a3a9b2ab60
Merge latest prerequisite branch.
6 years ago
Łukasz 'sil2100' Zemczak
b0910cbe50
Remove more unneeded raspi3 conditionals.
6 years ago
Łukasz 'sil2100' Zemczak
37f3cb1714
Merge latest prerequisite branch.
6 years ago
Łukasz 'sil2100' Zemczak
2e3c7d050c
Remove unneeded code and code duplication, add comments.
6 years ago
Łukasz 'sil2100' Zemczak
6ac3384f34
Merge latest prerequisite branch
6 years ago
Łukasz 'sil2100' Zemczak
a274206e1a
Don't overcomplicate bash conditionals.
6 years ago
Łukasz 'sil2100' Zemczak
cc5d39b93d
Merge latest prerequisite branches.
6 years ago
Łukasz 'sil2100' Zemczak
501afa0783
Merge latest prerequisite branch
6 years ago
Łukasz 'sil2100' Zemczak
61ba85df21
Merge trunk
6 years ago
Łukasz 'sil2100' Zemczak
f8529c9038
Add support for building classic images using makefile-based gadget trees.
6 years ago
Steve Langasek
41382692ba
Merge lp:~codyshepherd/livecd-rootfs/uefi-manifests-cosmic
6 years ago
Cody Shepherd
a9935923f8
Changes to include grub efi packages and dependencies in uefi image manifests.
6 years ago
Steve Langasek
840015fbbe
Merge lp:~aleks.bogdanov/livecd-rootfs/remove-vagrant-console-log
6 years ago
Cody Shepherd
2819290352
Changed absoluted paths to relative; set changelog message to UNRELEASED
6 years ago
Cody Shepherd
5bee1ade70
Ensure pre-seeded snaps are now published in the image manifests.
6 years ago
Łukasz 'sil2100' Zemczak
41b4130759
* Add support for raspi3 rootfs builds (based on Ryan Finnie).
...
* For ubuntu-image consumption, export the kernel and initrd to
image/boot/uboot for raspi*.
6 years ago
Łukasz 'sil2100' Zemczak
e115b2cbe7
Avoid issues of hard-linking to a symbolic vmlinuz as this can lead to a
...
dangling symlink.
6 years ago
Łukasz 'sil2100' Zemczak
4f6e5dc11e
For the pc model, the name changed so we need to special case it a bit.
6 years ago
Aleksandr Bogdanov
aba10dc702
vagrant: disabling automatic console log file
6 years ago
Łukasz 'sil2100' Zemczak
1498baada5
The model assertions for 18 don't actually use series=18 because that would be too logical.
6 years ago
Steve Langasek
b6dedb62ce
Unconditionally set GRUB_FORCE_PARTUUID in cloud images; as of version
...
2.02+dfsg1-5ubuntu5 grub will automatically fall back to booting with an
initrd if one is available, so we can now always attempt initramfsless
boot for cloud images which almost always works and causes only minimal
increase in boot speed for cases where it does not.
6 years ago
Łukasz 'sil2100' Zemczak
c184977a90
Decide what model assertion series to fetch depending on the suite. For xenial use 16 and for others (so bionic+): 18.
6 years ago
Robert C Jennings
5bbb8e6b3f
Improve snap model assertion code for readability
6 years ago
Robert C Jennings
0e00214cc6
Ensure snap models have been added prior to snap preseeding
6 years ago
Robert C Jennings
8d603cc87f
Simplify snap model assertion customization
6 years ago
Robert C Jennings
97b0bbeed3
Add logging when snap assertions are not replaced
6 years ago
Robert C Jennings
52e5a2b25b
Allow hooks to replace generic snap assertion
...
The generic assertion will be put in place if there are preseeded snaps.
A hook that wants to add its own model should be able to overwrite
the generic assertion. This patch allows a hook to continue unchanged
calling snap_prepare_assertions with a custom brand/model. The patch
will replace the generic brand/model if a custom brand/model is specified.
Prior to this patch the generic brand/model would remain in place.
6 years ago
Robert C Jennings
9f96dcb4de
Add the server snap seed to the ubuntu-cpc project
6 years ago
Michael Hudson-Doyle
791d2adfd8
merge trunk
6 years ago
Dimitri John Ledkov
08c9c26e58
Ensure /lib/modules exists in root tarballs and sqashfs.
...
(LP: #1792905 )
6 years ago
Adam Conrad
94230324e0
Stop building buildd chroots with --xattrs until we move to python3.
6 years ago
Colin Watson
bb652c238f
Merge trunk.
6 years ago
Colin Watson
c4c5c1f349
Generate tar file with --xattrs.
6 years ago
Julian Andres Klode
1746e65953
Reorganize minimal-manual file location.
...
This also gets rid of the change to debian/rules
6 years ago
Łukasz 'sil2100' Zemczak
e547599e5a
Add support for raspi3 rootfs generation for ubuntu-image consumption with all the additional changes required.
6 years ago
Łukasz 'sil2100' Zemczak
97fcf09972
Merge trunk
6 years ago
Julian Andres Klode
fc6907b701
fixup: Do not assume current directory
6 years ago
Julian Andres Klode
2e9349c543
minimize-manual.py: Followup with some cleanup, correct permissions
6 years ago
Julian Andres Klode
9360135b2c
Minimize the number of manually installed packages in images by marking
...
dependencies of metapackages as automatically installed.
6 years ago
Michael Hudson-Doyle
ae4a760edb
Fix live-server journald config snippet to actually disable journald rate
...
limiting.
6 years ago
Michael Hudson-Doyle
e804cc4e00
a less hackish approach
6 years ago
Michael Hudson-Doyle
a261471969
a less hackish approach
6 years ago
Michael Hudson-Doyle
1aa8b9d882
ffs
6 years ago
Michael Hudson-Doyle
00151c5e0b
Set PREINSTALLED=true for live-server so that universe ends up being
...
enabled in the image.
6 years ago
Steve Langasek
c7ca0a77c8
Merge lp:~vorlon/livecd-rootfs/lp.1302192
6 years ago
Steve Langasek
7d16b0d40a
Merge lp:~mwhudson/livecd-rootfs/lp-1776891
6 years ago
Steve Langasek
3db2340c54
generate all tar files with --xattrs. LP: #1302192 .
6 years ago
Michael Hudson-Doyle
333a3e2b1b
moderate comment
7 years ago
Michael Hudson-Doyle
092b316357
add a comment explaining why /dev cleaning is docker-only
7 years ago
Michael Hudson-Doyle
013dff431e
Remove device nodes from Docker images. (LP: #1645468 )
7 years ago
Robert C Jennings
c3f5ee6716
Disable checksum generation
...
These checksums are unused, integrity checking in launchpad is performed
separately.
7 years ago