609 Commits

Author SHA1 Message Date
Julian Andres Klode
e95ad81c47 Run clean_debian_chroot after minimize_manual
This avoids us having apt cache files in the final image.

For auto/build, we move the call to clean_debian_chroot to the end,
this also takes care of the caches generated by apt-get update
in case of a preinstalled-pool.

For layered, it's just a simple swap of the lines.

LP: #1826377
2019-04-25 11:51:30 +02:00
Tobias Koch
05e71b3840 Do not include any snaps in ubuntu-cpc:minimized builds 2019-04-12 13:37:02 -07:00
Balint Reczey
2d162dd121 Pass --sort=name to tar to make tarballs more reproducible and rsync-friendly 2019-04-10 14:38:35 +02:00
Didier Roche
b20cf752e6 Add languages to live pass
The name of the pass is live and not "ubuntu-live" which is the live pass
default task.
2019-03-20 17:10:05 +01:00
Didier Roche
995f3cf9e0 Ensure default langpacks are removed after installation
Add langpacks to live tasks to have them in the ubiquity diff file and
thus, purged after installation if not selected. (LP: #1818890)
2019-03-18 09:45:47 +01:00
Jean-Baptiste Lallement
38bb0b3301 Fix grub divert for multilayer images
grub-probe must not be called during image build so grub is diverted. In
multilayer image the chroot is always the tip of the filesystem, so we
divert grub at the beginning of each pass and undivdert it as the end.
For flat images, it's diverted just before building the chroot and
undiverted after.
2019-03-18 09:33:07 +01:00
Steve Langasek
ea5f01942f divert grub when calling into lb chroot
UbuntuStudio image builds have recently begun failing as a result of adding a
grub theme customization to their flavor, which they then try to apply by
running update-grub from their maintainer scripts.  This fails with:

  Setting up plymouth-theme-ubuntustudio (0.57) ...
  update-alternatives: using /usr/share/plymouth/themes/ubuntustudio-logo/ubuntustudio-logo.plymouth to provide /usr/share/plymouth/themes/default.plymouth (default.plymouth) in auto mode
  update-alternatives: using /usr/share/plymouth/themes/ubuntustudio-text/ubuntustudio-text.plymouth to provide /usr/share/plymouth/themes/text.plymouth (text.plymouth) in auto mode
  update-initramfs: diverted by livecd-rootfs (will be called later)
  /usr/sbin/grub-probe: error: cannot find a device for / (is /dev mounted?).
  dpkg: error processing package plymouth-theme-ubuntustudio (--configure):
   installed plymouth-theme-ubuntustudio package post-installation script subprocess returned error exit status 1

Packages providing grub themes should be able to call update-grub from their
maintainer scripts, and they should be able to be installed under
livecd-rootfs.  It's surprising to me that this hasn't been a problem before
now for any flavors.

We know that grub-probe should not be called as part of an image build, so
just use our standard helper function to divert it before running the chroot
stage and undivert it after.
2019-03-09 20:08:29 +00:00
Łukasz 'sil2100' Zemczak
8c8b7164d4 Support building pi3-arm64 core18 images. At the same time, make sure we still use the right gadget tree repository for the classic arm64 pi3 image. 2019-02-06 18:11:27 +01:00
Balint Reczey
039ed8ec31 Merge fixing minimized text spacing 2019-02-06 17:55:10 +07:00
Balint Reczey
0182d380ca Nicely separate motd text about minimizing from texts above 2019-02-05 17:24:09 +07:00
Balint Reczey
a06d208871 Merge branch feature/parallelization-pkg-version-fixing 2019-02-04 23:03:56 +07:00
Colin Watson
305d5cef50 Drop code to handle buildd images for <disco
We'll deal with those in stable updates instead.
2019-02-01 18:07:58 +00:00
Colin Watson
36af2769dc Disable merged /usr in buildd images
Otherwise we might end up building packages with hardcoded paths that
assume a merged /usr.
2019-02-01 18:03:20 +00:00
Tobias Koch
5b70d86f5c Inject a proxy into the build providing a snapshot view of the package repo.
When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
redirect all outgoing HTTP requests to this proxy.

The proxy, contained in the `magic-proxy` Python script, examines each request
and silently overrides those pointing to InRelease files or files that are
listed in InRelease files. It will instead provide the contents of the requested
file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
"by hash".
2019-02-01 11:26:20 +01:00
Michael Hudson-Doyle
a9991a908e revert change to ubuntu-server:live snap seeding 2019-02-01 17:22:25 +13:00
Jean-Baptiste Lallement
f84d92d76f Calculate total size of the image + typos 2019-01-30 12:29:57 +01:00
Jean-Baptiste Lallement
3db920c40c Fixed quoting of subproject variable 2019-01-30 12:29:57 +01:00
Jean-Baptiste Lallement
52d9bd3ead Run live specific scripts on non live layers
Allow execution of lb_binary_linux-image and lb_chroot_live-packages on
any layer by setting LIVE_PASSES.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
283871573d Changed the naming scheme for multi layer images to dot format 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
addef92e23 Decouple from ubuntu-cdimage & debian-cd landings
We don't want to regress the ubuntu desktop traditional image when
livecd-rootfs lands uncordinated with ubuntu-cdimage & debian-cd.
Decoupling enables us to:
- land livecd-rootfs (no change for ubuntu-desktop project,
ubuntu-desktop:ubiquity-ng can be tested once the 2 others branches
lands)
- land ubuntu-cdimage & debian-cd for publishing any arbitrary squashfs
names
- finally, revert that commit and land it in livecd-rootfs to transform
the traditional ubuntu-desktop image to a layered approach.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
2d2ce6eea4 Rename chroot.$PASS -> overlay.$PASS 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
e0d30dd2d3 Fixed substract -> subtract 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
41becb0af7 Ensure snaps are available on ubuntu-server live 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
3075d65578 Cleanup and handle manifest-remove files
manifest-remove files are generated in all cases and removed for
projects/subprojects that don't need it like the new ubiquity.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
9dba350834 Added lb_binary_layered
Created lb_binary_layered based on lb_binary
Factorized several helpers
These helpers are called from lb_chroot
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
43ec452fa0 Moved reusable functions to functions
Moved functions to reuse in lb_binary and lb_chroot to functions
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
047f883e92 Various fixes
Fixed prefix for passes to not conflict with global prefix
Set layer to none for layer without language packs
Copy size and manifest to the target directory
Make sure the diff always diffes existing manifests
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
3b21bd9a2e Moved back config helper functions to config
Moved back config specific functions from functions to config
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
42d1d77612 Layered Ubuntu desktop by default
Default Ubuntu desktop to the layered format
Remove the requirement on setting IMAGEFORMAT to layered to build a
layered image and relies on PASSED instead.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
f3dadf1091 Support for positive and negative sublayers
Calculate positive and negative package lists for sublayers
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
53b06af931 Added sublayers support
Adds support for sublayers by defining package lists corresponding to
each sublayer. The name of the package list defines the name of the
layer.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
78c196031b Add snaps to manifest
Make sure that all the snaps are listed in the full manifest of each
layer and as delta in the delta manifest.
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
ef72cf5fe8 Code refactoring:
* Moved *inheritance functions from config to functions
 * Moved code to extract snap from seed to snap_from_seed function
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
6a7368bf95 Clean-up dead code for server live builds. 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
d4f7a0b23d live-build/auto/config: Added ubuntu-desktop-minimal to install-minimal task 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
d5a16296f4 live-build/auto/build: Create one manifest by layer in diff format and one full manifest with all the layers in standard format 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
ca63d43696 live-build/auto/build: Add size of the filesystems. This is used by the installer to calculate the minimum partition size to reserve for installation. The installer will have to sum all the sizes to compute the final size. Thank didrocks 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
b6287916c2 auto/build: Order generated squashfs filesystems 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
ce973ba07b auto/build: Removed useless comment 2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
7b4acba31d * Added lb_chroot_layered to add support for multi layered squashfs images
* auto/*: Added live-layered image format
2019-01-30 12:29:56 +01:00
Jean-Baptiste Lallement
3e34faaa70 Moved add_task and add_package to functions in order to be available in hooks 2019-01-30 12:29:56 +01:00
Łukasz 'sil2100' Zemczak
b3dd27aedd Use linux-firmware-raspi2 instead of raspi3-firmware. 2019-01-18 17:10:11 +01:00
Colin Watson
2b15590f3b Fix buildd images for series earlier than bionic
Don't install gpg or gpg-agent when building buildd images for series
earlier than bionic.  (In earlier series, those packages didn't exist
and gnupg was build-essential.)
2019-01-16 12:39:21 +00:00
Łukasz 'sil2100' Zemczak
bf61fdecf3 Merge branch 'ubuntu/master' of git+ssh://git.launchpad.net/livecd-rootfs into sil2100/raspi-wpasupplicant 2019-01-11 11:24:54 +01:00
Łukasz 'sil2100' Zemczak
abec4f4c1d Link to the proper name instead. 2019-01-10 22:58:07 +01:00
Łukasz 'sil2100' Zemczak
e60bcbaecd Add proper IMAGAFORMAT for raspi3 classic builds, output the images with the expected naming. 2019-01-09 10:47:24 +01:00
Colin Watson
46942330d8 Move buildd image building to binary hooks 2018-12-20 01:20:57 +00:00
Colin Watson
082a2046e7 Add a LXD image to builds for the buildd subproject 2018-12-19 22:11:16 +00:00
Łukasz 'sil2100' Zemczak
85eed4a91d Add wpasupplicant to the additional packages installed for the raspi2 and raspi3 targets. 2018-12-17 17:34:43 +01:00
Michael Hudson-Doyle
f81fb59a00 Do no install openssh-server in the base filsystem for the live server installer. 2018-12-17 13:40:57 +13:00