a06d208871
Merge branch feature/parallelization-pkg-version-fixing
6 years ago
305d5cef50
Drop code to handle buildd images for <disco
...
We'll deal with those in stable updates instead.
6 years ago
36af2769dc
Disable merged /usr in buildd images
...
Otherwise we might end up building packages with hardcoded paths that
assume a merged /usr.
6 years ago
5b70d86f5c
Inject a proxy into the build providing a snapshot view of the package repo.
...
When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
redirect all outgoing HTTP requests to this proxy.
The proxy, contained in the `magic-proxy` Python script, examines each request
and silently overrides those pointing to InRelease files or files that are
listed in InRelease files. It will instead provide the contents of the requested
file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
"by hash".
6 years ago
a9991a908e
revert change to ubuntu-server:live snap seeding
6 years ago
f84d92d76f
Calculate total size of the image + typos
6 years ago
3db920c40c
Fixed quoting of subproject variable
6 years ago
52d9bd3ead
Run live specific scripts on non live layers
...
Allow execution of lb_binary_linux-image and lb_chroot_live-packages on
any layer by setting LIVE_PASSES.
6 years ago
283871573d
Changed the naming scheme for multi layer images to dot format
6 years ago
addef92e23
Decouple from ubuntu-cdimage & debian-cd landings
...
We don't want to regress the ubuntu desktop traditional image when
livecd-rootfs lands uncordinated with ubuntu-cdimage & debian-cd.
Decoupling enables us to:
- land livecd-rootfs (no change for ubuntu-desktop project,
ubuntu-desktop:ubiquity-ng can be tested once the 2 others branches
lands)
- land ubuntu-cdimage & debian-cd for publishing any arbitrary squashfs
names
- finally, revert that commit and land it in livecd-rootfs to transform
the traditional ubuntu-desktop image to a layered approach.
6 years ago
2d2ce6eea4
Rename chroot.$PASS -> overlay.$PASS
6 years ago
e0d30dd2d3
Fixed substract -> subtract
6 years ago
41becb0af7
Ensure snaps are available on ubuntu-server live
6 years ago
3075d65578
Cleanup and handle manifest-remove files
...
manifest-remove files are generated in all cases and removed for
projects/subprojects that don't need it like the new ubiquity.
6 years ago
9dba350834
Added lb_binary_layered
...
Created lb_binary_layered based on lb_binary
Factorized several helpers
These helpers are called from lb_chroot
6 years ago
43ec452fa0
Moved reusable functions to functions
...
Moved functions to reuse in lb_binary and lb_chroot to functions
6 years ago
047f883e92
Various fixes
...
Fixed prefix for passes to not conflict with global prefix
Set layer to none for layer without language packs
Copy size and manifest to the target directory
Make sure the diff always diffes existing manifests
6 years ago
3b21bd9a2e
Moved back config helper functions to config
...
Moved back config specific functions from functions to config
6 years ago
42d1d77612
Layered Ubuntu desktop by default
...
Default Ubuntu desktop to the layered format
Remove the requirement on setting IMAGEFORMAT to layered to build a
layered image and relies on PASSED instead.
6 years ago
f3dadf1091
Support for positive and negative sublayers
...
Calculate positive and negative package lists for sublayers
6 years ago
53b06af931
Added sublayers support
...
Adds support for sublayers by defining package lists corresponding to
each sublayer. The name of the package list defines the name of the
layer.
6 years ago
78c196031b
Add snaps to manifest
...
Make sure that all the snaps are listed in the full manifest of each
layer and as delta in the delta manifest.
6 years ago
ef72cf5fe8
Code refactoring:
...
* Moved *inheritance functions from config to functions
* Moved code to extract snap from seed to snap_from_seed function
6 years ago
6a7368bf95
Clean-up dead code for server live builds.
6 years ago
d4f7a0b23d
live-build/auto/config: Added ubuntu-desktop-minimal to install-minimal task
6 years ago
d5a16296f4
live-build/auto/build: Create one manifest by layer in diff format and one full manifest with all the layers in standard format
6 years ago
ca63d43696
live-build/auto/build: Add size of the filesystems. This is used by the installer to calculate the minimum partition size to reserve for installation. The installer will have to sum all the sizes to compute the final size. Thank didrocks
6 years ago
b6287916c2
auto/build: Order generated squashfs filesystems
6 years ago
ce973ba07b
auto/build: Removed useless comment
6 years ago
7b4acba31d
* Added lb_chroot_layered to add support for multi layered squashfs images
...
* auto/*: Added live-layered image format
6 years ago
3e34faaa70
Moved add_task and add_package to functions in order to be available in hooks
6 years ago
b3dd27aedd
Use linux-firmware-raspi2 instead of raspi3-firmware.
6 years ago
2b15590f3b
Fix buildd images for series earlier than bionic
...
Don't install gpg or gpg-agent when building buildd images for series
earlier than bionic. (In earlier series, those packages didn't exist
and gnupg was build-essential.)
6 years ago
bf61fdecf3
Merge branch 'ubuntu/master' of git+ssh://git.launchpad.net/livecd-rootfs into sil2100/raspi-wpasupplicant
6 years ago
abec4f4c1d
Link to the proper name instead.
6 years ago
e60bcbaecd
Add proper IMAGAFORMAT for raspi3 classic builds, output the images with the expected naming.
6 years ago
46942330d8
Move buildd image building to binary hooks
6 years ago
082a2046e7
Add a LXD image to builds for the buildd subproject
6 years ago
85eed4a91d
Add wpasupplicant to the additional packages installed for the raspi2 and raspi3 targets.
6 years ago
f81fb59a00
Do no install openssh-server in the base filsystem for the live server installer.
6 years ago
c4e5659217
do not include kernel in base install for ubuntu-server:live
...
this actually makes things closer to the non-live server build and so
makes things a bit simpler
6 years ago
4b01505952
Fix typo preventing builds of ubuntu-core images.
6 years ago
cbd4eb5717
Use series files with dependency handling to generate hook symlinks dynamically
...
This patch currently only applies to the "ubuntu-cpc" project.
More and more logic has been going into the hook scripts to decide under which conditions they should run or not. As we are moving to parallelized builds of image sets, this will get even more complicated. Base hooks will have to know which image sets they belong to and modification of the dependency chain between scripts will become more complicated and prone to errors, as the number of image sets grows.
This patch introduces explicit ordering and dependency handling for scripts through the use of `series` files and an explicit syntax for dependency specification.
6 years ago
5300bb9eb7
Key netplan delegation to NetworkManager on presence of
...
/usr/sbin/NetworkManager, not on /usr/lib/NetworkManager which may have
hooks from other packages (i.e., wpasupplicant).
6 years ago
6345ccd34c
Add a few minor fixes for raspi3 builds.
6 years ago
d3eb3dd0ac
Add missing arguments to ubuntu-image classic calls.
6 years ago
c229012efb
Add raspi3 arm64 rootfs build support.
6 years ago
65d907268a
raspi3 support: be sure to create /boot/firmware during pi3 rootfs builds. Also, for the raspi3 we need to explicitly specify the kernel flavor to raspi2. We also switch to using raspi3-firmware instead of linux-firmware-raspi2 because the latter is not available for arm64.
6 years ago
6ee39485dd
Merge lp:~sil2100/livecd-rootfs/use-ubuntu-image-classic
6 years ago
05a8be839f
Do the same for ubuntu-image snap builds.
6 years ago
8a33b23dd0
Use -O instead of -o for ubuntu-image classic builds.
6 years ago
2947cdbe60
First batch of obvious changes - use better shellism, only call make (without make install).
6 years ago
b3c9d8bac8
Merge lp:~sil2100/livecd-rootfs/raspi3-u-i-classic
6 years ago
77c44167df
Delete no longer accurate comments
6 years ago
c7e0c27607
[ Cody Shepherd ]
...
Fix snap-seed-parse to take filename argument instead of printing to
stdout
6 years ago
8868522e78
When calling snap-seed-parse append stdout to file, but redirect
...
stderr to stdout, thus unbreak autopkgtests.
6 years ago
1e1c6a8572
Properly fix the hard-linking of vmlinuz, taken astray by my misguided
...
merge review.
6 years ago
a3a9b2ab60
Merge latest prerequisite branch.
6 years ago
b0910cbe50
Remove more unneeded raspi3 conditionals.
6 years ago
37f3cb1714
Merge latest prerequisite branch.
6 years ago
2e3c7d050c
Remove unneeded code and code duplication, add comments.
6 years ago
6ac3384f34
Merge latest prerequisite branch
6 years ago
a274206e1a
Don't overcomplicate bash conditionals.
6 years ago
cc5d39b93d
Merge latest prerequisite branches.
6 years ago
501afa0783
Merge latest prerequisite branch
6 years ago
61ba85df21
Merge trunk
6 years ago
f8529c9038
Add support for building classic images using makefile-based gadget trees.
6 years ago
2819290352
Changed absoluted paths to relative; set changelog message to UNRELEASED
6 years ago
5bee1ade70
Ensure pre-seeded snaps are now published in the image manifests.
6 years ago
41b4130759
* Add support for raspi3 rootfs builds (based on Ryan Finnie).
...
* For ubuntu-image consumption, export the kernel and initrd to
image/boot/uboot for raspi*.
6 years ago
e115b2cbe7
Avoid issues of hard-linking to a symbolic vmlinuz as this can lead to a
...
dangling symlink.
6 years ago
4f6e5dc11e
For the pc model, the name changed so we need to special case it a bit.
6 years ago
1498baada5
The model assertions for 18 don't actually use series=18 because that would be too logical.
6 years ago
c184977a90
Decide what model assertion series to fetch depending on the suite. For xenial use 16 and for others (so bionic+): 18.
6 years ago
9f96dcb4de
Add the server snap seed to the ubuntu-cpc project
6 years ago
791d2adfd8
merge trunk
6 years ago
94230324e0
Stop building buildd chroots with --xattrs until we move to python3.
6 years ago
bb652c238f
Merge trunk.
6 years ago
c4c5c1f349
Generate tar file with --xattrs.
6 years ago
1746e65953
Reorganize minimal-manual file location.
...
This also gets rid of the change to debian/rules
6 years ago
e547599e5a
Add support for raspi3 rootfs generation for ubuntu-image consumption with all the additional changes required.
6 years ago
97fcf09972
Merge trunk
6 years ago
fc6907b701
fixup: Do not assume current directory
6 years ago
2e9349c543
minimize-manual.py: Followup with some cleanup, correct permissions
6 years ago
9360135b2c
Minimize the number of manually installed packages in images by marking
...
dependencies of metapackages as automatically installed.
6 years ago
e804cc4e00
a less hackish approach
6 years ago
a261471969
a less hackish approach
6 years ago
1aa8b9d882
ffs
6 years ago
00151c5e0b
Set PREINSTALLED=true for live-server so that universe ends up being
...
enabled in the image.
6 years ago
3db2340c54
generate all tar files with --xattrs. LP: #1302192 .
6 years ago
333a3e2b1b
moderate comment
7 years ago
092b316357
add a comment explaining why /dev cleaning is docker-only
7 years ago
013dff431e
Remove device nodes from Docker images. (LP: #1645468 )
7 years ago
c3f5ee6716
Disable checksum generation
...
These checksums are unused, integrity checking in launchpad is performed
separately.
7 years ago
b7403fabf1
Update unminimize script text and install ubuntu-standard when unminimizing a minimal image (LP: #1778777 )
7 years ago
1e6563aa79
Merge trunk.
7 years ago
baee4ed403
We know cosmic's name now.
7 years ago
8b1970f661
live-build/auto/config: Drop "lp-*" hostname filter for Launchpad
...
builders, since LP #1747015 is now fixed; "*.buildd" should be enough.
7 years ago
80459b6c1b
ubuntu-cpc: Use linux-kvm for all amd64 minimized builds (LP: #1775472 ).
7 years ago
664ace2f30
man un-diverting man idempotent
7 years ago
7c7c2c5b30
rm -r the lists
7 years ago
ccef323973
go back to having docker unminimize not install any extra packages
...
update text of man diversion to mention need to install man-db package
7 years ago
2fc3993d48
Remove apt lists that are currently removed downstream anyway.
...
(LP: #1699913 )
7 years ago
fa1bce5389
still install a few packages in docker unminimize
7 years ago
514faae2db
divert /usr/bin/man in minimized images to a script that mentions the unminimize script
7 years ago
7e1bd33544
do not install ubuntu-minimal in ubuntu-base's unminimize
7 years ago
7982442e32
Avoid issues of hard-linking to a symbolic vmlinuz as this can lead to a dangling symlink.
7 years ago
9ba04172d4
Completely drop Lubuntu Next.
7 years ago
382f17b08c
Don't follow recommends.
7 years ago
480e02443e
Drop seed workarounds for unbuilt Lubuntu Next.
7 years ago
1fab544a84
Add init to buildd chroots, since it's needed for LXD-based builds.
7 years ago
b77de06bfd
Remove some unnecessary buildd configuration.
7 years ago
07487675b6
Sort buildd tarballs by name and use numeric user and group IDs.
7 years ago
416093beec
Use a public-facing mirror URL in the final buildd /etc/apt/sources.list.
7 years ago
cb22177287
Add a buildd subproject.
7 years ago
e6089e9e32
Remove landscape-common from minimal image, and handle restoring it in
...
unminimize script. LP: #1763182 .
7 years ago
65dd7df171
last minute pre-upload typo fix
7 years ago
aacb8daaee
merge trunk
7 years ago
c46962ca2e
Refactor snap preseeding to allow additional snaps to be preseeded from
...
hooks
7 years ago
73dba1f31a
snap preseeding: capture Ubuntu snap seeding policy in code
...
When no channel is given for a pre-seeded snap, the channel
should be stable/ubuntu-XX.YY to match Ubuntu policy.
This patch adds the LB_DISTRIBUTION var to config/{binary,chroot}
to have a common way of determining the Ubuntu XX.YY version
number between hooks and auto/build.
7 years ago
57261c3edf
auto/build: Install snaps using common functions
7 years ago
e68923777e
merge lp:~tsimonq2/livecd-rootfs/lubuntu-seed-mangling
7 years ago
4bb0414a5d
Make sure we call the build "minimal" within the cloud build info,
...
when building a minimized image.
7 years ago
51c663a892
Fixed whitespace/tabs.
7 years ago
3cb1f38cf2
Set the default locale to C.UTF-8 in all server and cloud images.
...
(LP: #1751051 , #1759003 )
7 years ago
e4151ca741
Proper bash is rad, let's do it.
7 years ago
10ebe98d84
Special-case Lubuntu's seeds so that the minimal install works.
7 years ago
0b2239c069
Parametrize BUILD_NAME in /etc/cloud/build.info to make it "minimal-aware".
7 years ago
bfa43c1c5c
On amd64, if building minimal images for bionic, xenial, or extra ppa,
...
use kvm kernel, otherwise fallback to virtual.
7 years ago
c787069c5c
do not set INITRAMFS_COMPRESSION for projects that end up passing --initramfs=none to lb config
7 years ago
d46edbffdb
reduce duplication somewhat
7 years ago
b7f3ec398b
Make lzma initramfs compression opt-in rather than opt-out, and do not
...
opt-in to it for live-server builds to speed up the boot. (LP: #1750873 )
7 years ago
0d750f78bc
Set INITRAMFS_COMPRESSION to gzip for live-server builds to speed up the
...
boot. (LP: #1750873 )
7 years ago
90ef53cef1
Merge lp:~vorlon/livecd-rootfs/ubuntu-channels-for-snaps
7 years ago
ba4b16626f
live-build-auto/{build,config}: Support fetching a file from the seed
...
mirror (BASE_SEED.minimal-remove) and putting it into the livefs build as
filesystem.manifest-minimal-remove. It's intended for ubiquity to read
this file as a list of packages to remove when doing a 'minimal' desktop
installation.
7 years ago
57200eaa01
tyop
7 years ago
4b66f89e56
move skip_lb_stage to config
7 years ago
c85cae9bfe
respond to some review feedback
7 years ago
d46e397b24
merge trunk
7 years ago
131f14d33c
Use Ubuntu-specific branches when seeding snaps, as required in
...
<https://wiki.ubuntu.com/UbuntuSeededSnaps >.
7 years ago
15d9269e57
Install linux-signed-generic in the live-server image. (LP: #1749065 )
7 years ago
762536b5bf
live-build/auto/config: Take into account SUBPROJECT when setting seeded
...
snaps, and also make sure we can work with snaps seeded in project hooks.
7 years ago
301fdd2e02
Don't write config/seeded-snaps if no snaps have been seeded.
7 years ago
2219f62998
* live-build/auto/config: Clean out unused hostname matches and fix indenting.
...
* live-build/auto/config: Reinstate hostname filtering for "*.buildd", which
is the correct match for non-lxd builders, and add "lp-*" for the lxd ones.
* live-build/auto/config: Fix incorrect quoting causing a skipped if statement
in non-live ubuntu-server builds since sometime in mid-October of last year.
7 years ago
925e470693
Fix incorrect shell variable quoting.
7 years ago
2c40db69bc
Update hostname matches for launchpad buildds to match current practice,
...
fixing build failures due to LP being unable to reach
people.canonical.com.
7 years ago
72edc20589
Set ports/archive as appropriate for default mirror - should fix
...
autopkgtests.
7 years ago
9e09b3172c
Set a default archive mirror - needed for germinate.
7 years ago
42a6450584
Oops. I shouldn't reference my private stuff.
7 years ago
284240feb5
releasing package livecd-rootfs version 2.491
7 years ago
9bd0fd192f
Specify seeds for all flavours too
7 years ago
9978fd7b39
Support seeding of snaps, as emitted by germinate >= 2.27.
7 years ago
77de6a289f
snap: Add BASE_SEED for all desktop flavours
7 years ago
26612d0b26
snap: move the seeding block down, so that it is common to all flavours
7 years ago
d41cc70bf5
ubuntu-cpc: Initramfs compression should match runtime default (LP: #1744114 )
...
Cloud images created from the 'ubuntu-cpc' project use lzma initramfs
compression for the initial initramfs shipped in the image; this is the
default for livecd-rootfs. When a user updates the initramfs (or installs
a new kernel) on a running instance created from a cloud image they will
get gzip compression, which is the default shipped in initramfs-tools.
With this patch the compression method used to create the initramfs in
the initial cloud images will match the compression menthod used when
the end-user creates/updates an initramfs, namely gzip compression.
7 years ago
e6a66dd3bf
Add support for passing snap channel to ubuntu-core image builds.
7 years ago
df89bff043
Drop Nexus 7 support
7 years ago
34dd1fb2f4
Revert to building minimized and not minimimized images with the same ~2.2 GiB size
7 years ago
07873ec528
Support seeding of snaps
...
We run germinate during configure, and read from each resulting <seed>.snaps
file (expanded from STRUCTURE) to find out which snaps to seed. This is written
to config/seeded-snaps, which is read during build to download each one.
7 years ago
0113b9aad7
self-review
7 years ago
26753602fe
Move casper from filesystem.squashfs to installer.squashfs.
7 years ago
5f64c373f1
Drop android-tools-fsutils dependency, and instead install it on
...
demand for the nexus7 sub-arch. This target is no longer produced,
thus by doing this android-tools can fall out of main to universe.
7 years ago
532bd5b5ed
Build minimized images in a 1GiB image
7 years ago
89e87b4c2c
Set LB_ISO_PREPARER to livecd-rootfs to avoid unbound variable in default string
7 years ago
49e17b717e
Fix lingering reference to livecd-rootfs.ubuntu-core.model-assertion
...
that breaks the ubuntu-core image build.
7 years ago
f384f10867
Merge lp:~vorlon/livecd-rootfs/minimize-round-two
7 years ago
ea2840ddfc
fix wrong use of PREFIX literal
7 years ago
7c07f8a65b
Change ubuntu-core image builds to use the standard "$PREFIX" naming for
...
artifacts instead of being gratuitously different; requires a matching
change to ubuntu-cdimage.
7 years ago
02246dbf84
move configuration bits into live-build/auto/config from live-build/auto/build, per Adam
7 years ago
696ae6e1eb
Name the manifest the way ubuntu-cdimage expects it for subarchs
7 years ago
e96fa8b878
ubuntu-image now produces a manifest file listing the snap revisions
...
used; publish this so that it's picked up by launchpad-buildd.
7 years ago
b3cf7b9013
The target for x86 ubuntu-core images is VMs, so create them with
...
a buffer of free space in order to work if booted in place.
7 years ago
78da9b579b
Per the suggestions, we exclude all binary hooks when IMAGEFORMAT is none.
7 years ago
083d58397c
Make sure to remove any initramfs that was generated in a minimized
...
image.
7 years ago
f91a9f16ee
Also remove old dpkg files from the live images
7 years ago
c260534758
Add the IMAGEFORMAT=none to support generating a single rootfs.
7 years ago
df94729c60
sync with purge-initramfstools branch
7 years ago
e99636027f
busybox-initramfs and busybox-static have reverse-recommends, so it's not enough to use apt-mark auto; remove these packages by name.
7 years ago
d24ca0490b
Pass --cache false to lb config; otherwise we copy around caches of
...
.debs that are never used properly, and which prevent us from emptying
/var/cache/apt in images.
7 years ago
3a092539ca
purging initramfs-tools as a prereq
7 years ago
018525ba12
resync with trunk
7 years ago
56a85e74c9
Also mark busybox-{initramfs,static} as automatically installed, so they can be removed again
7 years ago
08a5fc58ba
Remove apt, debconf cruft files from /var/cache in all our livefses.
7 years ago
314655a2ae
Skip installing server task when building minimial images
7 years ago
d6bb42bc63
Use kvm kernel only on amd64
7 years ago
7798e70d8f
Purge initramfs-tools from minimized images.
7 years ago
58be5d5712
Merge lp:~vorlon/livecd-rootfs/snap-in-mate/
7 years ago
e509a81f1d
Unminimization information should only go to motd when we are actually
...
minimized.
7 years ago
1bcb0009ac
mkdir before use
7 years ago
aec4452acf
Fix quoting
7 years ago
c61850e168
Use regular chroot, not the Chroot wrapper, so we can actually debug our failing command
7 years ago
e59db65edb
Add initial support for preinstallation of snaps in images, and
...
preinstall pulsemixer in the Ubuntu MATE image.
7 years ago
f296ec41c7
Merge lp:~vorlon/livecd-rootfs/generic-model-assertion-handling
7 years ago
4204faa484
If we're not on xenial and don't have extra ppas, don't try to use the kvm flavor for minimal images since it's not currently available.
7 years ago
203eb6251f
mkdir our assertions dir
7 years ago
ff575bd93d
add ubuntu-mate to the set of projects we add snap model assertions to.
7 years ago
12b07ae5af
move snap assertion handling into the generic build script (and, in
...
the process, from the subiquity overlay to the base squashfs).
7 years ago
fffec4782f
skip installation of kernel headers for all minimal images
7 years ago
a85cf55f29
Use kvm kernel flavor for minimized cloud image, not virtual
7 years ago
4561f17d35
Merge lp:~rbalint/livecd-rootfs/minimized
7 years ago
Balint Reczey
Colin Watson
Tobias Koch
Michael Hudson-Doyle
Jean-Baptiste Lallement
Jean-Baptiste Lallement
Łukasz 'sil2100' Zemczak
Colin Watson
Steve Langasek
Cody Shepherd
Dimitri John Ledkov
Steve Langasek
Robert C Jennings
Adam Conrad
Colin Watson
Julian Andres Klode
Julian Andres Klode
Phil Roche
Daniel Watkins
Simon Quigley
Iain Lane
Christopher Glass
Mathieu Trudel-Lapierre
Gary.Wzl