Tobias Koch
5b70d86f5c
Inject a proxy into the build providing a snapshot view of the package repo.
...
When the REPO_SNAPSHOT_STAMP variable is set, the auto/build script will attempt
to launch a transparent HTTP proxy on port 8080, and insert an iptables rule to
redirect all outgoing HTTP requests to this proxy.
The proxy, contained in the `magic-proxy` Python script, examines each request
and silently overrides those pointing to InRelease files or files that are
listed in InRelease files. It will instead provide the contents of the requested
file as it was at REPO_SNAPSHOT_STAMP, by downloading the corresponding asset
"by hash".
6 years ago
Michael Hudson-Doyle
a9991a908e
revert change to ubuntu-server:live snap seeding
6 years ago
Jean-Baptiste Lallement
f84d92d76f
Calculate total size of the image + typos
6 years ago
Jean-Baptiste Lallement
3db920c40c
Fixed quoting of subproject variable
6 years ago
Jean-Baptiste Lallement
52d9bd3ead
Run live specific scripts on non live layers
...
Allow execution of lb_binary_linux-image and lb_chroot_live-packages on
any layer by setting LIVE_PASSES.
6 years ago
Jean-Baptiste Lallement
283871573d
Changed the naming scheme for multi layer images to dot format
6 years ago
Jean-Baptiste Lallement
addef92e23
Decouple from ubuntu-cdimage & debian-cd landings
...
We don't want to regress the ubuntu desktop traditional image when
livecd-rootfs lands uncordinated with ubuntu-cdimage & debian-cd.
Decoupling enables us to:
- land livecd-rootfs (no change for ubuntu-desktop project,
ubuntu-desktop:ubiquity-ng can be tested once the 2 others branches
lands)
- land ubuntu-cdimage & debian-cd for publishing any arbitrary squashfs
names
- finally, revert that commit and land it in livecd-rootfs to transform
the traditional ubuntu-desktop image to a layered approach.
6 years ago
Jean-Baptiste Lallement
2d2ce6eea4
Rename chroot.$PASS -> overlay.$PASS
6 years ago
Jean-Baptiste Lallement
e0d30dd2d3
Fixed substract -> subtract
6 years ago
Jean-Baptiste Lallement
41becb0af7
Ensure snaps are available on ubuntu-server live
6 years ago
Jean-Baptiste Lallement
3075d65578
Cleanup and handle manifest-remove files
...
manifest-remove files are generated in all cases and removed for
projects/subprojects that don't need it like the new ubiquity.
6 years ago
Jean-Baptiste Lallement
9dba350834
Added lb_binary_layered
...
Created lb_binary_layered based on lb_binary
Factorized several helpers
These helpers are called from lb_chroot
6 years ago
Jean-Baptiste Lallement
43ec452fa0
Moved reusable functions to functions
...
Moved functions to reuse in lb_binary and lb_chroot to functions
6 years ago
Jean-Baptiste Lallement
047f883e92
Various fixes
...
Fixed prefix for passes to not conflict with global prefix
Set layer to none for layer without language packs
Copy size and manifest to the target directory
Make sure the diff always diffes existing manifests
6 years ago
Jean-Baptiste Lallement
3b21bd9a2e
Moved back config helper functions to config
...
Moved back config specific functions from functions to config
6 years ago
Jean-Baptiste Lallement
42d1d77612
Layered Ubuntu desktop by default
...
Default Ubuntu desktop to the layered format
Remove the requirement on setting IMAGEFORMAT to layered to build a
layered image and relies on PASSED instead.
6 years ago
Jean-Baptiste Lallement
f3dadf1091
Support for positive and negative sublayers
...
Calculate positive and negative package lists for sublayers
6 years ago
Jean-Baptiste Lallement
53b06af931
Added sublayers support
...
Adds support for sublayers by defining package lists corresponding to
each sublayer. The name of the package list defines the name of the
layer.
6 years ago
Jean-Baptiste Lallement
78c196031b
Add snaps to manifest
...
Make sure that all the snaps are listed in the full manifest of each
layer and as delta in the delta manifest.
6 years ago
Jean-Baptiste Lallement
ef72cf5fe8
Code refactoring:
...
* Moved *inheritance functions from config to functions
* Moved code to extract snap from seed to snap_from_seed function
6 years ago
Jean-Baptiste Lallement
6a7368bf95
Clean-up dead code for server live builds.
6 years ago
Jean-Baptiste Lallement
d4f7a0b23d
live-build/auto/config: Added ubuntu-desktop-minimal to install-minimal task
6 years ago
Jean-Baptiste Lallement
d5a16296f4
live-build/auto/build: Create one manifest by layer in diff format and one full manifest with all the layers in standard format
6 years ago
Jean-Baptiste Lallement
ca63d43696
live-build/auto/build: Add size of the filesystems. This is used by the installer to calculate the minimum partition size to reserve for installation. The installer will have to sum all the sizes to compute the final size. Thank didrocks
6 years ago
Jean-Baptiste Lallement
b6287916c2
auto/build: Order generated squashfs filesystems
6 years ago
Jean-Baptiste Lallement
ce973ba07b
auto/build: Removed useless comment
6 years ago
Jean-Baptiste Lallement
7b4acba31d
* Added lb_chroot_layered to add support for multi layered squashfs images
...
* auto/*: Added live-layered image format
6 years ago
Jean-Baptiste Lallement
3e34faaa70
Moved add_task and add_package to functions in order to be available in hooks
6 years ago
Łukasz 'sil2100' Zemczak
b3dd27aedd
Use linux-firmware-raspi2 instead of raspi3-firmware.
6 years ago
Colin Watson
2b15590f3b
Fix buildd images for series earlier than bionic
...
Don't install gpg or gpg-agent when building buildd images for series
earlier than bionic. (In earlier series, those packages didn't exist
and gnupg was build-essential.)
6 years ago
Łukasz 'sil2100' Zemczak
bf61fdecf3
Merge branch 'ubuntu/master' of git+ssh://git.launchpad.net/livecd-rootfs into sil2100/raspi-wpasupplicant
6 years ago
Łukasz 'sil2100' Zemczak
abec4f4c1d
Link to the proper name instead.
6 years ago
Łukasz 'sil2100' Zemczak
e60bcbaecd
Add proper IMAGAFORMAT for raspi3 classic builds, output the images with the expected naming.
6 years ago
Colin Watson
46942330d8
Move buildd image building to binary hooks
6 years ago
Colin Watson
082a2046e7
Add a LXD image to builds for the buildd subproject
6 years ago
Łukasz 'sil2100' Zemczak
85eed4a91d
Add wpasupplicant to the additional packages installed for the raspi2 and raspi3 targets.
6 years ago
Michael Hudson-Doyle
f81fb59a00
Do no install openssh-server in the base filsystem for the live server installer.
6 years ago
Michael Hudson-Doyle
c4e5659217
do not include kernel in base install for ubuntu-server:live
...
this actually makes things closer to the non-live server build and so
makes things a bit simpler
6 years ago
Michael Hudson-Doyle
4b01505952
Fix typo preventing builds of ubuntu-core images.
6 years ago
Tobias Koch
cbd4eb5717
Use series files with dependency handling to generate hook symlinks dynamically
...
This patch currently only applies to the "ubuntu-cpc" project.
More and more logic has been going into the hook scripts to decide under which conditions they should run or not. As we are moving to parallelized builds of image sets, this will get even more complicated. Base hooks will have to know which image sets they belong to and modification of the dependency chain between scripts will become more complicated and prone to errors, as the number of image sets grows.
This patch introduces explicit ordering and dependency handling for scripts through the use of `series` files and an explicit syntax for dependency specification.
6 years ago
Steve Langasek
5300bb9eb7
Key netplan delegation to NetworkManager on presence of
...
/usr/sbin/NetworkManager, not on /usr/lib/NetworkManager which may have
hooks from other packages (i.e., wpasupplicant).
6 years ago
Łukasz 'sil2100' Zemczak
6345ccd34c
Add a few minor fixes for raspi3 builds.
6 years ago
Łukasz 'sil2100' Zemczak
d3eb3dd0ac
Add missing arguments to ubuntu-image classic calls.
6 years ago
Łukasz 'sil2100' Zemczak
c229012efb
Add raspi3 arm64 rootfs build support.
6 years ago
Łukasz 'sil2100' Zemczak
65d907268a
raspi3 support: be sure to create /boot/firmware during pi3 rootfs builds. Also, for the raspi3 we need to explicitly specify the kernel flavor to raspi2. We also switch to using raspi3-firmware instead of linux-firmware-raspi2 because the latter is not available for arm64.
6 years ago
Steve Langasek
6ee39485dd
Merge lp:~sil2100/livecd-rootfs/use-ubuntu-image-classic
6 years ago
Łukasz 'sil2100' Zemczak
05a8be839f
Do the same for ubuntu-image snap builds.
6 years ago
Łukasz 'sil2100' Zemczak
8a33b23dd0
Use -O instead of -o for ubuntu-image classic builds.
6 years ago
Łukasz 'sil2100' Zemczak
2947cdbe60
First batch of obvious changes - use better shellism, only call make (without make install).
6 years ago
Steve Langasek
b3c9d8bac8
Merge lp:~sil2100/livecd-rootfs/raspi3-u-i-classic
6 years ago
Steve Langasek
77c44167df
Delete no longer accurate comments
6 years ago
Cody Shepherd
c7e0c27607
[ Cody Shepherd ]
...
Fix snap-seed-parse to take filename argument instead of printing to
stdout
6 years ago
Dimitri John Ledkov
8868522e78
When calling snap-seed-parse append stdout to file, but redirect
...
stderr to stdout, thus unbreak autopkgtests.
6 years ago
Steve Langasek
1e1c6a8572
Properly fix the hard-linking of vmlinuz, taken astray by my misguided
...
merge review.
6 years ago
Łukasz 'sil2100' Zemczak
a3a9b2ab60
Merge latest prerequisite branch.
6 years ago
Łukasz 'sil2100' Zemczak
b0910cbe50
Remove more unneeded raspi3 conditionals.
6 years ago
Łukasz 'sil2100' Zemczak
37f3cb1714
Merge latest prerequisite branch.
6 years ago
Łukasz 'sil2100' Zemczak
2e3c7d050c
Remove unneeded code and code duplication, add comments.
6 years ago
Łukasz 'sil2100' Zemczak
6ac3384f34
Merge latest prerequisite branch
6 years ago
Łukasz 'sil2100' Zemczak
a274206e1a
Don't overcomplicate bash conditionals.
6 years ago
Łukasz 'sil2100' Zemczak
cc5d39b93d
Merge latest prerequisite branches.
6 years ago
Łukasz 'sil2100' Zemczak
501afa0783
Merge latest prerequisite branch
6 years ago
Łukasz 'sil2100' Zemczak
61ba85df21
Merge trunk
6 years ago
Łukasz 'sil2100' Zemczak
f8529c9038
Add support for building classic images using makefile-based gadget trees.
6 years ago
Cody Shepherd
2819290352
Changed absoluted paths to relative; set changelog message to UNRELEASED
6 years ago
Cody Shepherd
5bee1ade70
Ensure pre-seeded snaps are now published in the image manifests.
6 years ago
Łukasz 'sil2100' Zemczak
41b4130759
* Add support for raspi3 rootfs builds (based on Ryan Finnie).
...
* For ubuntu-image consumption, export the kernel and initrd to
image/boot/uboot for raspi*.
6 years ago
Łukasz 'sil2100' Zemczak
e115b2cbe7
Avoid issues of hard-linking to a symbolic vmlinuz as this can lead to a
...
dangling symlink.
6 years ago
Łukasz 'sil2100' Zemczak
4f6e5dc11e
For the pc model, the name changed so we need to special case it a bit.
6 years ago
Łukasz 'sil2100' Zemczak
1498baada5
The model assertions for 18 don't actually use series=18 because that would be too logical.
6 years ago
Łukasz 'sil2100' Zemczak
c184977a90
Decide what model assertion series to fetch depending on the suite. For xenial use 16 and for others (so bionic+): 18.
6 years ago
Robert C Jennings
9f96dcb4de
Add the server snap seed to the ubuntu-cpc project
6 years ago
Michael Hudson-Doyle
791d2adfd8
merge trunk
6 years ago
Adam Conrad
94230324e0
Stop building buildd chroots with --xattrs until we move to python3.
6 years ago
Colin Watson
bb652c238f
Merge trunk.
6 years ago
Colin Watson
c4c5c1f349
Generate tar file with --xattrs.
6 years ago
Julian Andres Klode
1746e65953
Reorganize minimal-manual file location.
...
This also gets rid of the change to debian/rules
6 years ago
Łukasz 'sil2100' Zemczak
e547599e5a
Add support for raspi3 rootfs generation for ubuntu-image consumption with all the additional changes required.
6 years ago
Łukasz 'sil2100' Zemczak
97fcf09972
Merge trunk
6 years ago
Julian Andres Klode
fc6907b701
fixup: Do not assume current directory
6 years ago
Julian Andres Klode
2e9349c543
minimize-manual.py: Followup with some cleanup, correct permissions
6 years ago
Julian Andres Klode
9360135b2c
Minimize the number of manually installed packages in images by marking
...
dependencies of metapackages as automatically installed.
6 years ago
Michael Hudson-Doyle
e804cc4e00
a less hackish approach
6 years ago
Michael Hudson-Doyle
a261471969
a less hackish approach
6 years ago
Michael Hudson-Doyle
1aa8b9d882
ffs
6 years ago
Michael Hudson-Doyle
00151c5e0b
Set PREINSTALLED=true for live-server so that universe ends up being
...
enabled in the image.
6 years ago
Steve Langasek
3db2340c54
generate all tar files with --xattrs. LP: #1302192 .
6 years ago
Michael Hudson-Doyle
333a3e2b1b
moderate comment
7 years ago
Michael Hudson-Doyle
092b316357
add a comment explaining why /dev cleaning is docker-only
7 years ago
Michael Hudson-Doyle
013dff431e
Remove device nodes from Docker images. (LP: #1645468 )
7 years ago
Robert C Jennings
c3f5ee6716
Disable checksum generation
...
These checksums are unused, integrity checking in launchpad is performed
separately.
7 years ago
Phil Roche
b7403fabf1
Update unminimize script text and install ubuntu-standard when unminimizing a minimal image (LP: #1778777 )
7 years ago
Colin Watson
1e6563aa79
Merge trunk.
7 years ago
Colin Watson
baee4ed403
We know cosmic's name now.
7 years ago
Colin Watson
8b1970f661
live-build/auto/config: Drop "lp-*" hostname filter for Launchpad
...
builders, since LP #1747015 is now fixed; "*.buildd" should be enough.
7 years ago
Daniel Watkins
80459b6c1b
ubuntu-cpc: Use linux-kvm for all amd64 minimized builds (LP: #1775472 ).
7 years ago
Michael Hudson-Doyle
664ace2f30
man un-diverting man idempotent
7 years ago
Michael Hudson-Doyle
7c7c2c5b30
rm -r the lists
7 years ago
Michael Hudson-Doyle
ccef323973
go back to having docker unminimize not install any extra packages
...
update text of man diversion to mention need to install man-db package
7 years ago
Michael Hudson-Doyle
2fc3993d48
Remove apt lists that are currently removed downstream anyway.
...
(LP: #1699913 )
7 years ago
Michael Hudson-Doyle
fa1bce5389
still install a few packages in docker unminimize
7 years ago
Michael Hudson-Doyle
514faae2db
divert /usr/bin/man in minimized images to a script that mentions the unminimize script
7 years ago
Michael Hudson-Doyle
7e1bd33544
do not install ubuntu-minimal in ubuntu-base's unminimize
7 years ago
Łukasz 'sil2100' Zemczak
7982442e32
Avoid issues of hard-linking to a symbolic vmlinuz as this can lead to a dangling symlink.
7 years ago
Simon Quigley
9ba04172d4
Completely drop Lubuntu Next.
7 years ago
Simon Quigley
382f17b08c
Don't follow recommends.
7 years ago
Simon Quigley
480e02443e
Drop seed workarounds for unbuilt Lubuntu Next.
7 years ago
Colin Watson
1fab544a84
Add init to buildd chroots, since it's needed for LXD-based builds.
7 years ago
Colin Watson
b77de06bfd
Remove some unnecessary buildd configuration.
7 years ago
Colin Watson
07487675b6
Sort buildd tarballs by name and use numeric user and group IDs.
7 years ago
Colin Watson
416093beec
Use a public-facing mirror URL in the final buildd /etc/apt/sources.list.
7 years ago
Colin Watson
cb22177287
Add a buildd subproject.
7 years ago
Steve Langasek
e6089e9e32
Remove landscape-common from minimal image, and handle restoring it in
...
unminimize script. LP: #1763182 .
7 years ago
Michael Hudson-Doyle
65dd7df171
last minute pre-upload typo fix
7 years ago
Michael Hudson-Doyle
aacb8daaee
merge trunk
7 years ago
Steve Langasek
c46962ca2e
Refactor snap preseeding to allow additional snaps to be preseeded from
...
hooks
7 years ago
Robert C Jennings
73dba1f31a
snap preseeding: capture Ubuntu snap seeding policy in code
...
When no channel is given for a pre-seeded snap, the channel
should be stable/ubuntu-XX.YY to match Ubuntu policy.
This patch adds the LB_DISTRIBUTION var to config/{binary,chroot}
to have a common way of determining the Ubuntu XX.YY version
number between hooks and auto/build.
7 years ago
Robert C Jennings
57261c3edf
auto/build: Install snaps using common functions
7 years ago
Iain Lane
e68923777e
merge lp:~tsimonq2/livecd-rootfs/lubuntu-seed-mangling
7 years ago
Steve Langasek
4bb0414a5d
Make sure we call the build "minimal" within the cloud build info,
...
when building a minimized image.
7 years ago
Christopher Glass
51c663a892
Fixed whitespace/tabs.
7 years ago
Michael Hudson-Doyle
3cb1f38cf2
Set the default locale to C.UTF-8 in all server and cloud images.
...
(LP: #1751051 , #1759003 )
7 years ago
Simon Quigley
e4151ca741
Proper bash is rad, let's do it.
7 years ago
Simon Quigley
10ebe98d84
Special-case Lubuntu's seeds so that the minimal install works.
7 years ago
Christopher Glass
0b2239c069
Parametrize BUILD_NAME in /etc/cloud/build.info to make it "minimal-aware".
7 years ago
Dimitri John Ledkov
bfa43c1c5c
On amd64, if building minimal images for bionic, xenial, or extra ppa,
...
use kvm kernel, otherwise fallback to virtual.
7 years ago
Michael Hudson-Doyle
c787069c5c
do not set INITRAMFS_COMPRESSION for projects that end up passing --initramfs=none to lb config
7 years ago
Michael Hudson-Doyle
d46edbffdb
reduce duplication somewhat
7 years ago
Michael Hudson-Doyle
b7f3ec398b
Make lzma initramfs compression opt-in rather than opt-out, and do not
...
opt-in to it for live-server builds to speed up the boot. (LP: #1750873 )
7 years ago
Michael Hudson-Doyle
0d750f78bc
Set INITRAMFS_COMPRESSION to gzip for live-server builds to speed up the
...
boot. (LP: #1750873 )
7 years ago
Steve Langasek
90ef53cef1
Merge lp:~vorlon/livecd-rootfs/ubuntu-channels-for-snaps
7 years ago
Iain Lane
ba4b16626f
live-build-auto/{build,config}: Support fetching a file from the seed
...
mirror (BASE_SEED.minimal-remove) and putting it into the livefs build as
filesystem.manifest-minimal-remove. It's intended for ubiquity to read
this file as a list of packages to remove when doing a 'minimal' desktop
installation.
7 years ago
Michael Hudson-Doyle
57200eaa01
tyop
7 years ago
Michael Hudson-Doyle
4b66f89e56
move skip_lb_stage to config
7 years ago
Michael Hudson-Doyle
c85cae9bfe
respond to some review feedback
7 years ago
Michael Hudson-Doyle
d46e397b24
merge trunk
7 years ago
Steve Langasek
131f14d33c
Use Ubuntu-specific branches when seeding snaps, as required in
...
<https://wiki.ubuntu.com/UbuntuSeededSnaps >.
7 years ago
Michael Hudson-Doyle
15d9269e57
Install linux-signed-generic in the live-server image. (LP: #1749065 )
7 years ago
Mathieu Trudel-Lapierre
762536b5bf
live-build/auto/config: Take into account SUBPROJECT when setting seeded
...
snaps, and also make sure we can work with snaps seeded in project hooks.
7 years ago
Iain Lane
301fdd2e02
Don't write config/seeded-snaps if no snaps have been seeded.
7 years ago
Adam Conrad
2219f62998
* live-build/auto/config: Clean out unused hostname matches and fix indenting.
...
* live-build/auto/config: Reinstate hostname filtering for "*.buildd", which
is the correct match for non-lxd builders, and add "lp-*" for the lxd ones.
* live-build/auto/config: Fix incorrect quoting causing a skipped if statement
in non-live ubuntu-server builds since sometime in mid-October of last year.
7 years ago
Adam Conrad
925e470693
Fix incorrect shell variable quoting.
7 years ago
Steve Langasek
2c40db69bc
Update hostname matches for launchpad buildds to match current practice,
...
fixing build failures due to LP being unable to reach
people.canonical.com.
7 years ago
Iain Lane
72edc20589
Set ports/archive as appropriate for default mirror - should fix
...
autopkgtests.
7 years ago
Iain Lane
9e09b3172c
Set a default archive mirror - needed for germinate.
7 years ago
Iain Lane
42a6450584
Oops. I shouldn't reference my private stuff.
7 years ago
Iain Lane
284240feb5
releasing package livecd-rootfs version 2.491
7 years ago
Iain Lane
9bd0fd192f
Specify seeds for all flavours too
7 years ago
Iain Lane
9978fd7b39
Support seeding of snaps, as emitted by germinate >= 2.27.
7 years ago
Iain Lane
77de6a289f
snap: Add BASE_SEED for all desktop flavours
7 years ago