3005 Commits

Author SHA1 Message Date
Dan Streetman
0eaf71737d test: fix example package class
this class can be much simpler and more robust and doesn't require
checking in the example package files to git
2021-07-14 17:41:10 -04:00
Dan Streetman
1b12d8b4e3 archive: convert to use pathlib instead of os.path
Mostly convert to using pathlib
2021-07-14 17:41:10 -04:00
Dan Streetman
be6e09a02b archive: don't use existing file if no verification methods provided
we shouldn't use an existing file if we aren't checking its checksums
2021-07-14 17:41:10 -04:00
Dan Streetman
86276665cd archive: Update PersonalPackageArchiveSourcePackage to handle private PPA
Unfortunately private PPAs require downloading files from the special server
private-ppa.launchpad.net, and all the usual urls provided by the LP api fail.
So add code to handle using those custom private URLs, and use authentication
when downloading.
2021-07-14 17:41:10 -04:00
Dan Streetman
3f2983c157 misc: Change download() method to use python requests and optional authentication
Since private PPAs require authentication, use python requests library instead
of urlopen(), since requests handles authentication easily
2021-07-14 17:41:10 -04:00
Dan Streetman
4f6d6bf2d8 misc: add extract_authentication method
This pulls the username:password out of a URL
2021-07-14 17:41:10 -04:00
Dan Streetman
df93a225a8 misc: replace os.path with Pathlib
also change some strings to use f-strings
2021-07-14 17:41:10 -04:00
Dan Streetman
d8df8cc869 misc: add download_bytes() and deprecate mode param for download_text()
Passing 'mode' assumes use of open(), but callers don't care about
implementation, just if the returned object is text or bytes
2021-07-14 17:41:04 -04:00
Dan Streetman
243a728d6c Move DownloadError into ubuntutools/misc 2021-07-13 14:08:59 -04:00
Dan Streetman
6e18d60de4 lpapicache: add Archive.getMySubscriptionURL()
Private PPA require using username/password to access their files,
so make this information available. This gets the currently logged in
user's "subscription URL", which includes the authentication data.
2021-07-13 07:55:02 -04:00
Dan Streetman
dbd453876e flake8 tests no longer need to specifically exclude ubuntu-archive-assistant
Now that ubuntu-archive-assistant is removed, we can simply test everything
with flake8
2021-07-12 12:45:27 -04:00
Dan Streetman
732ff00cac Completely remove ubuntu-archive-assistant code
This hasn't been updated even a single time since it was added without
review almost 3 years ago. It additionally has never been included in the
ubuntu-dev-tools package. It's unclear if anyone is using it for anything,
but in any case it certainly shouldn't be in the ubuntu-dev-tools repository.
2021-07-12 12:45:27 -04:00
Marco Trevisan (Treviño)
2ac69a89e3 mk-sbuild: Add support to configure ccache for each schroot
ccache can help greatly in speeding up recompilations in sbuild, but it
is a bit annoying to configure at each schroot creation.

So, add --cache option (and relative CCACHE config parameter) to
configure ccache for sbuild schroots.

By default we use a shared ccache directory, but each schroot can use
a customized one if needed (with local parameters) by using --cache-dir
(or CCACHE_DIR).

Default ccache max-size is 4G, but can be configured with --ccache-size
(or CCACHE_SIZE), the size value is applied to each ccache path, so can
be shared by multiple schroots or applied to a single one.
2021-06-15 02:24:16 +02:00
Marco Trevisan (Treviño)
4e5e6efdb1 mk-sbuild: Enable debugging in the finish.sh script if --debug is used 2021-06-15 02:23:05 +02:00
Marco Trevisan (Treviño)
e193c30695 mk-sbuild: Use a more maintainable OPTS list using a bash array 2021-06-15 02:23:05 +02:00
Stefano Rivera
6bf3640e8f Upload to unstable 0.183 2021-06-08 10:09:16 -04:00
Dan Streetman
5dcde81c58 pbuilder: include missing import
commit d784fea1cdf50ca8d80fe2a0074aeb96ab1b580f did not include the
import for 'suppress'
2021-06-06 21:16:44 -04:00
Stefano Rivera
30abe6eacd Upload to unstable 0.182 2021-06-06 19:52:25 -04:00
Stefano Rivera
c0546396bf Respect nocheck in DEB_BUILD_OPTIONS, again. 2021-06-06 19:52:14 -04:00
Dan Streetman
ef100f6166 update changelog 2021-06-04 12:26:32 -04:00
Dan Streetman
3428a65b1c d/rules: override build tests to use flake8 and nosetests3 2021-06-04 12:25:21 -04:00
Dan Streetman
91e0babd93 d/t/control: add minimum version requirement for flake8 test
the --extend-exclude parameter was added in flake8 3.8.0
2021-06-04 12:25:21 -04:00
Dan Streetman
952b331c22 archive: fix flake8 test failure 2021-06-04 12:14:10 -04:00
Dan Streetman
e44bc63209 update changelog 2021-06-02 14:57:27 -04:00
Dan Streetman
c2ea95c067 syncpackage: don't login to LP if using --simulate
No need to login to LP if no real action is being taken.
2021-06-02 14:55:17 -04:00
Dan Streetman
f25f815bef update changelog 2021-06-02 11:49:20 -04:00
Dan Streetman
a0315dac8c archive: only download dsc file to the workdir from pull() method
LP: #1928946
2021-06-02 11:24:53 -04:00
Dan Streetman
ec36c7c792 syncpackage: remove calls to no-op pull_dsc() 2021-05-28 16:24:53 -04:00
Dan Streetman
9be49e7b93 archive: deprecate poorly-named pull_dsc() method 2021-05-28 16:24:15 -04:00
Dan Streetman
90824e056c archive: move check for verify_signature into check_dsc_signature 2021-05-28 16:18:50 -04:00
Dan Streetman
1093c372eb archive: allow passing absolute path to _download_file 2021-05-28 16:17:29 -04:00
Dan Streetman
ff66707a4c Add mode param to download_text() to allow using custom modes like 'rb' 2021-05-28 16:14:51 -04:00
Mattia Rizzolo
128eca1a5b
Changelog for 0.181
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
0.181
2021-05-02 20:04:32 +02:00
Mattia Rizzolo
4f10be3f13
mk-sbuild: document eatmydata in the manpage
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-05-02 20:02:47 +02:00
Mattia Rizzolo
b687e11813
Merge branch 'fix-backportpackage' of git+ssh://git.launchpad.net/~ddstreet/ubuntu-dev-tools/+git/ubuntu-dev-tools
Closes: https://bugs.debian.org/983854
MR: https://code.launchpad.net/~ddstreet/ubuntu-dev-tools/+git/ubuntu-dev-tools/+merge/400848
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-05-02 19:55:44 +02:00
Mattia Rizzolo
eca442bf35
Merge branch 'lp1916633' of git+ssh://git.launchpad.net/~ddstreet/ubuntu-dev-tools/+git/ubuntu-dev-tools
MR: https://code.launchpad.net/~ddstreet/ubuntu-dev-tools/+git/ubuntu-dev-tools/+merge/399686
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-05-02 19:49:03 +02:00
Marco Trevisan (Treviño)
ede8a77718 doc/mk-sbuild.1: Add documentation for --debootstrap-proxy and DEBOOTSTRAP_PROXY
LP: #1926166
2021-04-26 20:33:48 +02:00
Dan Streetman
85ed9ad1ce backportpackage: don't use SourcePackage() directly
As the warning from 2010 says, don't use this class directly.
2021-04-08 22:52:20 -04:00
Balint Reczey
f97b19554f Use eatmydata by default
Since only the dpkg is wrapped in eatmydata it should be the safe and fast
default. Eatmydata is widely used around apt thus it should be a serious bug
if a package can't be installed with eatmydata in use.
2021-03-26 15:41:10 +01:00
Balint Reczey
a5ee35c812 Use eatmydata only with the dpkg command
Eatmydata wrapping the build as well could break tests.

Thanks: Julian Andres Klode for suggesting this solution
2021-03-26 15:40:25 +01:00
Dan Streetman
d784fea1cd pbuilder: handle debian change from /updates to -security
starting in bullseye, the security suite is -security instead of /updates

LP: #1916633
2021-03-12 13:09:17 -05:00
Krytarik Raido
728849964e
Logging: Fix oversight from the last logging refactor
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-02-24 14:26:18 +01:00
Mattia Rizzolo
09537bd44d
Merge branch 'fix-sponsor-patch' of git+ssh://git.launchpad.net/~logan/ubuntu-dev-tools
MR: https://code.launchpad.net/~logan/ubuntu-dev-tools/+git/ubuntu-dev-tools/+merge/398509
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-02-24 14:24:50 +01:00
Mattia Rizzolo
484a668c0a
init changelog
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-02-24 14:23:42 +01:00
Logan Rosen
bc24ef23de sponsor-patch: fix bugs from py3 migration 2021-02-22 22:24:52 -05:00
Mattia Rizzolo
ea549d6c19
Changelog for 0.180
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
0.180
2021-02-19 12:36:01 +01:00
Mattia Rizzolo
7118411b89
Drop coverage in the autopkgtest, as python3-nose-cov is not in Debian
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2021-02-19 12:12:02 +01:00
Dan Streetman
2c6f87acd3 update changelog for 0.179 0.179 2021-02-03 10:21:50 -05:00
Dan Streetman
211416d2fd update changelog 2021-02-02 06:26:08 -05:00
Dan Streetman
0eeb93ee0c logging: update ubuntutools.getLogger() to output to stdout/stderr correctly
Python logging by default sends all output to stderr, but that's not what
normal programs usually do and is not expected for these scripts.

Change the ubuntutools.getLogger() method to return a logger with handlers
correctly set up to send INFO level (or lower) logs to stdout and WARNING
level (or higher; technically INFO+1 level or higher) logs to stderr.

This results in normally logged output going to stdout and warnings/errors
going to stderr, as expected.
2021-02-02 06:25:12 -05:00