2887 Commits

Author SHA1 Message Date
Mattia Rizzolo
0aa7280f94
ubuntu-build: add support for riscv64.
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2020-04-29 00:12:24 +02:00
Dan Streetman
5a895e9685 update changelog
pullpkg: support pulling from Ubuntu upload queues
2020-03-13 10:03:33 -04:00
Dan Streetman
8aa2d602c5 pullpkg: add support for pulling from upload queue 2020-03-13 10:02:05 -04:00
Dan Streetman
8f42fb976f lpapicache: add PackageUpload class 2020-03-13 10:02:05 -04:00
Dan Streetman
ea30b9f5bc ubuntutools/misc: add download() function
Move the download functionality from the archive.py into the common
misc.py file.
2020-03-13 10:02:05 -04:00
Dan Streetman
c622c30297 update changelog
Verify checksums for downloaded binary files
2020-03-13 09:59:28 -04:00
Dan Streetman
fe4d2f08a5 test: remove test_dsc_missing test
This test class performs 'local source package' tests, but a missing
local dsc file won't perform any local test, it will query the LP server.
The test attempted to narrowly mock out specific network access to
emulate a 'missing' package by trying to return 404 when the url from
SourcePackage._lp_url() is opened, but now that _lp_url() is removed,
a missing local dsc file will result in full querying of the LP api,
which is not as easily mocked.
2020-03-06 13:01:37 +01:00
Dan Streetman
11429b213c archive: remove _lp_url() 2020-03-06 13:01:37 +01:00
Dan Streetman
eaa07014e0 archive: verify and use existing already-downloaded files 2020-03-06 13:01:37 +01:00
Dan Streetman
8682c44957 archive: update pull_dsc to use _source_urls() and verify_file_checksum() 2020-03-06 13:01:37 +01:00
Dan Streetman
20dd65b281 archive: verify binary file checksums 2020-03-06 13:01:37 +01:00
Dan Streetman
45253b398c archive: remove unneeded 'found' flag
This var isn't needed - just using for/else is better
2020-03-06 13:01:37 +01:00
Dan Streetman
e1f2cbf831 archive: remove _binary_files_info()
also use spph/bpph provided urls
2020-03-06 13:01:37 +01:00
Dan Streetman
8ebd086aac ubuntutools/misc: add verify_file_checksum function 2020-03-06 13:01:37 +01:00
Dan Streetman
9f428e471b ubuntutools/misc: convert print() to std logging 2020-03-06 13:01:37 +01:00
Dan Streetman
907061c15e lpapicache: support 'include_meta' param in binaryFileUrls()
support the param for both native BPPH as well as Debian Snapshot
emulated BPPH

add sourceFileUrls() function

add helper functions to get file urls, checksums, and size
2020-03-06 13:01:37 +01:00
Dan Streetman
ee98423715 lpapicache: use urlparse instead of manual parsing 2020-03-06 13:01:37 +01:00
Dan Streetman
d98e16226b archive: change _download_file verify param to dscverify
The param is specific to dsc-verifiable files, so name it accordingly.
2020-03-06 12:18:10 +01:00
Dan Streetman
53fa2336b8 archive: cache Debian srcpkg when pulling binaries 2020-03-06 12:18:10 +01:00
Dan Streetman
f5694d7cf6 archive: pass src pkg file size to _download_file 2020-03-06 12:18:10 +01:00
Dan Streetman
7900a09763 archive: fix DebianSourcePackage implementation of _source_urls() 2020-03-06 12:18:10 +01:00
Mattia Rizzolo
f2b758f503
init changelog for next release
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2020-02-23 13:10:04 +01:00
Mattia Rizzolo
2decc105a2
Changelog for 0.176
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
0.176
2020-02-23 13:09:19 +01:00
Mattia Rizzolo
41df9a33a4
d/control: Bump Standards-Version to 4.5.0, no changes needed.
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2020-02-23 13:02:49 +01:00
Dan Streetman
36ffc92e00 pullpkg: for -p list, show bpph arch for files built for 'all' arch 2020-02-13 17:43:24 -05:00
Dan Streetman
3d7f542e49 archive: allow pull_binaries() to accept arch=None 2020-02-13 17:43:24 -05:00
Dan Streetman
ebe460aad1 lpapicache: allow getBinaries(arch=None) to get all archs
this was the previous behavior and some scripts still call with no args.

LP: #1862286
2020-02-13 17:43:22 -05:00
Dan Streetman
5553d98e47 lpapicache: remove fallback_arch from getBinaries
Even for 'all' arch binaries, there are separate BPPHs per arch,
so we should index them properly by actual arch.
2020-02-13 17:41:35 -05:00
Dan Streetman
5838fa39ff lpapicache: remove SPPH _have_all_binaries flag
The 'all' arch makes it possible to not actually have all the
BPPH records for all archs, depending on how we've been called
previously (i.e. with which archs and/or no archs).

It's safer to just maintain our cache and recheck it each time if needed.
2020-02-13 17:39:53 -05:00
Dan Streetman
63f614ebe3 archive: if using local file, avoid error trying to copy file to itself 2020-02-13 17:39:01 -05:00
Dan Streetman
f026b5d597 ubuntu-upload-permission: sort packagesets by name
The change from py2->py3 broke this script, as sorted now refuses to
perform sorting if the elements can't be directly compared.

LP: #1862372
2020-02-13 17:39:01 -05:00
Dan Streetman
fe30873247 submittodebian: open file in binary mode before writing utf-8 encoded bytes
LP: #1863119
2020-02-13 17:39:01 -05:00
Colin Watson
1e1702e676 Use +sourcefiles URLs where possible
In
https://code.launchpad.net/~cjwatson/launchpad/archive-unambiguous-files-traversals/+merge/345118,
I added support for downloading source package files from Launchpad that
can cope with the situation where different versions of a source package
have the same file name with different contents (normally impossible,
but it can happen with imported archives and due to some old bugs).  Use
this where possible.

LP: #1860456
2020-01-24 16:34:02 +00:00
Mattia Rizzolo
f8fa865ab2
pbuilder-dist: Add support for riscv64.
LP: #1859277
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2020-01-11 15:36:48 +01:00
Mattia Rizzolo
6e3d26185c
Merge branch 'lintian-fixes' of git+ssh://git.launchpad.net/~debian-janitor/ubuntu-dev-tools
MR: https://code.launchpad.net/~debian-janitor/ubuntu-dev-tools/+git/ubuntu-dev-tools/+merge/376456
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2019-12-06 13:38:14 +01:00
Debian Janitor
c13988fbeb
Fix day-of-week for changelog entry 0.66.
Fixes lintian: debian-changelog-has-wrong-day-of-week
See https://lintian.debian.org/tags/debian-changelog-has-wrong-day-of-week.html for more details.
2019-12-06 12:19:47 +00:00
Mattia Rizzolo
7b95e4c457
Release 0.175
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
0.175
2019-12-01 19:40:22 +01:00
Mattia Rizzolo
6e4ab93ff9
document ddstreet contributions in d/copyright
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2019-12-01 19:40:15 +01:00
Mattia Rizzolo
41345dd546
d/control: Bump Standards-Version to 4.4.1, no changes needed.
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2019-12-01 19:35:49 +01:00
Mattia Rizzolo
87f226258a
Merge branch 'megamerge_request' of git+ssh://git.launchpad.net/~ddstreet/ubuntu-dev-tools/+git/ubuntu-dev-tools
MR: https://code.launchpad.net/~ddstreet/ubuntu-dev-tools/+git/ubuntu-dev-tools/+merge/375292
Signed-off-by: Mattia Rizzolo <mattia@debian.org>
2019-12-01 19:28:17 +01:00
Dan Streetman
82c8c438f7 ubuntutools: use file extension when possible to determine deb/ddeb/udeb 2019-11-25 16:40:18 -05:00
Dan Streetman
1a30454d1e test: remove test_archive obsolete tests
some tests mocked into the implementation of archive.py, which has now
changed dramatically, and the tests are no longer valid.
2019-11-25 10:10:06 -05:00
Dan Streetman
e37e9db7eb pullpkg: add --security param to query ubuntu sec team proposed ppa 2019-11-25 10:10:06 -05:00
Dan Streetman
87a09640ba ubuntutools/pullpkg.py: convert -v to count, enable package-wide debug for -vv 2019-11-25 10:10:06 -05:00
Dan Streetman
90e8fe81e1 replace ubuntutools.logger with standard python logging 2019-11-25 10:10:06 -05:00
Dan Streetman
c9c7fed1f6 pull-uca-*: search in reverse order of UCA releases, if none specified
if only the version of a UCA package is specified, search each UCA
archive from latest backwards.  This avoids having to specify both
the package version *and* UCA release.
2019-11-25 10:10:06 -05:00
Dan Streetman
7c097b19ba ubuntutools: add --status param to pull-pkg
Allow specifying what package statuses should be searched for.

By default search only for Pending and Published, unless a specific
version number is being searched for.
2019-11-25 10:10:06 -05:00
Dan Streetman
0f61836b10 ubuntutools: update archive/lpapicache to optionally search all series
For PPA and UCA repos, the latest build is not necessarily in the
'development' release; so for those SourcePackage classes, search
all the 'active' series (starting with latest devel) for any
matches to the provided package name.  This allows not having to
specify the series name when looking in PPA/UCA repos for the 'latest'
version of a specific package.
2019-11-25 10:10:06 -05:00
Dan Streetman
b11b83f0e2 pull-pkg: change UCA source pkg class to subclass of PPA source pkg class
The UCA source pkg class was its own specific class, but with the
addition of the generic PPA source pkg class, the UCA class is just
a specific case of PPA.  Changing it to a subclass of the PPA class
simplifies code.
2019-11-25 10:10:06 -05:00
Dan Streetman
7084bfc8bc pull-pkg: add pull-ppa-* functionality
Add functionality, and frontend pull-ppa-* scripts, to be able to pull
from PPA archives.
2019-11-25 10:10:06 -05:00