111 Commits

Author SHA1 Message Date
d052943e6d Yo dawg, I heard you like dict values, so I made your dict value a dict value. 2020-06-05 12:56:39 -05:00
fc9e24b62b Update templates for updated Jinja substitution variables. 2020-06-05 12:49:09 -05:00
5f198dc770 Massive cleanup of jobgenerator to allow for more flexible metadata. 2020-06-05 12:33:10 -05:00
12de78635b Suppress package-has-long-file-name, since our (somewhat) absurdly long version numbers are to blame. 2020-06-03 17:36:46 -05:00
c4b82fb746 Fix race condition by ensuring workspaces for packages are cleaned up before and after builds. 2020-05-28 11:01:00 -05:00
66afe1559a Correct job names in the request body. 2020-05-26 14:16:31 -05:00
b85aa44490 Add post-job hooks to the templates. 2020-05-26 14:09:25 -05:00
510db61714 Suppress orig-tarball-missing-upstream-signature on Unstable packages since there will never be an orig signature. 2020-05-25 15:43:22 -05:00
17e5d23ad1 Apply updated Lintian patch to the infra and adjust templates accordingly. 2020-05-25 14:36:45 -05:00
4ae071880b Apply experimental Lintian patch to the infra and enable the new flag.
See https://salsa.debian.org/lintian/lintian/-/merge_requests/311 for
more details. I will update the infra as needed, and once it is in a
released version of Lintian, I will backport it to Focal and install on
the infra.
2020-05-23 14:22:56 -05:00
apt-ghetto
73939dc9b5 Fix ModuleNotFoundError
Summary:
The jobgenerator failed because of a missing module.

  * Add tabulate to requirements.txt
  * Fix flake8 errors:
    - Removed unused imports
    - Boolean comparison with is and not ==
    - Line length
    - Removed whitespaces before and after parentheses

Test Plan:
1. Install it from the requirements
2. Start jobgenerator
3. Check, that it does not fail because of missing tabulate module.

Reviewers: tsimonq2, teward

Differential Revision: https://phab.lubuntu.me/D95
2020-05-21 05:12:15 -05:00
c6f4117ab7 The removed timers were redundant. 2020-05-17 06:27:41 -05:00
1b502ee4e4 Add a decorator to TimerMetrics and wrap most of the functions. 2020-05-17 05:59:48 -05:00
28c7f2b397 Replace some timer calls. 2020-05-17 04:44:41 -05:00
42869ace27 Initial commit of the timer_metrics module. 2020-05-17 04:34:00 -05:00
86f658cb55 We can get away with being a little less verbose now. 2020-05-17 03:04:03 -05:00
b6d9050604 Move parsing the existing job data to another function, and actually make it functional. 2020-05-17 02:55:06 -05:00
f529f5a1d1 Add semicolons to the end of each statement. 2020-05-17 01:52:20 -05:00
c85822e495 Make job editing more verbose. 2020-05-17 01:51:46 -05:00
5fb09fda6d Slightly clean that up. 2020-05-16 23:59:30 -05:00
bf8edaaf9d Make sure we don't fail when loading the non-data-using release-mgmt template. 2020-05-16 23:57:07 -05:00
050cf6cb12 Bump the total lp_check allowed time to 6 hours from 2, to account for publisher maintenance. 2020-05-16 23:45:02 -05:00
082ee862b0 Run Lintian on built binaries if the package build succeeds. 2020-05-16 23:41:23 -05:00
f7e731faae
Multiple issues fixed.
- Variable use before assignment
- Unhandled edge cases where variables referenced may not have the subdata/indexes requested
- try/catch fixes where 'finally' references a variable that might not exist
- Unnecessary imports
- Added requirements.txt file with base module requirements (without version specificity at this time)
2020-05-12 17:47:14 -04:00
b379ebb20d Add useless merger info. 2020-04-23 05:43:17 -05:00
apt-ghetto
04ea168cff Clean up code
Summary:
  * Remove unused import
  * Remove unused variables
  * Empty string is always False, don't check it twice
  * Use os.path.join to create a path

Test Plan: Check that the behaviour is the same as before.

Reviewers: tsimonq2

Reviewed By: tsimonq2

Differential Revision: https://phab.lubuntu.me/D65
2020-04-23 04:43:20 -05:00
ce9e4a5080 "&", not "&". 2020-04-23 04:38:55 -05:00
17e3f7dc47 If the branch already exists, don't create it again. 2020-04-23 04:36:31 -05:00
a8aec7fc37 If we can't just push it after a fast-forward merge, something is wrong. Don't assume it's all fine. 2020-04-23 04:21:23 -05:00
c310fd6ced Update hardcoded GPG pubkey fingerprint. 2020-04-23 02:40:56 -05:00
10adcf4555 Retry all builds to make sure flaky builds are less flaky. 2019-07-03 00:21:23 -05:00
Simon Quigley
4359bd14a5 Make sure all of the merger job have the merger management job as its upstream. 2019-04-13 15:54:37 -05:00
Simon Quigley
066fe8be08 Add the merger to the mgmt view. 2019-04-13 15:53:17 -05:00
Simon Quigley
4cda798504 Don't directly trigger the management job automatically, and create a master merger job. 2019-04-13 15:51:19 -05:00
Simon Quigley
872b968a1a And another underscore. 2019-04-13 15:42:45 -05:00
Simon Quigley
33be3109fd Add another missing underscore. 2019-04-13 15:41:25 -05:00
Simon Quigley
55f157a0f2 Bring the management job creation outside the scope of the main loop. 2019-04-13 15:39:03 -05:00
Simon Quigley
84cb5542c5 Add a missing underscore. 2019-04-13 15:38:14 -05:00
Simon Quigley
3f1c84609f Don't forget to close the project tag. 2019-04-13 15:36:42 -05:00
Simon Quigley
be0df4de34 Revert "Print the package_config for the management job."
This reverts commit 3189f14152fdfbd8205e2cce8dc7748e1290d633.
2019-04-13 15:36:22 -05:00
Simon Quigley
3189f14152 Print the package_config for the management job. 2019-04-13 15:35:17 -05:00
Simon Quigley
4e384845a2 Make data an optional argument, and only try to pull values from it if it is passed. 2019-04-13 15:32:40 -05:00
Simon Quigley
685228adfc Change to using management jobs. 2019-04-13 15:30:05 -05:00
Simon Quigley
eb286afbdd Sleep for five minutes instead of two.
There's no way the build is uploaded, done, and published in two
minutes, let alone five, so there's little downside. This fixes the race
condition where Launchpad hasn't even reviewed the upload in the queue
in two minutes, and since we're already checking every five minutes,
this time gap makes sense.
2019-04-13 14:44:58 -05:00
Simon Quigley
624173d664 Remove the obsolete package.xml template. 2019-04-13 14:44:20 -05:00
Simon Quigley
e6d2571b10 Ensure the correct upload target is put in. 2019-04-13 14:41:11 -05:00
Simon Quigley
3f83cdf778 No wonder that isn't working, we didn't even download the tar yet! Fix that. 2019-04-13 13:53:57 -05:00
Simon Quigley
e69667bfff Wrap it in a bash call. 2019-04-13 13:51:08 -05:00
Simon Quigley
037bfcb5cb Try renaming the tars correctly. 2019-04-13 13:47:28 -05:00
Simon Quigley
3a15d58a92 Remove extra line. 2019-04-13 13:33:22 -05:00