This website requires JavaScript.
8ea37122c5
Refine task insertion logic for previous commits
main
Simon Quigley
2025-02-16 17:42:27 -06:00
b2958b72b6
Attempt to clean up packageconf handling around system tasks
Simon Quigley
2025-02-16 16:51:06 -06:00
ee26b576c4
Queue source and build checks as system tasks
Simon Quigley
2025-02-16 13:14:11 -06:00
cd5ad6c3a9
Set a width of 18% for Queued
Simon Quigley
2025-02-13 14:53:06 -06:00
a37ee074be
Set a width of 65% for the log column in tasks
Simon Quigley
2025-02-13 14:48:20 -06:00
0fa2f12db8
Add qcoro to gear6
Simon Quigley
2025-02-13 12:26:08 -06:00
c2e3682d4c
Try direct assignment again
Simon Quigley
2025-02-12 21:04:03 -06:00
328cef71af
Don't follow symlinks infinitely
Simon Quigley
2025-02-10 17:07:22 -06:00
ba5e74caef
Small cleanup around task_mutex_
Simon Quigley
2025-02-10 16:07:09 -06:00
946235318a
Move common filesystem utilities from utilities to a new fs_common
Simon Quigley
2025-02-10 15:08:36 -06:00
8422093caf
Also set permission fallbacks
Simon Quigley
2025-02-10 14:42:55 -06:00
f4a4cfdf1f
Correctly set the mtime for the tarball
Simon Quigley
2025-02-10 14:40:46 -06:00
2693255a79
Small path correction
Simon Quigley
2025-02-10 02:04:56 -06:00
6ac61139ae
Move the tar functionality to tar_common
Simon Quigley
2025-02-10 02:03:22 -06:00
698e92fca8
Further tarball iteration
Simon Quigley
2025-02-10 01:49:45 -06:00
fe1e64d3cd
Can't one-line a catch statement??
Simon Quigley
2025-02-10 01:31:09 -06:00
e5cf2ebd61
std::string -> const char*
Simon Quigley
2025-02-10 01:28:03 -06:00
9517f6d74c
Fix conversion of group and user name to strings
Simon Quigley
2025-02-10 01:22:46 -06:00
d851f1ee8d
Reorganize headers and utilize archive_entry_set_uname / archive_entry_set_gname
Simon Quigley
2025-02-10 00:27:29 -06:00
53bfdecf73
When unable to stat(), adjust, don't continue
Simon Quigley
2025-02-09 23:59:20 -06:00
a138ed9328
Fine-tune tarball creation permissions
Simon Quigley
2025-02-09 23:44:37 -06:00
a558f51b5d
Source and build check fine-tuning
Simon Quigley
2025-02-08 20:13:38 -06:00
4829551112
Move ensure_git_inited from utilities to git_common
Simon Quigley
2025-02-08 19:36:21 -06:00
be1e7a31bc
Remove redundant to_time_t utility function
Simon Quigley
2025-02-08 19:28:37 -06:00
c998b3d4a4
Small cleanup around the tasks endpoint
Simon Quigley
2025-02-08 18:41:27 -06:00
6e978cc42c
Add a logging statement when doing a source check
Simon Quigley
2025-02-08 18:27:48 -06:00
d334bdebd8
Break the loop early (and thus hold the lock for less time) if we have all the data we need
Simon Quigley
2025-02-08 17:58:29 -06:00
f6a2ef8f3c
Slightly decrease delay from 1.5 to 1.4
Simon Quigley
2025-02-08 16:52:19 -06:00
ae22b08ad7
Space out build checks a little more; only check once an hour
Simon Quigley
2025-02-08 16:46:47 -06:00
731bbda848
Limit the lock context when checking sources and builds
Simon Quigley
2025-02-08 16:43:52 -06:00
8371277873
Also add support for automatically retrying failed source and build checks up to a certain point (1h for source builds, several days for build checks)
Simon Quigley
2025-02-08 02:01:22 -06:00
9233c8d810
Add missing include
Simon Quigley
2025-02-08 01:40:26 -06:00
85b0703e62
Enable new source check and build check tasks again
Simon Quigley
2025-02-08 01:10:28 -06:00
c3487eb887
Further tarball refinement
Simon Quigley
2025-02-08 00:56:28 -06:00
d74edb6a5a
Further rework path handling
Simon Quigley
2025-02-07 23:37:20 -06:00
a6c3fb165b
Touch up duplicate handling further
Simon Quigley
2025-02-07 21:28:46 -06:00
881adad442
Rework tarball logic further
Simon Quigley
2025-02-07 20:38:52 -06:00
77cbfb46cf
Go back to removing everything with .git in the name from tarballs, not just .git/
Simon Quigley
2025-02-07 19:45:59 -06:00
c8889e4b51
Cleanup tarball creation with try/catch, and remove duplicate file handling
Simon Quigley
2025-02-07 17:12:26 -06:00
f08b3ee199
Fix compilation warning
Simon Quigley
2025-02-04 00:57:19 -06:00
61f017eb2a
Only copy the debian directory, to avoid diff errors when the packaging tracks upstream sources
Simon Quigley
2025-02-04 00:55:16 -06:00
2aa28e2a50
Cleanup for the last commit
Simon Quigley
2025-02-03 15:41:14 -06:00
5f01bf5144
Various fixups around shared pointers and commits
Simon Quigley
2025-02-03 15:24:30 -06:00
8b9bd3142a
Use the Debian packaging for cmake
Simon Quigley
2025-02-03 15:21:20 -06:00
ed1559beb6
Fix typo preventing viewing of logs
Simon Quigley
2025-02-01 23:48:41 -06:00
8f7654c446
Try assigning pointers again
Simon Quigley
2025-02-01 22:40:23 -06:00
06a6567da9
Various cleanup bits
Simon Quigley
2025-02-01 17:02:05 -06:00
6eada27b20
Cleanup of CI database objs
Simon Quigley
2025-02-01 14:52:21 -06:00
5ed7b459c8
Properly convert int to std::string
Simon Quigley
2025-01-31 16:10:52 -06:00
5ac551f36a
Allow fetching the log for a specific task
Simon Quigley
2025-01-31 16:00:49 -06:00
7b63ca627e
Set defined widths for statuses
Simon Quigley
2025-01-31 15:17:27 -06:00
b5a5d66aad
yo dawg, I heard you like locks, so I locked your lock inside your lock
Simon Quigley
2025-01-30 00:55:47 -06:00
9a2d090eb4
build_check -> binary_check
Simon Quigley
2025-01-29 22:38:12 -06:00
29530ab6b5
Process builds every 15 minutes
Simon Quigley
2025-01-29 17:24:31 -06:00
2c82ddf9f3
Add initial sleep for background processing functions
Simon Quigley
2025-01-29 14:55:37 -06:00
bb3d45c4ea
In process_binaries_thread_, exit earlier if the item is not found in the PPA
Simon Quigley
2025-01-29 14:53:41 -06:00
a089918462
Actually add support for build statuses
Simon Quigley
2025-01-29 14:16:32 -06:00
03fdd33084
Further cleanup around source check timestamps
Simon Quigley
2025-01-29 13:20:48 -06:00
d6fa2d3792
Clear tasks before doing a pull and build all
Simon Quigley
2025-01-29 00:57:48 -06:00
cf7d05cc7b
Do a more direct sync
Simon Quigley
2025-01-29 00:15:04 -06:00
a4567f33d3
Ensure source checks are retried if failed
Simon Quigley
2025-01-28 23:58:38 -06:00
fca016b1df
Explicitly pass pkgconf to the lambda for source checks
Simon Quigley
2025-01-28 14:47:41 -06:00
9636a83546
Explicitly sync packageconfs after build/upload
Simon Quigley
2025-01-28 14:46:42 -06:00
94f5e376d4
Don't include warning: ignoring deletion of file in logs
Simon Quigley
2025-01-28 12:22:18 -06:00
9c53398fc9
Less calls to functions with locks
Simon Quigley
2025-01-28 12:22:03 -06:00
b82181d3f3
Tweak navbar
Simon Quigley
2025-01-28 11:54:51 -06:00
b1840bceb5
Enable LTO
Simon Quigley
2025-01-27 23:11:44 -06:00
dc4b0980b0
Small cleanup around changelog resets
Simon Quigley
2025-01-27 23:03:28 -06:00
de23cff1cc
Lower the max concurrent tasks to 6
Simon Quigley
2025-01-27 21:22:59 -06:00
809b69ae10
Deduplicate packages instead of packageconfs in running tasks
Simon Quigley
2025-01-27 19:57:56 -06:00
bf2255868a
return -> continue
Simon Quigley
2025-01-27 18:49:32 -06:00
7f3b73a857
Meh, don't use futures
Simon Quigley
2025-01-27 18:46:53 -06:00
b94ec17fd3
Further refinements to thread_db initialization
Simon Quigley
2025-01-27 18:14:24 -06:00
3bff0f3651
Add an extra sync
Simon Quigley
2025-01-27 18:01:22 -06:00
9e6a0b0453
Initialize thread_db within the loop
Simon Quigley
2025-01-27 17:51:52 -06:00
9c7c91dac9
Retry on parameter count mismatch as well
Simon Quigley
2025-01-27 17:50:02 -06:00
12cf91e4b2
Add a task save lock
Simon Quigley
2025-01-27 17:42:37 -06:00
ee8d6ffcc7
Try to do the pkgconf sync right away in the future
Simon Quigley
2025-01-27 17:31:53 -06:00
3f33edb4fa
Cut the future sleep in half
Simon Quigley
2025-01-27 16:43:16 -06:00
fb1d5e4340
Add another try/catch
Simon Quigley
2025-01-27 12:58:31 -06:00
2bc5c191f0
Add a 500 ms sleep when queuing futures, just in case
Simon Quigley
2025-01-27 12:38:56 -06:00
b618bf0932
Try to do exponential backoff with get_thread_connection too
Simon Quigley
2025-01-27 00:34:46 -06:00
8af3fe19b4
Use futures for queuing pull and tarball tasks
Simon Quigley
2025-01-27 00:10:50 -06:00
406fddb27b
Move to the database at the very end of a task
Simon Quigley
2025-01-26 23:40:58 -06:00
91fb6f2548
Only sync the task once per run in the task queue
Simon Quigley
2025-01-26 23:33:01 -06:00
9a35473d37
Use functions directly instead of grabbing many locks at once
Simon Quigley
2025-01-26 22:35:57 -06:00
1ecec033f1
Slightly rework locking with pull_project
Simon Quigley
2025-01-26 21:21:13 -06:00
0dced17ef2
Wrap clone/fetch in retry loops
Simon Quigley
2025-01-26 21:05:23 -06:00
c9474eccfb
Split apart Git functionality into a separate file
Simon Quigley
2025-01-26 20:42:51 -06:00
8b55525646
Decrease exponential backoff further
Simon Quigley
2025-01-26 20:26:04 -06:00
f98b9c04d8
Attempt to fix assignment of commits
Simon Quigley
2025-01-26 19:02:07 -06:00
20a701641a
General cleanup around task locking for a pkgconf
Simon Quigley
2025-01-26 17:56:13 -06:00
64ffc1b9e4
Be better about recognizing HTTP_PROXY
Simon Quigley
2025-01-26 16:59:50 -06:00
2bdae98c7e
Try to also recognize NO_PROXY
Simon Quigley
2025-01-26 16:46:21 -06:00
76605a4aed
No need to override the cert anymore
Simon Quigley
2025-01-26 16:25:58 -06:00
ce4050f1e2
Attempt to correctly use HTTP proxies if set via env var
Simon Quigley
2025-01-26 16:04:41 -06:00
fddc635957
Enable SSL and HTTP/2
Simon Quigley
2025-01-26 01:16:58 -06:00
f3bd66b872
Lower exponential backoff initial value even further
Simon Quigley
2025-01-25 23:59:41 -06:00
90baa5d8b8
Slightly enhance logging
Simon Quigley
2025-01-25 23:49:39 -06:00
80932a3136
Only show every 5% in the Git progress
Simon Quigley
2025-01-25 23:46:29 -06:00