171 Commits

Author SHA1 Message Date
de23cff1cc Lower the max concurrent tasks to 6 2025-01-27 22:02:23 -06:00
809b69ae10 Deduplicate packages instead of packageconfs in running tasks 2025-01-27 19:57:56 -06:00
bf2255868a return -> continue 2025-01-27 18:49:32 -06:00
7f3b73a857 Meh, don't use futures 2025-01-27 18:46:53 -06:00
b94ec17fd3 Further refinements to thread_db initialization 2025-01-27 18:14:24 -06:00
3bff0f3651 Add an extra sync 2025-01-27 18:01:22 -06:00
9e6a0b0453 Initialize thread_db within the loop 2025-01-27 17:51:52 -06:00
9c7c91dac9 Retry on parameter count mismatch as well 2025-01-27 17:50:02 -06:00
12cf91e4b2 Add a task save lock 2025-01-27 17:42:37 -06:00
ee8d6ffcc7 Try to do the pkgconf sync right away in the future 2025-01-27 17:31:53 -06:00
3f33edb4fa Cut the future sleep in half 2025-01-27 16:43:18 -06:00
fb1d5e4340 Add another try/catch 2025-01-27 12:58:31 -06:00
2bc5c191f0 Add a 500 ms sleep when queuing futures, just in case 2025-01-27 12:38:56 -06:00
b618bf0932 Try to do exponential backoff with get_thread_connection too 2025-01-27 00:34:46 -06:00
8af3fe19b4 Use futures for queuing pull and tarball tasks 2025-01-27 00:10:50 -06:00
406fddb27b Move to the database at the very end of a task 2025-01-26 23:40:58 -06:00
91fb6f2548 Only sync the task once per run in the task queue 2025-01-26 23:33:01 -06:00
9a35473d37 Use functions directly instead of grabbing many locks at once 2025-01-26 22:35:57 -06:00
1ecec033f1 Slightly rework locking with pull_project 2025-01-26 21:21:13 -06:00
0dced17ef2 Wrap clone/fetch in retry loops 2025-01-26 21:05:23 -06:00
c9474eccfb Split apart Git functionality into a separate file 2025-01-26 20:42:51 -06:00
8b55525646 Decrease exponential backoff further 2025-01-26 20:26:04 -06:00
f98b9c04d8 Attempt to fix assignment of commits 2025-01-26 19:02:07 -06:00
20a701641a General cleanup around task locking for a pkgconf 2025-01-26 17:56:13 -06:00
64ffc1b9e4 Be better about recognizing HTTP_PROXY 2025-01-26 16:59:50 -06:00
2bdae98c7e Try to also recognize NO_PROXY 2025-01-26 16:46:21 -06:00
76605a4aed No need to override the cert anymore 2025-01-26 16:25:58 -06:00
ce4050f1e2 Attempt to correctly use HTTP proxies if set via env var 2025-01-26 16:04:43 -06:00
fddc635957 Enable SSL and HTTP/2 2025-01-26 01:16:58 -06:00
f3bd66b872 Lower exponential backoff initial value even further 2025-01-25 23:59:41 -06:00
90baa5d8b8 Slightly enhance logging 2025-01-25 23:49:39 -06:00
80932a3136 Only show every 5% in the Git progress 2025-01-25 23:46:29 -06:00
2331105d58 Do not allow duplicate log entries 2025-01-25 23:36:49 -06:00
e39e2d4c49 Always consolidate the WAL file and VACUUM to start 2025-01-25 23:03:27 -06:00
565be5e97d Attempt to add repo clone/fetch progress to the log 2025-01-25 22:55:19 -06:00
6ea4665dbe Attempt to see if moving up the mutex will help with locking issues 2025-01-25 22:26:45 -06:00
345081b851 Try a different approach for tars 2025-01-25 18:03:25 -06:00
3bad275726 Also pass tarball_task by reference 2025-01-25 17:45:39 -06:00
c0b95cf54f Don't sync tasks without jobstatuses, it'll be taken care of later 2025-01-25 17:27:27 -06:00
2915f73367 Try minimizing duplicate locks 2025-01-25 17:22:41 -06:00
c0ba14764a small one-line 2025-01-25 17:18:42 -06:00
27da8b7df0 Make jobstatus_map a shared pointer, hopefully resolving nullptr issues 2025-01-25 17:01:10 -06:00
a43739dfeb Lower exponential delay 10x 2025-01-25 15:56:25 -06:00
ddc29602ee Add missing job_statuses 2025-01-25 15:46:57 -06:00
7feaf1726c Remove static const from jobstatuses to ensure it is passed correctly 2025-01-25 15:43:48 -06:00
296f37262d Also use exponential backoff for a locked db in the initial database schema, and support passing a QString to exec() 2025-01-25 15:18:34 -06:00
8b6ff0a865 Only queue the tarball task if the pull was successful 2025-01-25 15:09:34 -06:00
495912f0d2 Add several null checks for commits 2025-01-25 14:40:16 -06:00
1e92157a12 Consolidate much of the pull and build logic 2025-01-25 14:10:43 -06:00
228f430797 Be safer about removals from the active tokens list 2025-01-25 13:33:36 -06:00