Commit graph

212 commits

Author SHA1 Message Date
asonix 0a509e0271 Queue as many jobs as we can on ping
This change isn't incredibly important, but in cases where more than one
jobs server is running, and one happens to get a heavy amount of new job
traffic while the others get very few, it is possible that we can end up
with unprocessed jobs in the DB while not every worker is busy. This
change exausts our worker queue on ping if there are jobs available
2019-05-25 17:10:32 -05:00
asonix 875eec57dd Bump versions 2019-05-25 16:41:58 -05:00
asonix 2a6612225a Update cargo toml 2019-05-25 16:39:52 -05:00
asonix e43abbfaaa Add lock on queue traversal 2019-05-25 16:39:16 -05:00
asonix d3987768a5 Update readme, main repo docs 2019-05-25 16:15:09 -05:00
asonix 986a08b7e9 Update repo links 2019-05-25 15:33:38 -05:00
asonix df932f6699 Organize sled 2019-05-25 15:32:17 -05:00
asonix 5b13908886 2019 2019-05-25 15:26:12 -05:00
asonix f2a694879c Revamp background-jobs with pluggable backends 2019-05-25 15:22:26 -05:00
asonix edd63abf0f Relax bounds 2019-05-23 22:41:34 -05:00
asonix 2968ba5360 Drop tokio 2019-05-23 22:25:00 -05:00
asonix d1aeb6c139 Bump actix 2019-05-21 15:04:06 -05:00
asonix 94d0fd9a02
Job IDs start at 1, not 2 2018-12-18 17:11:02 -06:00
asonix 2fea1e8e69
Tick before increment, tick on fetch 2018-12-18 17:09:10 -06:00
asonix c6682d2fc9
Bump version (again) 2018-12-18 16:55:40 -06:00
asonix 2e10a14ed4
Bump version 2018-12-18 16:54:01 -06:00
asonix fcfc85cb69
Add statistics, and expose them through jobs-actix 2018-12-18 16:50:47 -06:00
asonix 975c20bd85
Add crate info for jobs-actix 2018-12-16 13:57:09 -06:00
asonix 3529b3ae08
Re-set default async zmq impl 2018-12-16 13:53:21 -06:00
asonix a7b494ca39
Prepare release 2018-12-16 13:44:25 -06:00
asonix a22d10242a
Fix jobs-server 2018-12-16 13:14:46 -06:00
asonix d266315f1f
Add jobs-actix 2018-12-16 12:43:44 -06:00
asonix 6e79341b38
Add scheduled jobs, fix spawning non-default jobs 2018-12-13 11:08:28 -06:00
asonix 8a78f9e129 Bump KV dep 2018-11-19 20:38:45 -06:00
asonix 2438fbcdaf Remove 'ignore' from readme 2018-11-18 15:10:18 -06:00
asonix ecf3efd9fb Update README version 2018-11-18 15:05:57 -06:00
asonix 4f2530d485 Add application state 2018-11-18 15:05:03 -06:00
asonix 58f794dc55 Update docs, use associated constants, add queue_sync 2018-11-18 08:45:12 -06:00
asonix 803a242a46 Oops, fix doc links 2018-11-17 19:52:36 -06:00
asonix 843b5407e8 Update metadata again 2018-11-17 19:46:42 -06:00
asonix 3553e2bdf8 Update metadata for other crates in the project 2018-11-17 19:43:45 -06:00
asonix 6878a8b3d2 Add metadata to core toml 2018-11-17 19:41:21 -06:00
asonix cf6ede67ea Add documentation, license info, Make API cleaner 2018-11-17 19:39:04 -06:00
asonix c23aa0961d Remove jobs-actix, jobs-tokio 2018-11-17 17:00:43 -06:00
asonix 6ae02e08cb Delete actix and tokio examples 2018-11-17 16:59:16 -06:00
asonix c8f1f6cd34 Mark jobs staged, not running
Clear staged jobs on startup
2018-11-16 19:10:45 -06:00
asonix 9cff817ed6 Rename crate, update TODO 2018-11-16 18:14:33 -06:00
asonix 960c0235c4 Update tokio-zmq, optionally use futures-zmq instead 2018-11-16 18:09:53 -06:00
asonix a877b5c9e8 Apply backpressure in pushers, portmap 2018-11-11 12:42:10 -06:00
asonix c0fcedf8a1 Add queues, make fault tolerant 2018-11-10 22:46:46 -06:00
asonix 0cfec96d4e Introduce queues to server 2018-11-10 21:15:21 -06:00
asonix 02406de28d Write up TODO 2018-11-10 16:51:21 -06:00
asonix dbb8144673 Use Push and Pull to transmit jobs. No more req/rep issues 2018-11-10 15:58:19 -06:00
asonix 87db89b35a Don't push db 2018-11-07 23:48:42 -06:00
asonix e70a6b80e4 Make jobs processor accessible over a network 2018-11-07 23:47:11 -06:00
asonix 77fa5c0df7 Add client/server processor 2018-11-07 22:49:27 -06:00
asonix afff778309 Split core into multiple files 2018-11-07 20:20:30 -06:00
asonix 5b8ec51e33 Generate jobs rather than writing out each one 2018-11-07 20:03:39 -06:00
asonix 3f6e27a9f7 Avoid unwraps by removing the need to parse 2018-11-07 19:59:21 -06:00
asonix 5c8b50643d Make actix handler and frontend 2018-11-07 19:50:21 -06:00