Commit graph

137 commits

Author SHA1 Message Date
asonix 7f49af58fe Update actix-form-data, impl Store & Repo for Data<T>
Some checks failed
continuous-integration/drone/push Build is failing
2022-09-10 19:29:22 -05:00
Aode (lion) e0543b2c1c Add HEAD endpoints for process, serve
All checks were successful
continuous-integration/drone/push Build is passing
2022-07-17 11:15:43 -05:00
asonix cb9a594f24 Fix content type on already processed images 2022-06-21 11:27:22 -05:00
Aode (lion) 8ee26ccf4f change some import paths
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-27 20:13:49 -05:00
Aode (Lion) 4ac20546ce Improve migration from 0.3 formats 2022-04-24 17:10:15 -05:00
Aode (Lion) b3cbda1337 Add internal endpoint for cleaning variants
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-11 16:56:39 -05:00
Aode (lion) 7436f15267 Dry download client logic
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-08 13:16:22 -05:00
Aode (lion) 5f19b63166 Extract details processing
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-08 13:03:00 -05:00
Aode (lion) 31c5a36c77 Better instrument drops, jobs. Properly disarm backgrounded downloads
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-08 12:51:33 -05:00
Aode (lion) 55d5e43cd2 Consolidate endpoints for downloading media, cached or backgrounded
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-08 12:05:14 -05:00
Aode (lion) 07c61cbe87 Add download backgrounded
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-07 19:07:30 -05:00
Aode (lion) e493e90dd4 Defensive tracing
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-07 12:56:40 -05:00
Aode (Lion) 6cdae7b318 Add 'cache' endpoint for ingesting ephemeral media
All checks were successful
continuous-integration/drone/push Build is passing
By default, cached media should only stick around for 7 days, however
The timeout is reset every time media is accessed, so only obscure
cached media will be flushed from the cache. This '7 days' number is
configurable through the commandline run options as --media-cache-duration
and in the pict-rs.toml file as [media] cache_duration
2022-04-05 20:29:30 -05:00
Aode (lion) b0670c2f66 Move migrate to old
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-03 15:07:31 -05:00
Aode (lion) 29f0774331 Add ability to claim uploads
All checks were successful
continuous-integration/drone/push Build is passing
2022-04-02 21:15:39 -05:00
Aode (lion) 8734dfbdc7 Add backgrounding routes
Some checks failed
continuous-integration/drone/push Build is failing
- Accept backgrounded uploads
- Allow backgrounded processing

Still TODO:
- Endpoint for waiting on/claiming an upload
2022-04-02 20:56:29 -05:00
Aode (Lion) c4d014597e Better job recovery
Some checks failed
continuous-integration/drone/push Build is failing
2022-04-02 18:53:03 -05:00
Aode (Lion) 132e395e5c Multiple items:
- Reduce duplicate work in generate job
- Use hash instead of identifier for unique processing
- Move motion ident generation behind concurrent processor lock
2022-04-02 17:40:08 -05:00
Aode (Lion) 09f53b9ce6 Move away from UploadManager to direct repo & store actions
Some checks failed
continuous-integration/drone/push Build is failing
2022-04-02 16:44:03 -05:00
Aode (lion) 6ed592c432 In Progress: process jobs
Some checks failed
continuous-integration/drone/push Build is failing
- Is this a good idea? it definitely will make interacting with pict-rs harder. Maybe it's best not to do this
2022-04-01 16:51:12 -05:00
Aode (lion) 09281d9ae8 Move stream timeout to all response bodies
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 16:48:26 -05:00
Aode (lion) 5adb3fde89 Move some Stream implementations into 'stream' module
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 15:59:17 -05:00
Aode (lion) 25f4480809 Remove custom stream error mapping types
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 14:17:20 -05:00
Aode (lion) 8226a3571d Enable multi-threaded job processing
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 13:18:47 -05:00
Aode (lion) 602d1ea935 Begin implementing queue, put cleanups in it
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 12:51:16 -05:00
Aode (lion) e25a4781a8 Remove unneeded variable
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 11:09:23 -05:00
Aode (lion) 99d042f36e Allow disabling gif/mp4
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-29 11:04:56 -05:00
Aode (Lion) eb5e39c634 Use color-eyre 2022-03-28 20:47:46 -05:00
Aode (lion) 1662f153ce Numerous changes:
All checks were successful
continuous-integration/drone/push Build is passing
- Improve error printing (display chain in addition to spantrace)
- Fix migration (read main identifier from identifier tree, not filename tree)
- Ensure uniqueness for processed images in ConcurrentProcessor (use source identifier in addition to thumbnail path, include extension in thumbnail path)
- Update default log levels (make pict-rs quieter)
- Add timeout for serving images from object storage (5 seconds)
2022-03-28 15:34:36 -05:00
Aode (Lion) 3792a8923a Finish redoing config probably
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-27 23:27:07 -05:00
Aode (lion) 37e6b21b55 Fix Range, consolidate errors, test object storage
Some checks failed
continuous-integration/drone/push Build is failing
2022-03-26 20:45:12 -05:00
Aode (lion) 15b52ba6ec Get it compiling again
Some checks failed
continuous-integration/drone/push Build is failing
2022-03-26 16:49:23 -05:00
Aode (lion) 323016f994 Build out migration path
Some checks failed
continuous-integration/drone/push Build is failing
2022-03-25 18:47:50 -05:00
Aode (lion) d6567fbbbd Implement sled repo
Some checks failed
continuous-integration/drone/push Build is failing
2022-03-24 17:09:15 -05:00
Aode (lion) a0c99d05eb Create initial trait representation for database
Some checks failed
continuous-integration/drone/push Build is failing
2022-03-24 13:16:41 -05:00
Aode (Lion) 2ad536db17 Promote console from compile flag to runtime flag
Some checks reported errors
continuous-integration/drone/push Build was killed
2022-03-21 22:41:51 -05:00
Aode (Lion) 62615be371 Allow configuring console buffer capacity
All checks were successful
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2022-03-21 21:56:19 -05:00
Aode (Lion) da159c69cb Try setting a lower default cache capacity
Some checks reported errors
continuous-integration/drone/push Build was killed
2022-03-21 21:15:43 -05:00
Aode (lion) 21b6e1dc08 Use actix-web's Range header
All checks were successful
continuous-integration/drone/push Build is passing
2022-03-01 11:23:15 -06:00
Aode (lion) c48808c1e1 Update deps
All checks were successful
continuous-integration/drone/push Build is passing
2021-12-18 20:24:22 -06:00
Aode (lion) 11739cd42c Remove fancy span following code
All checks were successful
continuous-integration/drone/tag Build is passing
continuous-integration/drone/push Build is passing
2021-12-06 20:35:22 -06:00
Aode (lion) 920f1f154c Improve follows-from and parent span relationships
All checks were successful
continuous-integration/drone/push Build is passing
2021-12-06 12:43:03 -06:00
Aode (lion) 42aed5165c Update tracing-awc, add drone
All checks were successful
continuous-integration/drone Build is passing
2021-12-03 14:21:31 -06:00
Aode (lion) 5f5c1d3530 Merge branch 'main' of git.asonix.dog:asonix/pict-rs into main 2021-11-23 16:31:19 -06:00
Aode (lion) 5b44de2070 clippy 2021-11-23 16:31:15 -06:00
Aode (Lion) 79afd0e8ea Update deps 2021-11-23 12:29:42 -06:00
Aode (lion) 0d153ca239 Make stores take filename into account when saving files 2021-11-16 09:45:16 -06:00
Aode (lion) c5d6610276 Properly handle out-of-bounds range requests 2021-11-03 12:04:59 -05:00
Aode (lion) 4c8da2b414 Keep a reqwest client around for sharing an object storage connection pool 2021-11-02 17:21:00 -05:00
Aode (lion) ccb9f49b8b Implement storage migration 2021-10-31 21:11:35 -05:00