asonix/pict-rs
2
2
Fork 1
Code Issues 3 Pull requests Actions Projects Releases 139 Wiki Activity
741 commits 23 branches 310 tags 14 MiB
Commit graph

48 commits

Author SHA1 Message Date
asonix 786f583d98 Add public_url to Store for optional redirects to public object store urls 
Add details generation to file migration to set the content-type for uploads
 2023-07-14 14:53:37 -05:00
asonix 691bca286c Make object storage timeouts configurable
All checks were successful
continuous-integration/drone/push Build is passing
Details
2023-07-11 13:01:58 -05:00
asonix 4be2eb67d1 Increase object storage signature expiry to 15 seconds
All checks were successful
continuous-integration/drone/push Build is passing
Details
2023-07-10 16:28:51 -05:00
asonix 4680f9c3aa Instrument repo and store build methods
All checks were successful
continuous-integration/drone/push Build is passing
Details
2023-07-08 10:42:03 -05:00
asonix 7274538b70 Try adding store healthcheck
Some checks reported errors
continuous-integration/drone/push Build encountered an error
Details
2023-07-07 12:05:42 -05:00
asonix a1d48cbb42 Share client between object store and request extractor 
Add config to limit connection pool size
 2023-06-23 11:20:20 -05:00
asonix 071d788349 Include original error in object storage sendrequest error 2023-06-21 17:07:14 -05:00
asonix 554d852e68 Create unique errors for Repo and Store, separate from UploadError 
Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound
Allow skipping files that are not found during store migration
 2023-06-20 15:59:08 -05:00
asonix 0aa3f574a5 Clippy
Some checks reported errors
continuous-integration/drone/push Build was killed
Details
2023-01-29 11:57:59 -06:00
asonix f6d6d54b88 Update deps
Some checks failed
continuous-integration/drone/push Build is failing
Details
2023-01-29 11:47:28 -06:00
asonix 3325b222a2 clippy
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-11-26 11:18:34 -06:00
asonix 669b3fb86f Fix webp metadata stripping, more tracing cleanup
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-10-01 22:47:52 -05:00
asonix 718f09c43a Clean tracing, simplify validation, rename InputFormat -> VideoFormat
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-10-01 21:17:18 -05:00
asonix e7cf21f862 Allow concurrency in small object uploads
All checks were successful
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
2022-10-01 13:06:19 -05:00
asonix fe2a499110 Fix sending upload parts (set size), optimize small file uploads
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-10-01 13:00:07 -05:00
asonix 0307dc5a3b Introduce BytesStream to simplify aggregating, forwarding bytes
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-10-01 12:06:33 -05:00
asonix 29cab025c6 Improve 0.3 migration code, repo traces 2022-09-27 23:19:52 -05:00
asonix 9db057fdc5 Add admin endpoint to fetch identifier from an alias
All checks were successful
continuous-integration/drone/push Build is passing
Details
continuous-integration/drone/tag Build is passing
Details
2022-09-25 20:59:57 -05:00
asonix dc95417846 Improve concurrency for upload streams part 2
Some checks failed
continuous-integration/drone/push Build is failing
Details
continuous-integration/drone/pr Build is failing
Details
2022-09-25 08:27:11 -05:00
asonix bf3c47e457 Improve concurrency for upload streams
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-09-24 22:07:06 -05:00
asonix a6adde874e Implement s3 multipart uploads 2022-09-24 20:33:59 -05:00
asonix 25209e29c0 Make it compile
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-09-24 17:18:53 -05:00
asonix ff1771e016 More migration work for rusty-s3
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-09-24 14:18:49 -05:00
asonix ab7fd9aaf7 Start work on using rusty-s3 instead of rust-s3
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-09-24 13:39:27 -05:00
Aode (lion) 2db76ad8c5 Update dependencies
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-04-29 15:54:54 -05:00
Aode (Lion) 4ac20546ce Improve migration from 0.3 formats 2022-04-24 17:10:15 -05:00
Aode (lion) c80d207a87 Improve tracing
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-04-06 21:40:49 -05:00
Aode (lion) c0d8e0e8e3 Support multiple queues for job processor
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-04-01 11:51:46 -05:00
Aode (lion) 09281d9ae8 Move stream timeout to all response bodies
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-03-29 16:48:26 -05:00
Aode (lion) 5adb3fde89 Move some Stream implementations into 'stream' module
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-03-29 15:59:17 -05:00
Aode (lion) 25f4480809 Remove custom stream error mapping types
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-03-29 14:17:20 -05:00
Aode (Lion) eb5e39c634 Use color-eyre 2022-03-28 20:47:46 -05:00
Aode (lion) 1291bf8beb Divorce reqwest from main application's spans
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-03-28 18:42:22 -05:00
Aode (lion) 1662f153ce Numerous changes:
All checks were successful
continuous-integration/drone/push Build is passing
Details 
- Improve error printing (display chain in addition to spantrace)
- Fix migration (read main identifier from identifier tree, not filename tree)
- Ensure uniqueness for processed images in ConcurrentProcessor (use source identifier in addition to thumbnail path, include extension in thumbnail path)
- Update default log levels (make pict-rs quieter)
- Add timeout for serving images from object storage (5 seconds)
 2022-03-28 15:34:36 -05:00
Aode (lion) 37e6b21b55 Fix Range, consolidate errors, test object storage
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-03-26 20:45:12 -05:00
Aode (lion) 15b52ba6ec Get it compiling again
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-03-26 16:49:23 -05:00
Aode (lion) 323016f994 Build out migration path
Some checks failed
continuous-integration/drone/push Build is failing
Details
2022-03-25 18:47:50 -05:00
Aode (Lion) d30415bb49 Don't debug PathStore
All checks were successful
continuous-integration/drone/push Build is passing
Details
2022-03-21 21:43:38 -05:00
Aode (lion) 5b44de2070 clippy 2021-11-23 16:31:15 -06:00
Aode (lion) 0d153ca239 Make stores take filename into account when saving files 2021-11-16 09:45:16 -06:00
Aode (lion) 4c8da2b414 Keep a reqwest client around for sharing an object storage connection pool 2021-11-02 17:21:00 -05:00
Aode (lion) ccb9f49b8b Implement storage migration 2021-10-31 21:11:35 -05:00
Aode (lion) cf50da30ec Use rust-s3 fork with asyncwrite support 2021-10-31 12:35:11 -05:00
Aode (lion) 76e3d37009 Clean up ObjectStore's Debug impl 2021-10-28 21:07:31 -05:00
Aode (lion) 366db1e1fe Make object storage with minio work 2021-10-28 20:59:11 -05:00
Aode (lion) f9f4fc63d6 Optionally support s3-compatible storage (untested) 2021-10-27 23:06:03 -05:00
Aode (lion) 26a2401027 Use tmp files for mp4s 2021-10-23 14:14:12 -05:00
Aode (lion) 48557bc2ea Make pict-rs generic over file storage 2021-10-22 23:48:56 -05:00