asonix
0bf8b6a2a8
Update rusty-s3 to 0.5.0
continuous-integration/drone/push Build is passing
2023-10-08 11:29:59 -05:00
asonix
745e990fa0
Remove direct dependency on actix-rt and actix-server
continuous-integration/drone/push Build is running
2023-09-24 15:45:10 -05:00
asonix
cde4a72203
Add metrics to object storage body streams
2023-09-20 19:46:10 -05:00
asonix
49d3037358
Add metrics to object storage requests
2023-09-20 19:39:03 -05:00
asonix
1b97ac1c5a
Start replacing manual stream implementations with streem
continuous-integration/drone/push Build is failing
2023-09-10 18:55:13 -04:00
asonix
a43de122f9
postgres: add already-claimed case, general: tracing paranoia
2023-09-03 21:30:47 -05:00
asonix
8921f57a21
Remove Identifier trait, Replace with Arc<str>
2023-09-02 18:38:02 -05:00
asonix
8c532c97e6
Initial postgres work
continuous-integration/drone/push Build is failing
2023-09-02 11:52:55 -05:00
asonix
ba3a23ed43
Add error codes
2023-09-01 20:51:01 -05:00
asonix
95637fdfe5
Remove direct dep on futures-util
continuous-integration/drone/push Build is running
2023-08-23 19:10:10 -05:00
asonix
8f50a15b25
Reduce reliance on futures-util
continuous-integration/drone/push Build is passing
2023-08-23 11:59:42 -05:00
asonix
c1127b4117
Set content-length in PutObject, CompleteMultipart
continuous-integration/drone/push Build is passing
2023-07-21 19:45:22 -05:00
asonix
2f0a3618d8
Replace awc with reqwest
2023-07-21 16:58:31 -05:00
asonix
786f583d98
Add public_url to Store for optional redirects to public object store urls
...
Add details generation to file migration to set the content-type for uploads
2023-07-14 14:53:37 -05:00
asonix
691bca286c
Make object storage timeouts configurable
continuous-integration/drone/push Build is passing
2023-07-11 13:01:58 -05:00
asonix
4be2eb67d1
Increase object storage signature expiry to 15 seconds
continuous-integration/drone/push Build is passing
2023-07-10 16:28:51 -05:00
asonix
4680f9c3aa
Instrument repo and store build methods
continuous-integration/drone/push Build is passing
2023-07-08 10:42:03 -05:00
asonix
7274538b70
Try adding store healthcheck
continuous-integration/drone/push Build encountered an error
2023-07-07 12:05:42 -05:00
asonix
a1d48cbb42
Share client between object store and request extractor
...
Add config to limit connection pool size
2023-06-23 11:20:20 -05:00
asonix
071d788349
Include original error in object storage sendrequest error
2023-06-21 17:07:14 -05:00
asonix
554d852e68
Create unique errors for Repo and Store, separate from UploadError
...
Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound
Allow skipping files that are not found during store migration
2023-06-20 15:59:08 -05:00
asonix
0aa3f574a5
Clippy
continuous-integration/drone/push Build was killed
2023-01-29 11:57:59 -06:00
asonix
f6d6d54b88
Update deps
continuous-integration/drone/push Build is failing
2023-01-29 11:47:28 -06:00
asonix
3325b222a2
clippy
continuous-integration/drone/push Build is passing
2022-11-26 11:18:34 -06:00
asonix
669b3fb86f
Fix webp metadata stripping, more tracing cleanup
continuous-integration/drone/push Build is passing
2022-10-01 22:47:52 -05:00
asonix
718f09c43a
Clean tracing, simplify validation, rename InputFormat -> VideoFormat
continuous-integration/drone/push Build is passing
2022-10-01 21:17:18 -05:00
asonix
e7cf21f862
Allow concurrency in small object uploads
continuous-integration/drone/push Build is passing
continuous-integration/drone/tag Build is passing
2022-10-01 13:06:19 -05:00
asonix
fe2a499110
Fix sending upload parts (set size), optimize small file uploads
continuous-integration/drone/push Build is passing
2022-10-01 13:00:07 -05:00
asonix
0307dc5a3b
Introduce BytesStream to simplify aggregating, forwarding bytes
continuous-integration/drone/push Build is failing
2022-10-01 12:06:33 -05:00
asonix
dc95417846
Improve concurrency for upload streams part 2
continuous-integration/drone/push Build is failing
continuous-integration/drone/pr Build is failing
2022-09-25 08:27:11 -05:00
asonix
bf3c47e457
Improve concurrency for upload streams
continuous-integration/drone/push Build is failing
2022-09-24 22:07:06 -05:00
asonix
a6adde874e
Implement s3 multipart uploads
2022-09-24 20:33:59 -05:00
asonix
25209e29c0
Make it compile
continuous-integration/drone/push Build is failing
2022-09-24 17:18:53 -05:00
asonix
ff1771e016
More migration work for rusty-s3
continuous-integration/drone/push Build is failing
2022-09-24 14:18:49 -05:00
asonix
ab7fd9aaf7
Start work on using rusty-s3 instead of rust-s3
continuous-integration/drone/push Build is failing
2022-09-24 13:39:27 -05:00
Aode (lion)
2db76ad8c5
Update dependencies
continuous-integration/drone/push Build is passing
2022-04-29 15:54:54 -05:00
Aode (lion)
c80d207a87
Improve tracing
continuous-integration/drone/push Build is passing
2022-04-06 21:40:49 -05:00
Aode (lion)
c0d8e0e8e3
Support multiple queues for job processor
continuous-integration/drone/push Build is passing
2022-04-01 11:51:46 -05:00
Aode (lion)
09281d9ae8
Move stream timeout to all response bodies
continuous-integration/drone/push Build is passing
2022-03-29 16:48:26 -05:00
Aode (lion)
5adb3fde89
Move some Stream implementations into 'stream' module
continuous-integration/drone/push Build is passing
2022-03-29 15:59:17 -05:00
Aode (lion)
25f4480809
Remove custom stream error mapping types
continuous-integration/drone/push Build is passing
2022-03-29 14:17:20 -05:00
Aode (Lion)
eb5e39c634
Use color-eyre
2022-03-28 20:47:46 -05:00
Aode (lion)
1291bf8beb
Divorce reqwest from main application's spans
continuous-integration/drone/push Build is passing
2022-03-28 18:42:22 -05:00
Aode (lion)
1662f153ce
Numerous changes:
...
continuous-integration/drone/push Build is passing
- Improve error printing (display chain in addition to spantrace)
- Fix migration (read main identifier from identifier tree, not filename tree)
- Ensure uniqueness for processed images in ConcurrentProcessor (use source identifier in addition to thumbnail path, include extension in thumbnail path)
- Update default log levels (make pict-rs quieter)
- Add timeout for serving images from object storage (5 seconds)
2022-03-28 15:34:36 -05:00
Aode (lion)
37e6b21b55
Fix Range, consolidate errors, test object storage
continuous-integration/drone/push Build is failing
2022-03-26 20:45:12 -05:00
Aode (lion)
15b52ba6ec
Get it compiling again
continuous-integration/drone/push Build is failing
2022-03-26 16:49:23 -05:00
Aode (lion)
5b44de2070
clippy
2021-11-23 16:31:15 -06:00
Aode (lion)
0d153ca239
Make stores take filename into account when saving files
2021-11-16 09:45:16 -06:00
Aode (lion)
4c8da2b414
Keep a reqwest client around for sharing an object storage connection pool
2021-11-02 17:21:00 -05:00
Aode (lion)
cf50da30ec
Use rust-s3 fork with asyncwrite support
2021-10-31 12:35:11 -05:00
asonix