68 commits

Author	SHA1	Message	Date
asonix	6a6c61058a	Split save_stream for object storage to early-drop stack-pinned stream	2024-02-22 18:55:12 -06:00
asonix	16bf18bda4	Remove some Unpin and 'static bounds	2024-02-22 18:05:04 -06:00
asonix	227e9cc3a7	BytesReader: use built-in state tracking	2024-02-22 17:49:16 -06:00
asonix	f3e455a1c3	Increase buffer size for AsyncRead -> Stream conversion	2024-02-22 16:25:03 -06:00
asonix	d8c4a22ba9	Start describing metrics	2024-02-04 14:26:18 -06:00
asonix	dc12f6f79d	replace remaining web::block with spawn_blocking	2024-01-30 14:16:05 -06:00
asonix	f6087d65be	Use async fn in trait for Store	2024-01-15 15:51:20 -05:00
asonix	9ed90efed4	Add release document, use .extend rather than .join	2024-01-11 16:48:18 -06:00
asonix	708c25f20a	Join identifier onto public_endpoint, rather than overwriting the existing path	2024-01-11 16:06:44 -06:00
asonix	bfc2410552	Add trace-level logs to every loop (paranoid)	2023-12-28 11:58:38 -06:00
asonix	df88660b9e	Lower priority of some object storage spans	2023-12-22 13:58:05 -06:00
asonix	b94ba5fcfc	Inline process background future, clean tracing a bit	2023-12-22 13:12:19 -06:00
asonix	b452a577a7	Add object ID to not found error	2023-12-11 13:05:29 -06:00
asonix	20d07ea29b	Remove direct dependency on quick-xml, update dependencies (minor & point)	2023-11-04 13:18:22 -05:00
asonix	c795c1edfa	Replace most of actix-rt with tokio, give names to tasks	2023-10-20 19:08:11 -05:00
asonix	0bf8b6a2a8	Update rusty-s3 to 0.5.0	2023-10-08 11:29:59 -05:00
asonix	745e990fa0	Remove direct dependency on actix-rt and actix-server	2023-09-24 15:45:10 -05:00
asonix	cde4a72203	Add metrics to object storage body streams	2023-09-20 19:46:10 -05:00
asonix	49d3037358	Add metrics to object storage requests	2023-09-20 19:39:03 -05:00
asonix	1b97ac1c5a	Start replacing manual stream implementations with streem	2023-09-10 18:55:13 -04:00
asonix	a43de122f9	postgres: add already-claimed case, general: tracing paranoia	2023-09-03 21:30:47 -05:00
asonix	8921f57a21	Remove Identifier trait, Replace with Arc<str>	2023-09-02 18:38:02 -05:00
asonix	8c532c97e6	Initial postgres work	2023-09-02 11:52:55 -05:00
asonix	ba3a23ed43	Add error codes	2023-09-01 20:51:01 -05:00
asonix	95637fdfe5	Remove direct dep on futures-util	2023-08-23 19:10:10 -05:00
asonix	8f50a15b25	Reduce reliance on futures-util	2023-08-23 11:59:42 -05:00
asonix	c1127b4117	Set content-length in PutObject, CompleteMultipart	2023-07-21 19:45:22 -05:00
asonix	2f0a3618d8	Replace awc with reqwest	2023-07-21 16:58:31 -05:00
asonix	786f583d98	Add public_url to Store for optional redirects to public object store urls ... Add details generation to file migration to set the content-type for uploads	2023-07-14 14:53:37 -05:00
asonix	691bca286c	Make object storage timeouts configurable	2023-07-11 13:01:58 -05:00
asonix	4be2eb67d1	Increase object storage signature expiry to 15 seconds	2023-07-10 16:28:51 -05:00
asonix	4680f9c3aa	Instrument repo and store build methods	2023-07-08 10:42:03 -05:00
asonix	7274538b70	Try adding store healthcheck	2023-07-07 12:05:42 -05:00
asonix	a1d48cbb42	Share client between object store and request extractor ... Add config to limit connection pool size	2023-06-23 11:20:20 -05:00
asonix	071d788349	Include original error in object storage sendrequest error	2023-06-21 17:07:14 -05:00
asonix	554d852e68	Create unique errors for Repo and Store, separate from UploadError ... Add .is_not_found() for Store errors, wire up Object and File storage to properly set NotFound Allow skipping files that are not found during store migration	2023-06-20 15:59:08 -05:00
asonix	0aa3f574a5	Clippy	2023-01-29 11:57:59 -06:00
asonix	f6d6d54b88	Update deps	2023-01-29 11:47:28 -06:00
asonix	3325b222a2	clippy	2022-11-26 11:18:34 -06:00
asonix	669b3fb86f	Fix webp metadata stripping, more tracing cleanup	2022-10-01 22:47:52 -05:00
asonix	718f09c43a	Clean tracing, simplify validation, rename InputFormat -> VideoFormat	2022-10-01 21:17:18 -05:00
asonix	e7cf21f862	Allow concurrency in small object uploads	2022-10-01 13:06:19 -05:00
asonix	fe2a499110	Fix sending upload parts (set size), optimize small file uploads	2022-10-01 13:00:07 -05:00
asonix	0307dc5a3b	Introduce BytesStream to simplify aggregating, forwarding bytes	2022-10-01 12:06:33 -05:00
asonix	dc95417846	Improve concurrency for upload streams part 2	2022-09-25 08:27:11 -05:00
asonix	bf3c47e457	Improve concurrency for upload streams	2022-09-24 22:07:06 -05:00
asonix	a6adde874e	Implement s3 multipart uploads	2022-09-24 20:33:59 -05:00
asonix	25209e29c0	Make it compile	2022-09-24 17:18:53 -05:00
asonix	ff1771e016	More migration work for rusty-s3	2022-09-24 14:18:49 -05:00
asonix	ab7fd9aaf7	Start work on using rusty-s3 instead of rust-s3	2022-09-24 13:39:27 -05:00