338 commits

Author	SHA1	Message	Date
asonix	8d35c2449d	Simplify the cancel-safe processor	2023-07-22 10:46:16 -05:00
asonix	c1127b4117	Set content-length in PutObject, CompleteMultipart	2023-07-21 19:45:22 -05:00
asonix	2f0a3618d8	Replace awc with reqwest	2023-07-21 16:58:31 -05:00
asonix	fc14ac2038	Clippy	2023-07-18 21:59:27 -05:00
asonix	3d93300ba9	Add access repos for alias & identifier	2023-07-18 21:56:13 -05:00
asonix	127dd6cdad	Make max file count configurable	2023-07-18 20:32:17 -05:00
asonix	eeac900d7e	Add quality value to process method, move -coalesce earlier in pipelines	2023-07-18 16:18:01 -05:00
asonix	558605381d	Fix dangling unprocessed uploads ... Adds error boundary around backgrounded ingest	2023-07-17 22:32:08 -05:00
asonix	496bcc5dc1	Only include -b:v 0 for VP9 ... also simplify building arguments	2023-07-17 18:13:50 -05:00
asonix	3aecef3a9e	Remove println	2023-07-17 17:47:48 -05:00
asonix	b1bbc6b159	Attempt adding quality settings to pict-rs	2023-07-17 17:45:26 -05:00
asonix	c4c920191f	Add read-only mode	2023-07-17 14:24:49 -05:00
asonix	dd1d509bb1	Enable configuring download client timeout	2023-07-17 13:44:31 -05:00
asonix	5e8ab7856d	Extract Status errors into command-specific errors	2023-07-17 13:30:08 -05:00
asonix	2961aae6e3	Port migration changes from 0.4.1	2023-07-16 22:07:42 -05:00
asonix	a751d92436	Port error changes to 0.5	2023-07-16 21:51:14 -05:00
asonix	9871ad2ee0	Clippy	2023-07-14 23:16:57 -05:00
asonix	4d78ce7689	Fix store delegation for public_url	2023-07-14 15:23:07 -05:00
asonix	786f583d98	Add public_url to Store for optional redirects to public object store urls ... Add details generation to file migration to set the content-type for uploads	2023-07-14 14:53:37 -05:00
asonix	4e58388b41	Clean alias before checking hash option	2023-07-13 19:58:31 -05:00
asonix	afeac8294a	Fix Alias cleanup ordering ... Update dev.toml	2023-07-13 19:57:09 -05:00
asonix	ec6c9aac1e	Better discovery validation, proper invoking of imagemagick	2023-07-13 19:21:57 -05:00
asonix	9b1dd1f8c3	Copy process from 0.4.x branch	2023-07-13 19:21:28 -05:00
asonix	2c22f2ee3a	It compiles and runs, but doesn't work	2023-07-13 17:42:21 -05:00
asonix	27451971a6	Fix tests, add animated_webp test	2023-07-13 14:34:40 -05:00
asonix	33b83f97f2	It compiles ... Need to reinstate media limits	2023-07-13 13:48:59 -05:00
asonix	ad1837f9dd	VERY BROKEN: start replacing parts of pict-rs	2023-07-12 22:12:21 -05:00
asonix	58d9765594	WIP: Rework format detection and conversions ... - Add a bunch of types & methods that aren't used yet. The idea is creating the output from the known input parameters is pure, and works for any uploaded media - Introduce a new kind of media "animation" which is neither an image nor a video. It is likely that animations can be processed properly at the /image/process.{ext} endpoint with a little massaging TODO: - Integrate this into exiftool, ffmpeg, magick commands - Detect apng with ffmpeg (imagemagick treats it as a still png unless it's given a hint) - Infallible conversion from Details to OutputFile - this might be impossible given that we don't currently store more than a mime type and a frame count to give any sort of indication of real type - Try not to break API	2023-07-11 23:11:25 -05:00
asonix	691bca286c	Make object storage timeouts configurable	2023-07-11 13:01:58 -05:00
asonix	f5c39f9be5	Typo, error formatting	2023-07-10 17:15:43 -05:00
asonix	4be2eb67d1	Increase object storage signature expiry to 15 seconds	2023-07-10 16:28:51 -05:00
asonix	9004ecaadf	Better classify process related errors	2023-07-10 15:29:41 -05:00
asonix	e10cb1401d	Bump version	2023-07-09 15:16:04 -05:00
asonix	7dadbcf3ed	Replace UnsupportedFormat error with more helpful errors	2023-07-09 15:07:49 -05:00
asonix	1694f49436	Use json for ffmpeg, imagemagick details parsing	2023-07-09 14:50:58 -05:00
asonix	686be1d93b	Turn export_path into flag for sled	2023-07-08 19:56:26 -05:00
asonix	7768d4e58e	Add database exports ... This should help admins running pict-rs on traditional filesystems to keep valid backups of pict-rs' sled repo	2023-07-08 17:36:01 -05:00
asonix	4680f9c3aa	Instrument repo and store build methods	2023-07-08 10:42:03 -05:00
asonix	d51c348a3f	Run health checks on old and new stores before migrating	2023-07-07 14:05:13 -05:00
asonix	3ccb8ecd8c	Validate alias represents real file before setting not found	2023-07-07 13:33:27 -05:00
asonix	9e7376d411	Remove is_missing error, make Identifier and DeleteToken return Option on fetch	2023-07-07 13:17:26 -05:00
asonix	7274538b70	Try adding store healthcheck	2023-07-07 12:05:42 -05:00
asonix	c150903980	Expand store differentiation	2023-07-07 11:19:39 -05:00
asonix	75be876d3c	Differentiate missing files in old vs new store for migration	2023-07-07 11:03:10 -05:00
asonix	508dd4340b	Fix panic when migrating < 100 files, improve resumed migration messaging	2023-07-06 16:06:37 -05:00
asonix	3487cb0e30	Add ability to set 404 image ... Fix imagemagick blur arguments	2023-07-05 19:07:03 -05:00
asonix	e7e4876908	Explicitly handle cases of invalid aliases	2023-07-05 16:46:44 -05:00
asonix	23e67b9697	Enhance migration handling of missing identifiers ... Queue a cleanup task for hashes that don't have original file identifiers Be more specific about what field is missing when a field is missing	2023-07-05 09:52:19 -05:00
asonix	2274dfecb4	Fix io-uring - read_to_end was polling Stream mapped through StreamReader after completion	2023-07-05 00:35:07 -05:00
asonix	c8e84b8914	Greatly improve error information during migration	2023-07-02 21:07:15 -05:00