Commit Graph

2547 Commits

Author SHA1 Message Date
tcely
687957f21f
Add BgTaskWorkerError exception 2025-06-06 04:50:20 -04:00
tcely
4cffc94aec
Retry the task when the queue worker is stopped 2025-06-06 04:44:30 -04:00
tcely
2fef103ea0
Don't remove based on task_hash 2025-06-05 13:16:33 -04:00
tcely
2dae3b087e
Delay additional indexing tasks while database tasks run 2025-06-05 04:15:45 -04:00
tcely
587461978d
Delay save_all_media_for_source while database tasks run 2025-06-05 04:03:01 -04:00
tcely
93adc595ff
Wait on database tasks and add verbose names to the new tasks 2025-06-04 15:59:25 -04:00
tcely
54aa509bbf
Migrate data from indexing to metadata in a task 2025-06-02 20:36:55 -04:00
tcely
37a60447ac
Add channel_id to the minimal metadata 2025-05-29 11:41:09 -04:00
tcely
e21da0fb26
Update Media.has_metadata
One of the `*_id` keys must have a value.
2025-05-29 11:29:32 -04:00
tcely
5e20ebdf47
Do not call Media.save_to_metadata function unless needed 2025-05-29 10:18:23 -04:00
tcely
6b64614561
Use the Media.metadata_clear function 2025-05-29 09:57:09 -04:00
tcely
9a5acdd2ab
Create new Media instances with defaults 2025-05-29 08:52:07 -04:00
tcely
6aac84922b
Revert Depend on 0033 temporarily 2025-05-29 01:16:06 -04:00
tcely
cf27324c78
Merge branch 'meeb:main' into index-rewrite 2025-05-29 01:13:10 -04:00
meeb
e3ce550e6a
Merge pull request #938 from tcely/patch-14
Some checks failed
CI / info (push) Has been cancelled
CI / test (3.10) (push) Has been cancelled
CI / test (3.11) (push) Has been cancelled
CI / test (3.12) (push) Has been cancelled
CI / test (3.13) (push) Has been cancelled
CI / containerise (push) Has been cancelled
Rename media files from all sources by default
2025-05-29 15:05:19 +10:00
tcely
460f2c0669
Update README.md 2025-05-29 00:52:31 -04:00
tcely
2120776581
Merge branch 'main' into patch-14 2025-05-29 00:47:27 -04:00
meeb
c0f9b05eb4
Merge pull request #1077 from tcely/patch-7
Set a value when `Media.published` is `None`
2025-05-29 14:24:22 +10:00
meeb
4d160ee673
Merge pull request #1073 from tcely/patch-4
Targeted indexing schedule
2025-05-29 14:14:43 +10:00
tcely
0b5a475e03
Ignore indexed data when trying to reuse old metadata 2025-05-28 16:37:57 -04:00
tcely
d970733204
Providing the source column is still needed 2025-05-28 12:27:41 -04:00
tcely
595e3479ec
Depend on 0033 temporarily 2025-05-28 06:19:41 -04:00
tcely
212f4fb9c7
Create 0035_alter_metadata_unique_together_metadata_source_and_more.py 2025-05-28 06:12:39 -04:00
tcely
7f63c99d5c
Remove an unused import 2025-05-28 05:41:47 -04:00
tcely
db7cceacc5
Merge pull request #681 from tcely/patch-10
Use `Metadata` table to store Source indexing results
2025-05-28 05:38:06 -04:00
tcely
1927b96fcc
Manage the "Checking all media" task better
There is a delay for that task that allows small sources to finish indexing first.

That left us with large indexing tasks and that task running concurrently, which some databases really do not handle well.

Remove the task during indexing and schedule it when indexing has completed.
2025-05-28 05:37:09 -04:00
tcely
2e1b96bb61
Write to the database in batched transactions 2025-05-28 05:16:37 -04:00
tcely
811e36abe0
Do not accept indexing results as media metadata 2025-05-28 01:53:01 -04:00
tcely
3093315271
Use Metadata table to store Source indexing results 2025-05-28 01:39:54 -04:00
tcely
6828eb926c
Set a value when Media.published is None 2025-05-27 14:33:38 -04:00
tcely
05443978cc
Do not adjust Task.run_at
I don't believe this can work with how `background_task` operates.
2025-05-27 00:09:07 -04:00
tcely
7d98855272
Switch to a more human-friendly target schedule format 2025-05-26 22:43:38 -04:00
tcely
4df84b37cf
Calculate the delta to add instead of looping 2025-05-26 22:11:14 -04:00
tcely
ec913485a3
Update source.html 2025-05-26 09:41:23 -04:00
tcely
7e9e6f1262
Do not format the datetime 2025-05-26 09:03:10 -04:00
tcely
ec2d9d6914
Update 0034_source_target_schedule_and_more.py 2025-05-26 08:19:04 -04:00
tcely
9b81c54c0f
fixup: remove white-space 2025-05-26 07:58:13 -04:00
tcely
c797d97f5d
fixup: remove white-space 2025-05-26 07:56:37 -04:00
tcely
c637d2da45
Bump the version 2025-05-26 07:50:44 -04:00
tcely
d6846ee9d4
Update source.py 2025-05-26 07:23:18 -04:00
tcely
be0f57fb5b
Update 0034_source_target_schedule_and_more.py 2025-05-26 07:22:12 -04:00
tcely
6f70fc763f
Update views.py 2025-05-26 07:06:15 -04:00
tcely
a198886ab5
Update forms.py 2025-05-26 06:50:06 -04:00
tcely
73ee968bdd
Update views.py 2025-05-26 06:46:31 -04:00
tcely
252d6f4418
Update forms.py 2025-05-26 06:43:38 -04:00
tcely
2e7d34611b
Update views.py 2025-05-26 06:35:52 -04:00
tcely
58d3541acf
Update 0034_source_target_schedule_and_more.py 2025-05-26 06:19:58 -04:00
tcely
5ddf0208b2
Update forms.py 2025-05-26 06:08:49 -04:00
tcely
a80950ee16
We want to edit target_schedule 2025-05-26 05:22:33 -04:00
tcely
41c1c0a2ba
Update views.py 2025-05-26 04:09:54 -04:00