Commit Graph

919 Commits

Author SHA1 Message Date
Makhuta
df4b824672 Change
- simplified the returns
2025-01-11 22:17:10 +01:00
Makhuta
3ea7e6c8ee Change
- changed the episode_str to be togglable and use the old format by default
2025-01-11 22:07:36 +01:00
tcely
f464acaa63
Simplify directory_path for Media 2025-01-11 15:38:45 -05:00
tcely
4364ebbff3
Multi-stage docker build for ffmpeg & s6-overlay
* Create a s6-overlay-extracted stage to copy from

This was largely inspired by: @socheatsok78

Our downloaded files are checked where that version doesn't do any verification of the downloads.

* Update ffmpeg to the first build with checksums.sha256

* Create a ffmpeg-extracted stage to copy from

* Don't preserve ownership from the builder

I was sick of the extra work with ffmpeg builds.

So, I managed to get sums generated for those builds and now we don't need to manually fill out SHA256 hashes anymore.

Now to bump ffmpeg, we can just change the date.
2025-01-11 11:53:10 -05:00
Makhuta
8dda325dbd Update models.py 2025-01-11 15:53:36 +01:00
Makhuta
81edd08c7d Update
- added video order to Media Format
2025-01-11 14:38:31 +01:00
tcely
6292a9a59d
Add SHRINK_OLD_MEDIA_METADATA setting 2025-01-09 14:22:37 -05:00
tcely
1ff8dfda98
Use the new copy argument to filter_response 2025-01-09 13:53:12 -05:00
tcely
274f19fa15
Use the new copy argument to filter_response 2025-01-09 13:41:23 -05:00
tcely
0f986949e5
Have filter_response return a copy, if requested 2025-01-09 13:36:43 -05:00
tcely
29c39aab1f
Add SHRINK_NEW_MEDIA_METADATA setting 2025-01-09 13:20:22 -05:00
tcely
3e3f80d287
More filter_response asserts 2025-01-09 12:04:01 -05:00
tcely
4c9fa40bb0
More filter_response asserts 2025-01-09 11:47:10 -05:00
meeb
b829b233f8
Merge pull request #615 from tcely/patch-5
Test and log ffmpeg version output earlier
2025-01-10 02:20:47 +11:00
meeb
ee5f611592
Merge pull request #614 from tcely/patch-4
Make better use of CPU cache with nginx
2025-01-10 02:19:49 +11:00
meeb
1b1fc67984
Merge pull request #613 from tcely/patch-1
exec nginx so bash isn't still running
2025-01-10 02:18:13 +11:00
tcely
682a53da34
Add a filter_response test
First, only check that changes did happen.
2025-01-09 10:17:37 -05:00
tcely
100382f66f
Rename compact_data to compact_json
This was misleading because the data dict becomes a JSON string.
2025-01-09 09:28:58 -05:00
tcely
ad10bcfa61
Log both compacted and reduced sizes 2025-01-08 22:48:23 -05:00
tcely
d35f52f8ac
Drop /expire/ URLs from automatic_captions too 2025-01-08 11:31:23 -05:00
tcely
7b42213bbb
Keep curl and add less
These are very useful when using the shell inside the container and don't use much space.
2025-01-08 00:36:37 -05:00
tcely
f0b7d31949
Test and log ffmpeg version output earlier
Running the ffmpeg in an earlier (hopefully cached) layer should clean up the logs a bit.

On a related note, shadowing the environment variable was causing some confusing log output, so stop doing that as well.
2025-01-08 00:31:30 -05:00
tcely
ab5e63f643
Make better use of CPU cache with nginx 2025-01-08 00:12:21 -05:00
tcely
6e116899a7
We don't need to keep bash running 2025-01-07 23:45:25 -05:00
tcely
1c432ccce1
Some formats are using a different URL 2025-01-07 13:49:58 -05:00
tcely
7793701228
Simplify results from _url_keys
Also, name the tuple values when using the results.
2025-01-07 13:01:06 -05:00
tcely
8ac5b36eee
Use the exception function for traceback 2025-01-07 06:38:56 -05:00
tcely
2d85bcbe14
Use a distinct try to log errors 2025-01-07 06:20:01 -05:00
tcely
c7457e94ac
Check that the drop_key exists 2025-01-07 05:58:50 -05:00
tcely
7b8d11791d
Drop keys from formats that cannot be useful 2025-01-07 05:39:50 -05:00
tcely
431de2e0df
Loop over a set of keys for each URL type 2025-01-07 04:11:14 -05:00
tcely
db25fa8029
Adjusted comment 2025-01-07 03:35:58 -05:00
tcely
9a4101a0a1
Fix formatting 2025-01-07 03:18:39 -05:00
tcely
2f34fff713
Fixes from testing
The `automatic_captions` has a layer for language codes that I didn't account for.

The type checking was copied and I didn't adjust for the arguments in this function.
2025-01-07 02:55:05 -05:00
tcely
25d2ff6802
Don't reduce the actual data yet 2025-01-07 02:12:22 -05:00
tcely
ca75398548
Merge branch 'meeb:main' into filter-metadata-response 2025-01-07 01:35:13 -05:00
tcely
8c31720bf7
Log the reduction of metadata length 2025-01-07 01:33:06 -05:00
tcely
63fa97cc58
More compact JSON
The software doesn't need an extra space per key.
2025-01-07 00:43:59 -05:00
meeb
f6e557f502
Merge pull request #611 from tcely/patch-1
Don't chmod a+r when it already has those permissions
2025-01-07 16:41:35 +11:00
tcely
8c22b6c99e
Add response filtering
These functions aren't being used yet, they will be tested against my database before that happens.
2025-01-07 00:05:57 -05:00
tcely
215aa64f2d
Change to a logged warning for NFO permission problems 2025-01-06 10:35:37 -05:00
tcely
e64f71a970
Don't chmod a+r when it already has those permissions 2025-01-06 10:23:17 -05:00
meeb
25bc6143e0
Merge pull request #610 from tcely/patch-1
Some checks failed
Run Django tests for TubeSync / test (3.10) (push) Has been cancelled
Run Django tests for TubeSync / test (3.11) (push) Has been cancelled
Run Django tests for TubeSync / test (3.12) (push) Has been cancelled
Run Django tests for TubeSync / test (3.7) (push) Has been cancelled
Run Django tests for TubeSync / test (3.8) (push) Has been cancelled
Run Django tests for TubeSync / test (3.9) (push) Has been cancelled
Run Django tests for TubeSync / containerise (push) Has been cancelled
Match another variation of the message
2025-01-03 01:48:43 +11:00
tcely
59865a885b
Match another variation of the message
```
{key}: This video is available to this channel's members on level: Level 2: Contributor (or any higher level). Join this YouTube channel from your computer or Android app.
```
2025-01-02 02:39:19 -05:00
tcely
fbcd01fe6c
Merge branch 'main' into rename-files-with-source-format-issue-185 2024-12-26 01:08:23 -05:00
meeb
e2f2a7bb49
Merge pull request #595 from tcely/patch-7
Some checks failed
Run Django tests for TubeSync / test (3.10) (push) Has been cancelled
Run Django tests for TubeSync / test (3.11) (push) Has been cancelled
Run Django tests for TubeSync / test (3.12) (push) Has been cancelled
Run Django tests for TubeSync / test (3.7) (push) Has been cancelled
Run Django tests for TubeSync / test (3.8) (push) Has been cancelled
Run Django tests for TubeSync / test (3.9) (push) Has been cancelled
Run Django tests for TubeSync / containerise (push) Has been cancelled
Do not try to skip already skipped media
2024-12-26 12:56:40 +11:00
meeb
b40564ff93
Merge pull request #596 from tcely/patch-8
Reduce image size and keep pycache in a volume
2024-12-26 12:44:42 +11:00
meeb
4248824332
Merge pull request #599 from tcely/patch-4
Fix paths for when filename includes sub-directories
2024-12-26 12:43:16 +11:00
meeb
3b3203c7f1
Merge pull request #591 from tcely/patch-5
Handle raise_no_formats exception
2024-12-26 12:42:10 +11:00
meeb
76ac432e53
Merge pull request #593 from RichardHyde/handle_member_only_videos
Handle download_media_metadata task failures
2024-12-26 12:40:45 +11:00