My post was prompted by the guide on twitter spaces and the mention of archiving Twitch with yt-dlp. I automatically archive several YT and Twitch streams and Twitter spaces and get Discord notifications for everything, very convenient. You, too, can have a convenient archiving experience with these three tools:
Twitch -
https://github.com/jangxx/twitch-auto-recorder-3000
Caveats:
- Claims to be Python >=3.7 but is actually also Python <=3.10, Python 3.11 breaks building of the project, instructions are otherwise on point.
- Very reliable twitch recorder using API to detect a live stream. Doesn't need maintenance whatsoever.
- I suggest following the steps for ffmpeg_remux so you get nice mp4s.
- Original ts recordings are still kept so when your hard disk is running low, delete all the ts files or use the included script to do it automatically.
Twitter (spaces) -
https://github.com/HitomaruKonpaku/twspace-crawler
Caveats:
- Twitter API limitation really fucked all things Twitter, had to drastically lower the poll rate so free API plan doesn't run out of quota. Setting a rate of 70000 for 18 channels keeps me in the green. If you want to monitor less, you can go faster. Experiment until you don't run out of quota.
- Installation instructions work just fine, but Nodejs will suggest you install python for building, and that will install a higher version than what is supported by the above Twitch solution. Skip the python installation from the NodeJS installer when using both (or have two python installations in parallel if you know what you are doing)
Youtube -
https://github.com/HoloArchivists/hoshinova
Caveats:
- Ideal for catching every unarchived stream and yab on YT. When it works, it works great but when it doesn't work, it can be a world of pain.
- I found it easiest to run in Linux and you should check on it once or twice a day in case any streams errored out due to temporary connection issues.
- Uses yt-archive to record, is about to add support for yt-dlp which should enable archiving of all content a chuuba uploads
- Nice web interface
I'm happy to help out anyone needing help navigating the configuration of these tools but if you encounter issues with building/installing, you are on your own (sorry).
If anyone is interested in archiving paywalled content (z-an, spwn etc.), do let me know and I'll post a guide of the basics.