SBBP

• Some videos really should have just been blog posts, and I feel like I've just wasted time.
• Others are actually valuable, but as a parent with young kids my time is limited, and so this allows faster consumption or in settings where watching a video isn't feasible.

Task List

• Up Next

  • Get thumbnail image from video metadata
  • Summarize comments (can yt-dlp grab them?)
  • For videos with chapters, summarize each chapter
  • Allow navigating between chapters

• Soon

  • Improve reader layout
  • Video Host whitelist?
    • Might be a hassle to maintain but also potentially prevents issues with shady content

• Later

  • Host this somewhere so I can access it over the web and add to Readwise
  • Some way for multiple users to link to the same video without downloading it each time
    • Probably put the video metadata itself in a separate table and have the user's video model link to that.

• Done

  • Move processing into Rust
    • Steps
      • Download video
      • Images
        • Extract Images
        • Similar Image Algorithm
      • Transcript
        • Extract Audio
        • Transcription
        • Summary of Transcription
  • Simple auth
  • Allow storing files in cloud storage
  • Use Deepgram for transcription
  • Hosting: Store non-temporary downloaded files in Backblaze or Cloudflare object storage
  • Integrate with Filigree
  • Allow triggering video download and processing from inside the app — Nov 20th, 2023
  • Queue up multiple videos for processing — Nov 20th, 2023
  • Add "read" state and progress tracking — Nov 20th, 2023
  • Speed up SSIM process — Nov 18th, 2023
  • Generate a summary of the video — Nov 18th, 2023
  • Use structural similarity (SSIM) metric to remove duplicate screenshots — Nov 17th, 2023
  • Screenshot extraction
  • Whisper transcript generation
  • Align transcript to images and