Ask HN: Any tools to search video based on audio?

by muxneo on 6/12/2022, 1:09:22 AM with 12 comments
Hello,

I am wondering if there is any tool (good to have opensource) which lets you search an audio+video file based on the audio. Basically enter a search string containing text and the result is the video player showing the video frame containing the audio in which this text exist

  • by PainfullyNormal on 6/12/2022, 2:02:52 AM

    Have you seen this post on videogrep? https://news.ycombinator.com/item?id=31483548

  • by kingkool68 on 6/12/2022, 1:34:45 AM

    There's https://filmot.com/ which searches/indexes on YouTube captions and will take you right to the point in the video that matches your search.

  • by 0des on 6/12/2022, 3:22:37 AM

    If I didn't have showdead, I'd have no idea about videogrep or PainfullyNormal's comment (which I cannot vouch for to comment in thanks, or upvote, its just [dead])

    Admins - Get rid of whatever behavior gets random people on blocklists, or at least make it finite in duration. I was told by Dan to stop mentioning this when I see it (which is unethical in my opinion), but its just sad how often it happens now. Even an asshole is right sometimes (not saying this guys an asshole).

  • by mrkramer on 6/12/2022, 11:21:36 AM

    I had an idea to create commercial service for this; but I'm afraid it would cost me too much to transcribe videos. Short videos are not costly to transcribe but hours long videos are. At the end of the day I might do it because Moore's law is our friend and it should get cheaper and cheaper over the years.

  • by bryanrasmussen on 6/12/2022, 1:29:26 AM

    asr (automatic speech recognition) https://github.com/topics/asr-model

  • by The_Amp_Walrus on 6/12/2022, 4:30:05 AM

    Descript maybe

  • by 0des on 6/12/2022, 3:19:24 AM

    didn't echonest used to do this?