Automating Video – ITP Winter Show 2017 /shows/winter2017/ Fri, 22 Dec 2017 17:19:51 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 Scenescoop /shows/winter2017/scenescoop/ Fri, 15 Dec 2017 17:52:25 +0000 https://itp.nyu.edu/shows/winter2017/scenescoop/ Continue reading "Scenescoop"

]]> Cristobal Valenzuela

A tool to get similar semantic scenes from a pair of videos.

https://github.com/cvalenzuela/scenescoop

Main Project Image

Description

Scenescoop is a tool to get similar semantic scenes from a pair of videos. Basically, you input a video and get a scene that has a similar meaning in another video. Scenescoop uses the im2text tensorflow model on a frame by frame basis over the input and transfer video. It then uses Spacy to average the word vectors in a sentence and Annoy to create an index for fast nearest-neighbor lookup.

Classes

Automating Video

]]>