Synopsis Public Beta 2 is available. Want to know more? - join our slack channel

Synopsis Inspector - Frequently asked Questions:

The description of my media is wrong

Sorry about that! Synopsis Analyzer tries to predict (a fancy way of using statistics to guess) the right descriptions of your media. If we've gotten something wrong, please report a bug, and if possible, share the media file with us so we can teach the analyzer to be better! Analyzer learns by examples, and the more examples the better it will get. If you want to help make Analyzer and Inspector the even better, sign up for crowd labelling to seriously help us out!

Inspector doesn’t show my media. Why?

Synopsis Inspector only loads media that has been analyzed by Synopsis Analyzer or other supported tools that output compatible files. Please analyze your media and store it on a volume that supports extended attributes - and Synopsis Inspector will automatically discover it and load it.

If you are curious to try out Inspector without analyzing your media, you can download some sample media that has been 'pre-analyzed'.

What do the various sort buttons do in the Inspector toolbar?

When selecting a single piece of content in Inspector main panel (the reference clip), one can sort all loaded media by how similar they are to your reference clip.

There are a few ways the decide how things are similar - does it have similar colors, does it describe the same scene, is the image layed out similarly, etc. Each sorting button provides similar funcionality:

Histogram Similarity orders clips based on a histogram similarity metric. This more or less results in sorting based on color and over all brightness / expsoure of the scene.

Prediction Similarity orders clips based on the similarity of confidence values (how likely each concept is present in the video) for all of the CinemaNet concepts. You can think of this as shot similarity. Is the shot location, framing, subject matter, etc similar? The default metric is cosine similarity.

Embedding Similarity orders clips based on a (not human interpretable) 'embedding vector' which can be thought of as a by product of computing the prediction above. The embedding vector is loosely equivalent to spatial similarity - ie, the over all shape, color, contrast, texture of the scene. Embedding similarity is roughly equivalent to a 'structure' similarity. The default metric is cosine similarity.

All uses the above 3 similarity scores together and gives a hybrid similarity score which clips are ordered by. Its a touch more expensive (slower) but results in generally a more pleasing and expected ordering.

Where is the metadata stored?

By Default Synopsis Analyzer encodes metadata directly into the output Quicktime container file. There are no side car files unless you optionally specify them by choosing an appropriate preset in Synopsis Analyzer.