FILM: Frame Interpolation for Large Motion
source link: https://film-net.github.io/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Abstract
We present a frame interpolation algorithm that synthesizes multiple intermediate frames from two input images with large in-between motion. Recent methods use multiple networks to estimate optical flow or depth and a separate network dedicated to frame synthesis. This is often complex and requires scarce optical flow or depth ground-truth. In this work, we present a single unified network, distinguished by a multi-scale feature extractor that shares weights at all scales, and is trainable from frames alone. To synthesize crisp and pleasing frames, we propose to optimize our network with the Gram matrix loss that measures the correlation difference between feature maps. Our approach outperforms state-of-the-art methods on the Xiph large motion benchmark. We also achieve higher scores on Vimeo-90K, Middlebury and UCF101, when comparing to methods that use perceptual losses. We study the effect of weight sharing and of training with datasets of increasing motion range. Finally, we demonstrate our model's effectiveness in synthesizing high quality and temporally coherent videos on a challenging near-duplicate photos dataset.
Recommend
-
21
之前写了一片剖析纹理映射的文章,里面简单的介绍了一下纹理映射中常用的仿射插值(Affine),处理一些特殊情况下的投影插值(Projective),作为抛砖引玉的见解之文,收到了不少好评,谢谢大家的
-
52
Kotlin’s string interpolation is an amazing feature. Combined with autocompletion support by the Intellij IDE, writing interpolated strings is as easy as writing string literals. When experimenting…
-
80
README.md Adversarially Constrained Autoencoder Interpolations (ACAI) Code for the paper "Understanding and I...
-
36
熟悉GLES的同学都属性纹理映射的规则,可能也都遇到过一些纹理映射中的小问题,今天就简单的说一下Projective Texture Mapping(投影映射纹理,有人翻译为透视映射纹理,不要在意这些细节,本文按照 投影映射纹理...
-
32
README.md Chalk Terminal colors using Swift 5’s string interpolation extensions. print("Hi my name is
-
53
Understanding Angular’s data binding types is important when building Angular applications. Learn about property binding and interpolation so you can understand which method best suits the task at hand. When buil...
-
63
Introduction String interpolation allows the creation of string literals with interpolation expressions. The syntax is convenient for formatting strings and is generally more readable than composite formatting...
-
13
FILM: Frame Interpolation for Large Scene Motion Project | Paper | YouTube |
-
4
Film is nuanced. So is Filmbox.The look and feel of motion picture film defines a century of art.As we move beyond photochemical imaging, we need not leave behind its aesthetic quality....
-
2
AMD previews FSR 3 with frame interpolation, an Nvidia DLSS 3 frame generation rival...
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK