|
<!DOCTYPE html> |
|
<html> |
|
<head> |
|
<meta charset="utf-8"> |
|
<meta name="description" |
|
content="WOPR: Word Predictor. Memory-based language modeling"> |
|
<meta name="keywords" content="word prediction, wopr, memory-based learning, timbl, memory-based language modeling"> |
|
<meta name="viewport" content="width=device-width, initial-scale=1"> |
|
<title>WOPR: Memory-based language modeling</title> |
|
|
|
<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro" |
|
rel="stylesheet"> |
|
|
|
<link rel="stylesheet" href="./static/css/bulma.min.css"> |
|
<link rel="stylesheet" href="./static/css/bulma-carousel.min.css"> |
|
<link rel="stylesheet" href="./static/css/bulma-slider.min.css"> |
|
<link rel="stylesheet" href="./static/css/fontawesome.all.min.css"> |
|
<link rel="stylesheet" |
|
href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css"> |
|
<link rel="stylesheet" href="./static/css/index.css"> |
|
<link rel="icon" href="./static/images/favicon.svg"> |
|
|
|
|
|
<script defer src="./static/js/fontawesome.all.min.js"></script> |
|
<script src="./static/js/bulma-carousel.min.js"></script> |
|
<script src="./static/js/bulma-slider.min.js"></script> |
|
<script src="./static/js/index.js"></script> |
|
</head> |
|
<body> |
|
|
|
<section class="hero"> |
|
<div class="hero-body"> |
|
<div class="container is-max-desktop"> |
|
<div class="columns is-centered"> |
|
<div class="column has-text-centered"> |
|
<h1 class="title is-1 publication-title">WOPR: Memory-based language modeling</h1> |
|
<div class="is-size-5 publication-authors"> |
|
<span class="author-block"> |
|
<a href="https://antalvandenbosch.nl/" target="_blank">Antal van den Bosch</a><sup>1</sup>,</span> |
|
<span class="author-block"> |
|
<a href="https://www.humlab.lu.se/person/PeterBerck/" target="_blank">Peter Berck</a><sup>2</sup>,</span> |
|
</div> |
|
|
|
<div class="is-size-5 publication-authors"> |
|
<span class="author-block"><sup>1</sup>Utrecht University</span> |
|
<span class="author-block"><sup>2</sup>University of Lund</span> |
|
</div> |
|
|
|
<div class="column has-text-centered"> |
|
<div class="publication-links"> |
|
|
|
|
|
<span class="link-block"> |
|
<a href="https://berck.se/thesis.pdf" target="_blank" |
|
class="external-link button is-normal is-rounded is-dark"> |
|
<span class="icon"> |
|
<i class="fas fa-file-pdf"></i> |
|
</span> |
|
<span>Thesis</span> |
|
</a> |
|
</span> |
|
|
|
|
|
<span class="link-block"> |
|
<a href="http://ufal.mff.cuni.cz/pbml/91/art-bosch.pdf" target="_blank" |
|
class="external-link button is-normal is-rounded is-dark"> |
|
<span class="icon"> |
|
<i class="fas fa-file-pdf"></i> |
|
</span> |
|
<span>Paper</span> |
|
</a> |
|
</span> |
|
|
|
|
|
<span class="link-block"> |
|
<a href="https://github.com/LanguageMachines/wopr" target="_blank" |
|
class="external-link button is-normal is-rounded is-dark"> |
|
<span class="icon"> |
|
<i class="fab fa-github"></i> |
|
</span> |
|
<span>Code</span> |
|
</a> |
|
|
|
</div> |
|
|
|
</div> |
|
</div> |
|
</div> |
|
</div> |
|
</div> |
|
</section> |
|
|
|
|
|
|
|
<section class="section"> |
|
<div class="container is-max-desktop"> |
|
|
|
<div class="columns is-centered has-text-centered"> |
|
<div class="column is-four-fifths"> |
|
<h2 class="title is-3">Abstract</h2> |
|
<div class="content has-text-justified"> |
|
<p> |
|
We present the first method capable of photorealistically reconstructing a non-rigidly |
|
deforming scene using photos/videos captured casually from mobile phones. |
|
</p> |
|
<p> |
|
Our approach augments neural radiance fields |
|
(NeRF) by optimizing an |
|
additional continuous volumetric deformation field that warps each observed point into a |
|
canonical 5D NeRF. |
|
We observe that these NeRF-like deformation fields are prone to local minima, and |
|
propose a coarse-to-fine optimization method for coordinate-based models that allows for |
|
more robust optimization. |
|
By adapting principles from geometry processing and physical simulation to NeRF-like |
|
models, we propose an elastic regularization of the deformation field that further |
|
improves robustness. |
|
</p> |
|
<p> |
|
We show that <span class="dnerf">Nerfies</span> can turn casually captured selfie |
|
photos/videos into deformable NeRF |
|
models that allow for photorealistic renderings of the subject from arbitrary |
|
viewpoints, which we dub <i>"nerfies"</i>. We evaluate our method by collecting data |
|
using a |
|
rig with two mobile phones that take time-synchronized photos, yielding train/validation |
|
images of the same pose at different viewpoints. We show that our method faithfully |
|
reconstructs non-rigidly deforming scenes and reproduces unseen views with high |
|
fidelity. |
|
</p> |
|
</div> |
|
</div> |
|
</div> |
|
|
|
|
|
</div> |
|
</section> |
|
|
|
|
|
|
|
|
|
<section class="section" id="BibTeX"> |
|
<div class="container is-max-desktop content"> |
|
<h2 class="title">BibTeX</h2> |
|
<pre><code>@article{VandenBosch+09, |
|
author = {A. {Van den Bosch} and P. Berck}, |
|
journal = {The Prague Bulletin of Mathematical Linguistics}, |
|
pages = {17--26}, |
|
title = {Memory-based machine translation and language modeling}, |
|
volume = {91}, |
|
year = {2009}, |
|
bdsk-url-1 = {http://ufal.mff.cuni.cz/pbml/91/art-bosch.pdf}} |
|
}</code></pre> |
|
</div> |
|
</section> |
|
|
|
|
|
<footer class="footer"> |
|
<div class="container"> |
|
<div class="content has-text-centered"> |
|
<a class="icon-link" href="https://github.com/LanguageMachines/wopr" target="_blank" class="external-link" disabled> |
|
<i class="fab fa-github"></i> |
|
</a> |
|
</div> |
|
<div class="columns is-centered"> |
|
<div class="column is-8"> |
|
<div class="content"> |
|
<p> |
|
This website is licensed under a <a rel="license" target="_blank" |
|
href="http://creativecommons.org/licenses/by-sa/4.0/">Creative |
|
Commons Attribution-ShareAlike 4.0 International License</a>. |
|
</p> |
|
<p> |
|
This websites gladly made use of the <a target="_blank" |
|
href="https://github.com/nerfies/nerfies.github.io">source code</a> of the Nerfies website. Thanks! |
|
</p> |
|
</div> |
|
</div> |
|
</div> |
|
</div> |
|
</footer> |
|
|
|
</body> |
|
</html> |
|
|
