Joshua Kazdan

Language models are running out of high-quality training data, and even aggressively deduplicated corpora retain some amount of repetition. Earlier controlled studies predated Chinchilla-style scaling laws and could only measure the cost of repetition indirectly. We revisit repetition in the Chinchilla era, using a fitted no-repetition scaling law to report Compute-Equivalent Gain and Compute-Equivalent Loss.

TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models TrajectoryCrafter introduces a groundbreaking approach for redirecting camera movements in monocular videos through diffusion models. By separating view transformations from content generation, this technique enables precise control over camera trajectories. The dual-stream diffusion model integrates point cloud renders with source videos to ensure accurate transformations and coherent content generation.