Replicate Intelligence #11: Fine-tune FLUX.1, Tavus digital twins, and new AI video and 3D tools
Replicate now lets users fine-tune the FLUX.1 image model with custom images, while its latest weekly bulletin also covers Tavus’s real-time conversational video API, Sketch2Scene’s sketch-to-3D-game pipeline, and Puppet-Master’s object controls for Stable Video Diffusion.
Replicate’s weekly bulletin details several new AI capabilities. Users can now fine-tune FLUX.1 with 12–20 images to create custom styles or subjects in about 30 minutes. Tavus launched a Conversational Video Interface, a real-time “digital twin” API built on Replicate for video chat with sub-one-second latency. The research project Sketch2Scene converts crude drawings into fully playable 3D game worlds, and Puppet-Master adds drag-token controls to Stable Video Diffusion for manipulating objects in generated videos. The post also references a 2022 talk by Replicate’s Mattt on AR, VR, and AI agents. Source: Replicate Blog.
The Wire · Newsletter
One careful email,
every Monday.
The week's most important AI stories, lightly edited and personally vouched for. No autoplay, no spam, easy to leave.
Comments · 0
Sign in to join the discussion.
Be the first to leave a thought.