Skip to content
Date and source

Dates follow the news timeline in Beijing time and include both endpoints.

Oct 24Tue
Oct 2Mon
Sep 29Fri
Sep 18Mon
  1. Hugging Face Blog30

    Getting started with 3D Gaussian Splatting: principles and prospects of real-time radiance field rendering

    3D Gaussian Splatting is a rasterization technique that can learn from a small number of images and render photorealistic scenes in real time. It first uses COLMAP for Structure from Motion to estimate a point cloud, then converts each point into a Gaussian and trains it, achieving fast rendering through differentiable Gaussian rasterization. The costs are high VRAM usage (4GB for viewing, 12GB for training) and large scene files (1GB+), and it is not yet compatible with existing rendering pipelines such as Vulkan, DirectX, and WebGPU.

Aug 30Wed
Aug 9Wed
  1. Hugging Face Blog22

    How to optimize the Bark text-to-speech model with 🤗 Transformers

    Based on 🤗 Transformers, Optimum, and Accelerate, three optimizations can reduce the VRAM usage of the Bark text-to-speech model and speed up inference. Bark was proposed by Suno AI, has been supported since Transformers v4.31.0, consists of four models—semantic, coarse acoustics, fine acoustics, and EnCodec decoding—and offers small and large checkpoints.

  2. Hugging Face Blog22

    Deploying Hugging Face models with BentoML: a DeepFloyd IF hands-on guide

    This tutorial demonstrates how to deploy DeepFloyd IF as a production-grade service using the open-source model serving framework BentoML. DeepFloyd IF is an open-source text-to-image model that works directly in pixel space, consists of a frozen text encoder and three cascaded pixel diffusion modules, can progressively upscale a 64x64 px image to 1024x1024 px, and encodes prompts with T5-XXL-1.1.

Aug 4Fri
Jul 17Mon
  1. Hugging Face Blog60

    Hugging Face builds an AI WebTV video stream with Zeroscope and MusicGen

    Hugging Face released an experimental AI WebTV demo that uses the open-source text-to-video model Zeroscope and the music generation model MusicGen to automatically generate and stream short videos.

    Why it matters: It breaks down the complete pipeline for building an automatically generated video stream with Zeroscope, MusicGen, and FILM, and includes failure cases and prompt suggestions.

Jul 14Fri
Jun 15Thu
May 25Thu
  1. Hugging Face Blog22

    Optimizing Stable Diffusion for Intel CPUs with NNCF and 🤗 Optimum

    Using quantization-aware training (QAT) with OpenVINO NNCF combined with Token Merging, Stable Diffusion achieves a 5.1x inference speedup and a 4x reduction in model size on Intel CPUs. The optimization starts from a model fine-tuned on the Pokemons dataset, requires only 4096 iterations, completes within one day on a single GPU with 24GB of VRAM, and has been integrated into the Diffusers training scripts.

May 23Tue
Apr 26Wed
Mar 28Tue
Mar 24Fri
  1. Hugging Face Blog62

    Train your own ControlNet with diffusers

    Hugging Face released a tutorial explaining how to train ControlNet with diffusers, walking through a three-step process using the face pose model Uncanny Faces as an example.

    Why it matters: Using the face pose ControlNet as an example, it walks through the full process of conditioning planning, dataset construction, and the diffusers training script, and provides low-VRAM parameter configurations.

Jan 26Thu
  1. Hugging Face Blog73

    Hugging Face explains how to efficiently fine-tune Stable Diffusion with LoRA

    Hugging Face published a blog post on how to efficiently fine-tune Stable Diffusion with LoRA, and LoRA training support is now available in diffusers, covering both Dreambooth and full fine-tuning approaches.

    Why it matters: The official diffusers documentation provides LoRA fine-tuning and inference scripts and notes that weights can be reduced to about 3 MB, making it easy for creators to evaluate a low-cost customization workflow.

Jan 20Fri
  1. Hugging Face Blog22

    AI applications in game development: 3D asset generation

    Text-to-3D is not yet practically usable for game development; generated meshes require extensive manual processing to meet game-ready standards. Approaches such as DreamFusion, Point-E, and CLIP-Forge are mostly based on view synthesis or NeRF and are incompatible with the mesh pipelines that games rely on. In a 5-day farming game project, the author instead used differently colored cubes to represent crops.

Nov 7Mon
Jun 7Tue
  1. Hugging Face Blog20

    Illustrated Diffusion Models: From DDPM to a Step-by-Step PyTorch Implementation

    This Hugging Face blog post takes an in-depth look at denoising diffusion probabilistic models (DDPM), based on the 2020 paper by Ho et al., with a step-by-step PyTorch implementation whose code references Phil Wang's implementation. The article covers both the forward noising and reverse denoising processes; the DDPM authors use T=1000 time steps, encode time steps with sinusoidal positional embeddings, and use Wide ResNet blocks as the core module of the U-Net.