Skip to content

Creative Directions

Image Generation Latest

The front line of AI image generation: text-to-image model iterations, image editing capabilities, and applications in storyboarding, posters, and asset creation.

114 picksLast 30 days 43 itemsCollected 1,145 items

updated

Pick archive · page 6

Feb 3Sat101–114
  1. Hugging Face Blog62

    SegMoE Released: Building Mixture-of-Experts Diffusion Models from Scratch

    Segmind releases the SegMoE framework, which can create Mixture-of-Experts (MoE) diffusion models from scratch and has been integrated into Hugging Face diffusers. This release includes three model versions—SegMoE-4x2, SegMoE-2x1, and SegMoE-SD4x2—along with the segmoe code package for building custom MoE models. The models are licensed under Apache 2.0.

    Why it matters: The release provides code for building MoE diffusion models from scratch along with three merged versions, enabling creators to combine multiple pretrained models into new ones.

Jan 2Tue
  1. Hugging Face Blog62

    Hugging Face Releases Advanced Training Script for SDXL Dreambooth LoRA

    Hugging Face releases an advanced training script for SDXL Dreambooth LoRA, integrating Pivotal Tuning and the Prodigy optimizer into diffusers, along with reusable training parameters.

    Why it matters: Hugging Face officially integrates Pivotal Tuning and the Prodigy optimizer into diffusers training scripts, providing directly reusable parameters and experimental comparisons.

Nov 9Thu
  1. Hugging Face Blog78

    Using Latent Consistency LoRA to Generate SDXL Images in 4 Steps

    Hugging Face releases the LCM LoRA method, which trains a small number of LoRA adapter layers instead of distilling the entire model, reducing image generation for SDXL and Stable Diffusion from 25 to 50 steps down to 4 to 8 steps.

    Why it matters: LCM LoRA enables SDXL to generate images in 4 steps. The article provides directly runnable diffusers code and speed comparisons across multiple hardware configurations.

Oct 19Thu
  1. OpenAI News62

    DALL·E 3 Launches on ChatGPT Plus and Enterprise

    OpenAI announced that DALL·E 3 is now available in ChatGPT Plus and Enterprise. To prepare for a broader release, OpenAI developed a set of safety mitigations and also shared its progress on content provenance research.

    Why it matters: DALL·E 3 is open to ChatGPT Plus and Enterprise, and the official announcement also explains the safety mitigations made for the expanded release.

Sep 13Wed
  1. Hugging Face Blog60

    Hugging Face releases Würstchen: a fast image diffusion model with a highly compressed latent space

    Hugging Face released the Würstchen image generation diffusion model, whose text-conditioning part works in a highly compressed latent space, achieving 42x spatial compression through Stage A's VQGAN and Stage B's Diffusion Autoencoder, with Stage C trained as a Prior in that latent space.

    Why it matters: Würstchen uses 42x spatial compression to cut training cost to about one-sixth of SD1.4, which can be used to evaluate low-VRAM image generation options.

Sep 8Fri
  1. Hugging Face Blog62

    Hugging Face brings T2I-Adapter controllable generation support to SDXL

    The Hugging Face Diffusers team, in collaboration with the T2I-Adapter authors, provides T2I-Adapter support for Stable Diffusion XL and releases checkpoints for conditions such as sketch, canny, lineart, depth, and openpose.

    Why it matters: Comparing ControlNet's parameter count and inference overhead, it presents a T2I-Adapter controllable generation solution on SDXL and reusable training scripts.

Jul 27Thu
  1. Hugging Face Blog62

    Apple and Hugging Face run Stable Diffusion XL on Mac with Core ML mixed-bit quantization

    Apple and Hugging Face have ported the Stable Diffusion XL base model to Core ML, usable on Apple Silicon Macs running the macOS 14 public beta; it currently uses the ORIGINAL attention implementation, and the refiner stage has not yet been ported.

    Why it matters: Apple and Hugging Face jointly present a Core ML mixed-bit quantization solution for SDXL on Mac, with measured latency for various models and compression recipes.

Mar 24Fri
  1. Hugging Face Blog62

    Train your own ControlNet with diffusers

    Hugging Face released a tutorial explaining how to train ControlNet with diffusers, walking through a three-step process using the face pose model Uncanny Faces as an example.

    Why it matters: Using the face pose ControlNet as an example, it walks through the full process of conditioning planning, dataset construction, and the diffusers training script, and provides low-VRAM parameter configurations.

Mar 3Fri
  1. Hugging Face Blog62

    Diffusers integrates ControlNet: a tutorial on using StableDiffusionControlNetPipeline

    Hugging Face integrated ControlNet into Diffusers and introduced StableDiffusionControlNetPipeline, which can control Stable Diffusion generation using spatial conditions such as depth maps, segmentation maps, scribbles, and keypoints.

    Why it matters: The official Diffusers documentation provides the complete way to integrate ControlNet, including reusable code for Canny, OpenPose, and multi-condition combinations.

Jan 26Thu
  1. Hugging Face Blog73

    Hugging Face explains how to efficiently fine-tune Stable Diffusion with LoRA

    Hugging Face published a blog post on how to efficiently fine-tune Stable Diffusion with LoRA, and LoRA training support is now available in diffusers, covering both Dreambooth and full fine-tuning approaches.

    Why it matters: The official diffusers documentation provides LoRA fine-tuning and inference scripts and notes that weights can be reduced to about 3 MB, making it easy for creators to evaluate a low-cost customization workflow.

Dec 1Thu
  1. Hugging Face Blog62

    How to run Stable Diffusion with Core ML on Apple Silicon

    Apple engineers provided conversion scripts and inference code, and Hugging Face has converted the weights of Stable Diffusion v1.4, v1.5, v2 base, and v2.1 base into Core ML versions and published them on the Hugging Face Hub.

    Why it matters: Apple engineers and Hugging Face converted Stable Diffusion weights to Core ML and provided two inference paths, in Python and Swift, for generating images locally on Apple Silicon.

Aug 22Mon
  1. Hugging Face Blog62

    Hugging Face Explains How to Run Stable Diffusion with Diffusers

    Hugging Face releases a tutorial explaining how to run the Stable Diffusion text-to-image model with the Diffusers library and breaking down how it works.

    Why it matters: Hugging Face officially breaks down how Stable Diffusion is invoked in Diffusers and the principles of Latent Diffusion's three components, making the image generation process easier to understand.

Jul 20Wed
  1. OpenAI News62

    OpenAI Opens DALL·E Beta, Inviting 1 Million Waitlist Users

    OpenAI announces that DALL·E has entered beta and will invite 1 million people from the waitlist over the coming weeks. Users can generate images with free credits that reset monthly, or purchase additional credits at $15 for 115 generations.

    Why it matters: DALL·E moves from waitlist to million-scale access, with free credits and paid add-ons, offering a way to gauge the accessibility threshold of early image generation tools.

May 18Wed
  1. OpenAI News60

    OpenAI Updates DALL·E 2 Research Preview: Up to 1,000 New Users from the Waitlist Each Week

    OpenAI updates progress on the DALL·E 2 research preview: early users have generated over 3 million images to date and have helped improve safety processes. OpenAI says it will begin adding up to 1,000 new users from the waitlist each week.

    Why it matters: Progress on user scale and safety processes during the DALL·E 2 research preview phase, offering insight into its early rollout pace.