Skip to content
Hugging Face Blog·· 2023-05-23AI score34

Instruction fine-tuning Stable Diffusion with InstructPix2Pix

Instruction-tuning Stable Diffusion with InstructPix2Pix

AI briefing

This work combines the training strategy of InstructPix2Pix with the instruction template approach of FLAN V2 to instruction fine-tune Stable Diffusion, enabling it to perform image translation and low-level image processing tasks such as cartoonization and rain removal given an input image plus an instruction.

Open original huggingface.co