Hugging Face Blog·· 2023-05-23AI score34
Instruction fine-tuning Stable Diffusion with InstructPix2Pix
Instruction-tuning Stable Diffusion with InstructPix2Pix
AI briefing
This work combines the training strategy of InstructPix2Pix with the instruction template approach of FLAN V2 to instruction fine-tune Stable Diffusion, enabling it to perform image translation and low-level image processing tasks such as cartoonization and rain removal given an input image plus an instruction.
Open original huggingface.co