Skip to content

Awesome Instruction Editing. Image and Media Editing with Human Instructions. Instruction-Guided Image and Media Editing.

License

Notifications You must be signed in to change notification settings

tamlhp/awesome-instruction-editing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 

Repository files navigation

Awesome Instruction Editing

A Survey of Instruction-Guided Image and Media Editing in LLM Era

Awesome GitHub stars Hits Contrib

A collection of academic articles, published methodology, and datasets on the subject of Instruction-Guided Image and Media Editing.


Existing Surveys

Paper Title Venue Year Focus
A Survey of Multimodal Composite Editing and Retrieval arXiv 2024 Media Retrieval
INFOBENCH: Evaluating Instruction Following Ability in Large Language Models arXiv 2024 Text Editing
Multimodal Image Synthesis and Editing: The Generative AI Era TPAMI 2023 X-to-Image Generation
LLM-driven Instruction Following: Progresses and Concerns EMNLP 2023 Text Editing

Approaches

Title Year Venue Editing Method Code
Guiding Instruction-based Image Editing via Multimodal Large Language Models 2024 ICLR Image Diffusion [Code]
Hive: Harnessing human feedback for instructional visual editing 2024 CVPR Image Diffusion [Code]
EffiVED:Efficient Video Editing via Text-instruction Diffusion Models 2024 arXiv Video Diffusion --
InstructPix2Pix: Learning To Follow Image Editing Instruction 2023 CVPR Image Diffusion [Code]

Datasets


Disclaimer

Feel free to contact us if you have any queries or exciting news. In addition, we welcome all researchers to contribute to this repository and further contribute to the knowledge of this field.

If you have some other related references, please feel free to create a Github issue with the paper information. We will glady update the repos according to your suggestions. (You can also create pull requests, but it might take some time for us to do the merge)

HitCount visitors