Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
-
Updated
Oct 25, 2024 - Python
Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery. Arxiv, 2024.
This repository contain a project which goal is to find new parameter efficient fine tuning framework in order to improve performance of Deep Artificial Neural Network onto "out of distribution" data (OOD). In this specific case you can find Multi-task Learning problem.
Add a description, image, and links to the task-arithmetic topic page so that developers can more easily learn about it.
To associate your repository with the task-arithmetic topic, visit your repo's landing page and select "manage topics."