Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.
-
Updated
Aug 25, 2023 - Python
#
low-rank-adaptation
Here are 27 public repositories matching this topic...
[SIGIR'24] The official implementation code of MOELoRA.
multi-task
peft
multitask-learning
mixture-of-experts
large-language-models
chatglm
low-rank-adaptation
parameter-efficient-fine-tuning
peft-fine-tuning-llm
-
Updated
Jul 22, 2024 - Python
A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
adapter
natural-language-processing
glue
llama
lora
pretrained-models
natural-language-generation
natural-language-understanding
commonsense-reasoning
soft-prompt-tuning
low-rank-adaptation
llama2-7b
parameter-efficient-fine-tuning
subject-driven-generation
llama3-8b
subspace-tuning
lora-dash
-
Updated
Sep 16, 2024 - Python
LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
-
Updated
Jul 24, 2023 - Jupyter Notebook
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
pytorch
lora
low-rank-approximation
peft
large-language-models
llm
low-rank-adaptation
finetuning-llms
galore
-
Updated
Mar 7, 2024 - Python
Easy wrapper for inserting LoRA layers in CLIP.
lora
multimodal
multimodal-deep-learning
image-text-matching
parameter-efficient-tuning
vision-language-pretraining
low-rank-adaptation
-
Updated
Jun 16, 2024 - Python
Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)
lora
fine-tuning
peft
puffin
multi-turn-dialogue
wandb
hugging-face
gpt-4
large-language-models
llm
low-rank-adaptation
parameter-efficient-fine-tuning
mistral-7b
-
Updated
Nov 23, 2023 - Jupyter Notebook
-
Updated
Sep 9, 2024 - Python
This repository contains the lab work for Coursera course on "Generative AI with Large Language Models".
reinforcement-learning
transformer
kl-divergence
proximal-policy-optimization
large-language-models
prompt-engineering
flan-t5
instruction-finetuning
low-rank-adaptation
reward-model
parameter-efficient-fine-tuning
llm-evaluation
-
Updated
Dec 1, 2023 - Jupyter Notebook
A curated list of Parameter Efficient Fine-tuning papers with a TL;DR
-
Updated
Sep 19, 2024
Advanced AI-driven tool for generating unique video game characters using Stable Diffusion, DreamBooth, and LoRa adaptations. Enhances creativity with customizable, high-quality character designs, tailored specifically for game developers and artists.
machine-learning
deep-learning
neural-network
artificial-intelligence
digital-art
image-generation
lora
game-art
video-game-development
creative-ai
ai-art
character-design
stable-diffusion
dreambooth
low-rank-adaptation
-
Updated
May 18, 2024 - Jupyter Notebook
Efficient fine-tuned large language model (LLM) for the task of sentiment analysis using the IMDB dataset.
-
Updated
Jun 3, 2024 - Python
The simplest repository & Neat implementation of different Lora methods for training/fine-tuning Transformer-based models (i.e., BERT, GPTs). [ Research purpose ]
-
Updated
Apr 2, 2024 - Jupyter Notebook
Long term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.
python
machine-learning
deep-learning
jupyter-notebook
pytorch
transformer
bitnet
pytorch-lightning
vision-transformer
large-language-models
low-rank-adaptation
flash-attention
-
Updated
Oct 15, 2024 - Python
PersonifAI is an AI-powered platform delivering personalized, multilingual educational content and real-time adaptive learning for postgraduate students.
natural-language-processing
text-to-speech
artificial-intelligence
adaptive-learning
machine-learning-models
education-technology
education-platform
personalised-learning
language-model-finetuning
huggingface-transformers
generative-ai
low-rank-adaptation
retrieval-augmented-generation
seamless-m4t
multilingual-education
4-bit-quantisation
-
Updated
Nov 10, 2024 - Jupyter Notebook
A Low-Rank Adaptation of a pretrained Stable Diffusion model that generates background scenery. Trained with PyTorch, and deployed with AWS EC2 and Ngrok.
-
Updated
Jul 3, 2024 - TypeScript
My lab work of “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.
python
machine-learning
kl-divergence
proximal-policy-optimization
llms
generative-ai
flan-t5
low-rank-adaptation
parameter-efficient-fine-tuning
peft-fine-tuning-llm
-
Updated
Jul 31, 2024 - Jupyter Notebook
Unlocking the Power of Generative AI: In-Context Learning, Instruction Fine-Tuning and Reinforcement Learning Fine-Tuning.
memory-management
bert
conda-environment
kl-divergence
encoder-decoder-model
proximal-policy-optimization
encoder-model
storage-management
megacmd
model-quantization
large-language-models
prompt-engineering
generative-ai
reinforcement-learning-from-human-feedback
flan-t5
few-shot-prompting
low-rank-adaptation
reinforcement-learning-from-ai-feedback
peft-fine-tuning-llm
instruction-fine-tuning
-
Updated
Oct 25, 2024 - Jupyter Notebook
-
Updated
Jun 19, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the low-rank-adaptation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the low-rank-adaptation topic, visit your repo's landing page and select "manage topics."