Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implemented Mamba Model #32

Merged
merged 21 commits into from
May 1, 2024
Merged

Implemented Mamba Model #32

merged 21 commits into from
May 1, 2024

Conversation

Adibvafa
Copy link
Member

@Adibvafa Adibvafa commented Apr 30, 2024

PR Type

Feature - Mamba

Short Description

  • Implemented Mamba Pretraining and Finetuning Models
  • Developed HuggingFace functionalities for the MambaSequenceClassifierOutput, MambaClassificationHead, and MambaForSequenceClassification classes.

Tests Added

None

@Adibvafa Adibvafa requested review from mahshidaln and amrit110 and removed request for mahshidaln April 30, 2024 00:07
@Adibvafa
Copy link
Member Author

@amrit110 @mahshidaln Note this PR is not yet ready to merge. Once a successful training is done, I will fix merge conflicts with the most recent main branch and let you know the PR is ready.

@Adibvafa Adibvafa added the enhancement New feature or request label Apr 30, 2024
@Adibvafa Adibvafa self-assigned this Apr 30, 2024
@Adibvafa Adibvafa marked this pull request as draft April 30, 2024 00:08
@Adibvafa Adibvafa marked this pull request as ready for review April 30, 2024 03:57
@Adibvafa
Copy link
Member Author

Adibvafa commented May 1, 2024

@amrit110 This is ready for merge now.

@Adibvafa Adibvafa changed the title Implemented Mamba Pretraining Model Implemented Mamba Model May 1, 2024
@amrit110 amrit110 merged commit 9ae62fe into main May 1, 2024
0 of 2 checks passed
@amrit110 amrit110 deleted the feature/mamba branch May 1, 2024 18:15
@Adibvafa Adibvafa restored the feature/mamba branch May 1, 2024 18:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants