Code

Implemented EHRMamba#50

Code

Merged

amrit110 merged 23 commits intomainVectorInstitute/odyssey:mainfrom feature/mambaVectorInstitute/odyssey:feature/mambaCopy head branch name to clipboardMay 30, 2024

+1,572-1,226

Commits

Commits on May 11, 2024

• Implemented data splits that minimize pretrain-finetune overlap and maximize intra-finetune task overlaps.

  Adibvafa

  committed
  59980a3

  Copy full SHA for 59980a3

Commits on May 27, 2024

• Separated multibird option from bigbird option.

  Adibvafa

  committed
  a0129c6

  Copy full SHA for a0129c6

• Updated data processing pipeline for new data splits.

  Adibvafa

  committed
  3aa551b

  Copy full SHA for 3aa551b

• Added task2index dict and increased decoder dataset functionality to accept single or multihead.

  Adibvafa

  committed
  a2c84a7

  Copy full SHA for a2c84a7

• Updated baseline models to use new data splits.

  Adibvafa

  committed
  2777af8

  Copy full SHA for 2777af8

• Updated config files for more efficient training.

  Adibvafa

  committed
  e7d87a6

  Copy full SHA for e7d87a6

• Implemented multihead Mamba.

  Adibvafa

  committed
  cabd47c

  Copy full SHA for cabd47c

• Updated bigbird model to use autocast.

  Adibvafa

  committed
  c2f99d6

  Copy full SHA for c2f99d6

• Added functionalities to evaluate models using standard metrics and get predictions for a wide range of models.

  Adibvafa

  committed
  81b264e

  Copy full SHA for 81b264e

• New updates to playground notebook for Mamba.

  Adibvafa

  committed
  69ad1f4

  Copy full SHA for 69ad1f4

Commits on May 30, 2024

• Removed TestAnalysis.ipynb from Git.

  Adibvafa

  committed
  50d5948

  Copy full SHA for 50d5948

• Added config option to use MultiHead or not for MambaForSequenceClassification.

  Adibvafa

  committed
  e77b76d

  Copy full SHA for e77b76d

• Added EHR forecasting capabilities to prediction.py

  Adibvafa

  committed
  5ab9d5d

  Copy full SHA for 5ab9d5d

• Updated mamba_utils.py to have single head and multi head classifiers.

  Adibvafa

  committed
  4c60cae

  Copy full SHA for 4c60cae

• Fixed merge conflicts.

  Adibvafa

  committed
  41a1968

  Copy full SHA for 41a1968

• [pre-commit.ci] Add auto fixes from pre-commit.com hooks

  Show description for 0c8bdd7
  pre-commit-ci[bot]

  committed
  0c8bdd7

  Copy full SHA for 0c8bdd7

• Removed TestAnalysis.ipynb from Git.

  Adibvafa

  committed
  b373f29

  Copy full SHA for b373f29

• Minor style improvements.

  Adibvafa

  committed
  273b640

  Copy full SHA for 273b640

• Removed mamba-dev.ipynb from Git.

  Adibvafa

  committed
  dfde0cb

  Copy full SHA for dfde0cb

• Removed playground for mamba development from Git.

  Adibvafa

  committed
  2fb224c

  Copy full SHA for 2fb224c

• Removed playground notebooks from BigBird development.

  Adibvafa

  committed
  4894981

  Copy full SHA for 4894981

• Rename cehr_mamba to ehr_mamba

  Adibvafa

  committed
  807d99a

  Copy full SHA for 807d99a

• Renamed cehr_mamba to ehr_mamba.

  Adibvafa

  committed
  30623ec

  Copy full SHA for 30623ec