Research study for course CS421: Natural Language Processing @ UIC.
The paper analyzed can be found here, and its original repo here.
Study performed by:
In order to reproduce the study that we have performed, follow these steps:
- Create a subfolder of
source
calleddataset_image
. - Download the image data from here.
- Put all the installed images in the folder just created (i.e. in
source/dataset_image/
). - Into
run.ipynb
change the cell just under the voice Preprocessing with the path where you have stored the repo and, if you are not using Gogle Colab delete or comment the first cell. - Run all cells of file
run.ipynb
.
Thanks for the original repo from https://github.com/TIAN-viola/DynRT
Thanks for the dataset from https://github.com/headacheboy/data-of-multimodal-sarcasm-detection
Thanks for the RoBERTa model from https://huggingface.co/roberta-base/
Thanks for the TRAR from https://github.com/rentainhe/TRAR-VQA