Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

inference_raw.json for BIP-ALM test evaluation in reproducing #4

Open
chunhuizng opened this issue Jun 19, 2024 · 2 comments
Open

Comments

@chunhuizng
Copy link

Hi Chuanyang,

Could you release the inference_raw.json file used in text_parsing.py for test evaluation?

To reproduce the _BIP-ALM_method test, we need the multimodal_representations.json file. However, generating this file requires running text_parsing.py with inference_raw.json, which is not currently available in the repo (and also lacks instructions on how to create it).

If the inference_raw.json file can be released (or, more straightforwardly, if the final evaluation test data multimodal_representations.json for BIP-ALM can be released), it will enable successfully reproducing the test evaluation of the proposed BIP-ALM method. This would help to enhance the impact and reproducibility of this smart paper within the community.

Thank you very much!

@chuanyangjin
Copy link
Owner

We have released the requested files. You can now find them in the folder "files" for use in reproducing our results. Thank you for bringing this to our attention!

@chunhuizng
Copy link
Author

We have released the requested files. You can now find them in the folder "files" for use in reproducing our results. Thank you for bringing this to our attention!

Thank you very much, Chuanyang! They are super helpful.

I would also like to share some additional .json files used in the middle process: Google Drive folder in case anyone wants to use them.

@chunhuizng chunhuizng changed the title lack of inference_raw.json for BIP-ALM test evaluation in reproducing inference_raw.json for BIP-ALM test evaluation in reproducing Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants