Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stop explicitly generating bibliography files #3997

Open
mbollmann opened this issue Nov 3, 2024 · 0 comments
Open

Stop explicitly generating bibliography files #3997

mbollmann opened this issue Nov 3, 2024 · 0 comments
Assignees

Comments

@mbollmann
Copy link
Member

mbollmann commented Nov 3, 2024

We currently generate a BibTeX, MODS XML, and Endnote file for each paper. Currently, more than 300,000 bibliography files are being written on each build, and furthermore, the Hugo templates read each of these files again during the website generation.

I think we should do the following:

  • Change the build pipeline to write the bibliography entries into the Hugo data files.
    • Since we currently rely on bibutils, the closest functional equivalent would be to add calls to the bibutils executables within the Python library. I haven't seen any Python bindings for nor Python-native alternatives to bibutils, unfortunately. This might introduce some additional runtime overhead.
    • On the other hand, we would gain a speed-up from not having to write 300,000+ files. I suspect that this outweighs any overhead from calling bibutils from Python, but that would have to be tested.
    • Additionally, I would expect a speed-up during the Hugo generation due to Hugo not having to open and read 300,000+ extra files.
  • Add JavaScript to programmatically trigger a file download.
@mbollmann mbollmann self-assigned this Nov 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant