fakeonion

An interactive Onion Headline generator using DistilGPT2 and Streamlit.

Creating the Environment

Automatic ENV Setup

I strongly recommend using the fakeonion.yml to build the environment.

conda env create -n fakeonion -f fakeonion.yml

Manual ENV Setup

If you prefer to do it manually, beware of protobuf issues.

conda create -n fakeonion pytorch=1.9 cudatoolkit=11.1 streamlit=0.89.0 fuzzywuzzy=0.18.0 transformers=4.11 -y
conda activate fakeonion
python -m pip install --upgrade protobuf

Versions are required here because conda cannot seem to solve the environment without them. After initial install of protobuf via conda, running streamlit results in a AttributeError: module 'google.protobuf.descriptor' has no attribute '_internal_create_key'. You must upgrade protobuf from pip to get rid of the error. I do not fully understand why there is a versioning issue with conda-forge that breaks streamlit, but it is a known issue, so there's hope it will be solved soon. Do NOT allow later packages to install protobuf from conda-forge. This will break your Streamlit app.

Standing Up the App

conda activate fakeonion
streamlit run app.py

What's left to do?

• Add code to fine-tune the distilGPT2 model, or add a download link for the fine-tuned models I've already created.
• Update the app to only use models that exist in the model repo
• Some tests to make sure everything is working
• Figure out what's up with protobuf???
• Fix the blank-seed bug that produces empty output on an empty string of text. It can generate from blank seeds just fine. Probably needs ~ 800 token candidates for the first three words or so.
• Find a good annealing rule for generating text.