abci

ABCI 上で実行可能なスクリプト

教師なし学習

python3 train_mt5.py --mlm file0.txt file1.txt ...

Name		Name	Last commit message	Last commit date
Latest commit History 74 Commits
data		data
LICENSE		LICENSE
README.md		README.md
abci_memo.txt		abci_memo.txt
key.tsv		key.tsv
kogi0_test.tsv		kogi0_test.tsv
kogi0_train.tsv		kogi0_train.tsv
kogi1_test.tsv		kogi1_test.tsv
kogi1_train.tsv		kogi1_train.tsv
kogi2_test.tsv		kogi2_test.tsv
kogi2_train.tsv		kogi2_train.tsv
kogi3_test.tsv		kogi3_test.tsv
kogi3_train.tsv		kogi3_train.tsv
kogi4_test.tsv		kogi4_test.tsv
kogi4_train.tsv		kogi4_train.tsv
kogi5_test.tsv		kogi5_test.tsv
kogi5_train.tsv		kogi5_train.tsv
kogi6_test.tsv		kogi6_test.tsv
kogi6_train.tsv		kogi6_train.tsv
python_corpus.zip		python_corpus.zip
pytorch_t.py		pytorch_t.py
requirements.txt		requirements.txt
run.sh		run.sh
sample.sh		sample.sh
small_test.tsv		small_test.tsv
small_train.tsv		small_train.tsv
test_mt5.py		test_mt5.py
test_token.py		test_token.py
tiny.txt		tiny.txt
train_common.py		train_common.py
train_mt5.py		train_mt5.py
train_t.py		train_t.py