Skip to content

2 new embedding reduction options.
Compare
Choose a tag to compare
@dmmiller612 dmmiller612 released this 23 Dec 01:50
· 70 commits to master since this release
0.5.2
78311a9
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

In this release, two new reduce options are included: concat_last_4 and reduce_last_4. The concat_last_4 concats the last 4 BERT hidden layers and takes the mean for aggregation. The reduce last 4 option sums the last four layers and takes the mean across tokens.

Assets 2
Loading