v0.8.0

Fixes

• Fix TF versions to be updated due to TF bugs that were solved
• Fixed documentation generation

v0.7.0 - DataMapCallback

New features

• Added tavolo.learning.DataMapCallback for gathering training dynamics

Removed features

• Removed tavolo.seq2seq.MultiHeadedAttention - already implemented under tensorflow addons

v0.6.1

Changes

TF2.1 testing

v0.6.0

Changes

Major changes for interfaces, and better masking management

v0.5.1

Changes

• Remove unnecessary dropout in MultiHeadedAttention
• Change to add_weight from the deprecated add_variable

v0.5.0

Changes

• Tested on tensorflow-2.0.0
• Removed LayerNormalization
• Implementation changes to MultiHeadedAttention (previously MultiHeadedSelfAttention)
• Added tests for Python 3.8

v0.4.1

Changes

• Tested on tensorflow-2.0.0-rc0 (official on tensorflow.org at the time)
• Tensorflow installation is no longer a requirement by the package, this is to avoid installing both CPU and GPU version on the host at the same time. It is the user responsibility to install tensorflow
• seq2seq.MultiHeadedSelfAttention removed projection bias by default
• seq2seq.MultiHeadedSelfAttention has been added a projection layer after the concatenation of the head's results

v0.4.0

New Modules

• Dynamic Meta Embeddings
• Contextual Dynamic Meta Embeddings

Changes

• Better test coverage
• Fixed typing usage
• Rename LayerNorm to LayerNormalization
• PositionalEncoding now infers shapes by itself
• Tested on tensorflow-2.0.0-beta1

v0.3.0

• Added learning.LearningRateFinder
• Improved coverage for learning.CyclicLearningRateCallback
• Fixed mispelled exp_range on learning.CyclicLearningRateCallback

v0.2.1

Adjusted code to comply with the newest version of TensorFlow (2.0.0-beta0)