ONE Release 1.17.0

Release Note 1.17.0

ONE Compiler

Compiler Frontend

• More optimization pass
  • Remove Quant-Dequant sequence
  • Replace Sub with Add
  • Substitute StridedSlice to Reshape
  • Fuse Mean with Mean
  • Fuse Transpose with Mean
  • Substitute PadV2 to Pad
• Add new InstanceNorm pattern in FuseInstanceNormPass
• Add verbose option
• Introduce onecc driver to one-cmds
• Introduce one-profile driver to one-cmds

ONE Runtime

gpu_cl backend added

• New backend(gpu_cl) added. This backend exploits tensorflow lite's gpu delegate.
• This backend supports the following operations : Add, Convolution, Depthwise Convolution, Pooling, Reshape, Relu, Softmax

ONE Release 1.16.1

Release Note 1.16.1

ONE Compiler

Compiler Frontend

• Extends the point where one-codegen finds backends.

ONE Release 1.16.0

Release Note 1.16.0

ONE Compiler

Compiler Frontend

• Enable PadV2 in luci-interpreter and quantization
• Provide circle-tensordump, circledump as a development tool
• Provide luci-eval-driver as test tool
• Enable STRING type as constant values in CircleConst
• Fix CircleCustom may have 0 input, 0 output
• Enable debian package generation
• More optimization pass
  • Min(6)+ReLU to ReLU6
  • Remove FakeQuant Op
• Experimental support of ONNX upgraded to version 1.8.0 with additional patch
• Fix bugs where one-cmds' config file didn't evaluate boolean properly

ONE Release 1.15.0

Release Note 1.15.0

ONE Compiler

Compiler Frontend

• Support more Ops for quantization
• Fix record-minmax tool for bool type, NaN values
• Fix one-cmds test scripts
• Remove stdex module
• arser supports short option

ONE Runtime

Runtime backend supports more operations and types

• CPU backend
  • Add: int8
  • AvgPool2d: int8
  • Conv2D: int8
  • DepthwiseConv2D: int8
  • Div: uint8
  • Elu: float
  • ExpandDims: int8
  • LogicalAnd: boolean
  • Maximum: uint8
  • MaxPool2D: int8
  • Minimum: uint8
  • Mul: int8
  • Pad: int8
  • PadV2: int8
  • Quantize: uint8, int8
  • Reshape: int8
  • Resizebiliear: int8
  • Softmax: int8
  • Squeeze: int8
  • Sub: int8

ARM Compute Library Update

• ONERT uses Compute Library v21.02

ONE Release 1.14.0

Release Note 1.14.0

ONE Compiler

Compiler Frontend

• one-codegen interface now distinguishes own arguments from backend's.
• Adds RemoveUnnecessaryStridedSlice optimization pass.
• Introduces experimental support for generating profile data.
  • Adds --generate_profile_data option to one-optimize, one-quantize.

ONE Release 1.13.0

Release Note 1.13.0

ONE Compiler

Compiler Frontend

• Add optimization pass: ConvertNCHWToNHWC, FoldSparseToDensePass, FuseBatchNormWithConvPass, ForwardReshapeToUnaryOpPass, RemoveUnnecessarySlicePass, RemoveUnnecessarySplitPass, RemoveUnnecessaryReshapePass, RemoveRedundantReshape, SubstituteTransposeToReshapePass, SubstituteSqueezeToReshapePass,
• Support more operators: FAKE_QUANT
• Enhancements: Support auto generated random input for record-minmax (for better quantization testing)
• Changes: --all option to --O1 in circle2circle(and one-optimize)
• Fixes: tf2tfliteV2 accept input shapes --v2 option, lots of fixes for increase test coverage
• Experimental: Compile ONNX models to circle

ONE Release 1.12.1

Release Note 1.12.1

ONE Compiler

Changes

• Fix minor bug of one-build.

ONE Release 1.12.0

Release Note 1.12.0

ONE Compiler

Compiler Frontend

• Add optimization pass: ReplaceMulAddWithDepthwiseConvPass, SubstitutePackToReshape, RemoveRedundantTranspose, ShuffleWeightTo16x1Float32Pass
• Add quantization for InstanceNorm.
• Fix bug of one-import-bcq command for --v1, --v2 arguments.
• Fix FuseBCQPass to work with inter-subgraphs in the model file and minor BCQ related optimizations.

ONE Runtime

Runtime backend operation supports more operations and types

• CPU backend
  • Concat: int8
  • DepthToSpace: float, uint8, int8
  • LeakyRelu: float
• ACL-CL backend
  • ArgMin: float, uint8, int8
• ACL-NEON backend
  • ArgMax: int8
  • ArgMin: float, uint8, int8

nnpackage defines configuration file

• Allow users to set configuration variable via conf file. For more information, See nnpackage spec

ONE Release 1.11.1

Release Note 1.11.1

ONE Runtime

Hot Fixes

• Fix segfault due to the wrong BCQGather DynamicShapeInferer's behavior

ONE Release 1.11.0

Release Note 1.11.0

ONE Compiler

Compiler supports more operations

• MaxPoolWithArgMax by CustomOp

Changes

• one-build command added as representative command
• one-cmds are now revised to python script and supports configuration file as input parameters
• added rawdata2hdf5 tool to help creating input datasets for calibration
• added more optimization passes in one-optimize; fuse_preactivation_batchnorm, make_batchnorm_gamma_positive and fuse_activation_function

ONE Runtime

Runtime backend operation supports more operations and types

• CPU backend
  • float: AddN, Floor, UniDirectionalSequenceLSTM
  • uint8: Dequantize, Rank
  • int8: Dequantize, Rank, Shape