merge rc131-mb-1 into master branch

F5Networks · Aug 22, 2022 · 6ae935c · 6ae935c
1 parent fd87507
commit 6ae935c
Show file tree

Hide file tree

Showing 68 changed files with 26,084 additions and 3,622 deletions.
diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml
@@ -161,7 +161,7 @@ lint:
 test_node4:
     extends:
         - .run_unittest
-    image: ${ARTIFACTORY_DOCKER_HUB}/node:4
+    image: ${ARTIFACTORY_DOCKER_HUB}/node:4.8.0
 
 # just in case, unittests only (without coverage check)
 test_node6:
@@ -229,6 +229,7 @@ npm_audit:
 
 # run tests and check code coverage
 coverage:
+    image: ${ARTIFACTORY_DOCKER_HUB}/node:8.11.1
     extends:
         - .test_job_definition
     script:

diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -1,6 +1,27 @@
 # Changelog
 Changes to this project are documented in this file. More detail and links can be found in the Telemetry Streaming [Document Revision History](https://clouddocs.f5.com/products/extensions/f5-telemetry-streaming/latest/revision-history.html).
 
+## 1.31.0
+### Added
+- TS-676: Add gRPC exporter to OpenTelemetry_Exporter (experimental feature)
+- TS-678: Add new performance stats - 'system.connectionsPerformance'
+- TS-681: Generic_HTTP consumer should allow to tune transport options (experimental feature)
+- TS-682: Add 'compressionType' option to Generic_HTTP consumer
+- TS-684: DataDog consumer should support proxy configuration
+- TS-686: DataDog consumer should split huge payload into smaller chunks according to API docs
+- TS-688: DataDog consumer should allow to tune transport options (experimental feature)
+- TS-690: Add OpenTelemetry_Exporter raw JSON output
+- TS-693: Add secure connection settings to OpenTelemetry_Exporter (experimental feature)
+### Fixed
+- TS-687: DataDog consumer should send correct timestamp value
+- TS-670: [GitHub #209](https://github.com/F5Networks/f5-telemetry-streaming/issues/209) OpenTelemetry_Exporter should set correct 'timestamp'
+### Changed
+- TS-669: OpenTelemetry updated to version 0.31.0
+- TS-672: Update npm packages (@grpc/proto-loader from 0.6.12 to 0.7.0, eventemitter2 from 6.4.5 to 6.4.7)
+- TS-680: 'system.throughputPerformance' in System Poller's default output should match output example in "examples" directory
+- TS-685: DataDog consumer should use API v2 for to send data
+### Removed
+
 ## 1.30.0
 ### Added
 ### Fixed

diff --git a/SUPPORT.md b/SUPPORT.md
@@ -17,9 +17,10 @@ Currently supported versions:
 
 | Software Version | Release Type  | First Customer Ship | End of Support  |
 |------------------|---------------|---------------------|-----------------|
-| TS 1.28.0        | Feature       |  19-Apr-2022        | 19-Jul-2022     |
+| TS 1.27.1        | LTS           |  19-Apr-2022        | 19-Apr-2023     |
 | TS 1.29.0        | Feature       |  31-May-2022        | 31-Aug-2022     |
 | TS 1.30.0        | Feature       |  15-Jul-2022        | 15-Oct-2022     |
+| TS 1.31.0        | Feature       |  23-Aug-2022        | 23-Nov-2022     |
 
 Versions no longer supported:
 
@@ -53,6 +54,6 @@ Versions no longer supported:
 | TS 1.25.0        | Feature       |  14-Dec-2021        | 14-Mar-2022     |
 | TS 1.26.0        | Feature       |  25-Jan-2022        | 25-Apr-2022     |
 | TS 1.27.0        | Feature       |  08-Mar-2022        | 08-Jun-2022     |
-| TS 1.27.1        | LTS           |  19-Apr-2022        | 19-Apr-2023     |
+| TS 1.28.0        | Feature       |  19-Apr-2022        | 19-Jul-2022     |
 
 See the [Release notes](https://github.com/F5Networks/f5-telemetry-streaming/releases) and [Telemetry Streaming documentation](https://clouddocs.f5.com/products/extensions/f5-telemetry-streaming/latest/revision-history.html) for new features and issues resolved for each release.
diff --git a/contributing/README.md b/contributing/README.md
@@ -108,7 +108,7 @@ How does the project handle a typical `POST` request?
             "trace": false,
             "format": "default"
         },
-        "schemaVersion": "1.30.0"
+        "schemaVersion": "1.31.0"
     }
 }
 ```

diff --git a/contributing/process_release.md b/contributing/process_release.md
@@ -66,6 +66,7 @@
     * 1.28.0 - 17.7 MB
     * 1.29.0 - 17.8 MB
     * 1.30.0 - 16.0 MB
+    * 1.31.0 - 20.5 MB (NOTE: inclusion of OpenTelemetry and grpc-js libraries)
   * Install build to BIG-IP, navigate to folder `/var/config/rest/iapps/f5-telemetry/` and check following:
     * Run `du -sh` and check that folder's size (shouldn't be much greater than previous versions):
       * 1.4.0 - 65 MB
@@ -95,6 +96,7 @@
       * 1.28.0 - 127 MB
       * 1.29.0 - 129 MB
       * 1.30.0 - 116 MB
+      * 1.31.0 - 153 MB (NOTE: inclusion of OpenTelemetry and grpc-js libraries)
     * Check `node_modules` folder - if you see `eslint`, `mocha` or something else from [package.json](package.json) `devDependencies` section - something wrong with build process. Probably some `npm` flags are work as not expected and it MUST BE FIXED before publishing.
 * Ensure that all tests (unit tests and functional tests passed)
 * Optional: Ensure that your local tags match remote. If not, remove all and re-fetch:

diff --git a/detailed_information.md b/detailed_information.md
@@ -969,6 +969,233 @@ Note: available only when `debug` is turned on.
                 "name": "urldb",
                 "level": "none"
             }
+        },
+        "throughputPerformance": {
+            "clientBitsIn": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientBitsIn"
+            },
+            "clientBitsOut": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientBitsOut"
+            },
+            "clientIn": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientIn"
+            },
+            "clientOut": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientOut"
+            },
+            "compression": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "compression"
+            },
+            "inBits": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "inBits"
+            },
+            "inPackets": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "inPackets"
+            },
+            "managementBitsIn": {
+                "average": 2969820,
+                "current": 846485,
+                "max": 36591317,
+                "name": "managementBitsIn"
+            },
+            "managementBitsOut": {
+                "average": 133,
+                "current": 0,
+                "max": 12478,
+                "name": "managementBitsOut"
+            },
+            "outBits": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "outBits"
+            },
+            "outPackets": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "outPackets"
+            },
+            "serverBitsIn": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverBitsIn"
+            },
+            "serverBitsOut": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverBitsOut"
+            },
+            "serverIn": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverIn"
+            },
+            "serverOut": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverOut"
+            },
+            "serviceBits": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serviceBits"
+            },
+            "servicePackets": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "servicePackets"
+            },
+            "sslTps": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "sslTps"
+            }
+        },
+        "connectionsPerformance": {
+            "blade1": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "blade1"
+            },
+            "blade2": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "blade2"
+            },
+            "client": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "client"
+            },
+            "clientAccepts": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientAccepts"
+            },
+            "clientConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientConnections"
+            },
+            "clientConnects": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "clientConnects"
+            },
+            "connections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "connections"
+            },
+            "httpRequests": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "httpRequests"
+            },
+            "pvaClient": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "pvaClient"
+            },
+            "pvaServer": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "pvaServer"
+            },
+            "server": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "server"
+            },
+            "serverConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverConnections"
+            },
+            "activeSslClientConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "activeSslClientConnections"
+            },
+            "newSslClientConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "newSslClientConnections"
+            },
+            "activeSslServerConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "activeSslServerConnections"
+            },
+            "newSslServerConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "newSslServerConnections"
+            },
+            "serverNewConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverNewConnections"
+            },
+            "serverNewTcpConnections": {
+                "average": 0,
+                "current": 0,
+                "max": 0,
+                "name": "serverNewTcpConnections"
+            }
+        },
+        "asmAttackSignatures": {
+            "ff8080817a3a4908017a3a490958000e": {
+                "filename": "ASM-AttackSignatures_20190716_122131.im",
+                "createDateTime": 1563279691000,
+                "name": "ff8080817a3a4908017a3a490958000e"
+            }
         }
     },
     "virtualServers": {

diff --git a/docs/conf.py b/docs/conf.py
@@ -79,7 +79,7 @@
 # The short X.Y version.
 version = u''
 # The full version, including alpha/beta/rc tags.
-release = u'1.30.0'
+release = u'1.31.0'
 
 # The language for content autogenerated by Sphinx. Refer to documentation
 # for a list of supported languages.

diff --git a/docs/output-example.rst b/docs/output-example.rst
@@ -52,6 +52,9 @@ The following properties were introduced in recent Telemetry Streaming versions.
         - System
         - **asmAttackSignatures**, which shows ASM attack signature information.
 
+      * - 1.31
+        - System
+        - **system.connectionsPerformance**, shows performance stats.
 
 
 .. literalinclude:: ../examples/output/system_poller/output.json