diff --git a/_posts/release/2024-07-10-accumulo-2.1.3.md b/_posts/release/2024-07-10-accumulo-2.1.3.md index 3423d135d..ff56b0e9c 100644 --- a/_posts/release/2024-07-10-accumulo-2.1.3.md +++ b/_posts/release/2024-07-10-accumulo-2.1.3.md @@ -18,13 +18,14 @@ history or issue tracker. Improvements that affect performance: -* {% ghi 3722 %} Adds parameter {% plink general.filename.base.allocation %}, that allows the batch size +* {% ghi 3722 %} Adds properties {% plink general.file.name.allocation.batch.size.min %} and + {% plink general.file.name.allocation.batch.size.max%} that allow the batch size for unique filename allocation in ZooKeeper to be configurable. In a system that requires large numbers - of unique names, larger batch sizes can reduce ZooKeeper contention because more file names can be + of unique names, larger batch sizes can reduce ZooKeeper contention because more file names can be reserved with a single ZooKeeper call. * {% ghi 3733 %} Avoid creating server side threads when failed writes are cancelled. In versions 2.1.2 and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, an - new thrift method is available to test if a session is reserved and deletes it if it is not reserved + new thrift method is available to test if a session is reserved and deletes it if it is not reserved without creating an additional thread. If the new method is not available it falls back to the previous close method to preserve interoperability between 2.x versions. * {% ghi 3738 %} Adds parameter {% plink gc.remove.in.use.candidates %}, that enables the Garbage Collector @@ -35,6 +36,8 @@ Improvements that affect performance: * {% ghi 4682 %} Changed the ScanServer ref format to sort by UUID to increase performance * {% ghi 4536 %} Created ScanServerSelector that tries to use scan servers on the same host to leverage shared off-heap-cache usage. +* {% ghi 4544 %} Made scan servers refresh cached list of tablet files before expiration. Added new property + {% plink sserver.cache.metadata.refresh.percent %} to control when refresh happens. ### Notable Bug Fixes @@ -59,10 +62,15 @@ Improvements that affect performance: ignored in favor of the deprecated `open.max` property. * {% ghi 4681 %} Stopped listing all compactors in each compactor to reduce load on Zookeeper. * {% ghi 4309 %} Optimized logic for getting a random TabletServer connection which improved Shell startup times. +* {% ghi 3873 %} Increase Thrift max message size defaults which avoids errors with large key values. Added + property {% plink rpc.message.size.max %}. Removed experimental properties `sserver.server.message.size.max`, + `compactor.message.size.max`,`compaction.coordinator.message.size.max`. +* {% ghi 3966 %} Changed the default value of the the property {% plink table.majc.compaction.strategy %} + to empty string to fix a compatibility bug with old and new compaction plugins. ### Improvements that help with administration: -* {% ghi 3697 %} Allow `ACCUMULO_JAVA_PREFIX` option in `accumulo-env.sh` so it can be passed +* {% ghi 3697 %} Allow `ACCUMULO_JAVA_PREFIX` option in `accumulo-env.sh` so it can be passed as an array. This simplifies passing user options when starting Accumulo processes, for example `numactl` parameters. * {% ghi 3751 %} Added property {% plink rpc.backlog %} to configure backlog size for @@ -70,14 +78,19 @@ Improvements that affect performance: * {% ghi 3745 %} Adds prefix to gc deletion log messages. This makes it easier to isolate the deletion actions of the garbage collector for analysis. * {% ghi 3724 %} Adds logging of transactions when metadata and in-memory differences are detected. -* {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. +* {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Added property {% plink gc.candidate.batch.size %} * {% ghi 3684 %} Consolidated y/n prompts in the shell. Users can now exit out of multi-table delete operations without accepting prompts for each one. * {% ghi 3726 %} Adjusted reauthentication messages from the shell to assist with troubleshooting. * {% ghi 4461 %}, {% ghi 4522 %}, {% ghi 4577 %} Added various metrics for scan servers to determine scan reservations and usage * {% ghi 4459 %} Added the ability to specify multiple MeterRegistryFactorys to allow for various metric exporters - to be used at the same time. + to be used at the same time. Updated documentation on the property {% plink general.micrometer.factory %} * {% ghi 4622 %} Added compactor busy and server idle metrics {% ghi 4740 %} to allow for proper scale-in operations. + Added property {% plink general.metrics.process.idle %} to configure idle time for metrics. +* {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties + {% plink monitor.resources.external %} and {% tserver.compaction.major.service.meta.planner.opts.executors %} to use this new type. +* {% ghi 4223 %} Added properties {% plink compactor.wait.time.job.min %} and {% compactor.wait.time.job.max %} to + control the min and max times compactors use when polling for work. ## Upgrading