Skip to content

Commit

Permalink
Minor updates to 2.1.3 release notes (#436)
Browse files Browse the repository at this point in the history
* Minor updates to 2.1.3 release notes

* Update _posts/release/2024-07-10-accumulo-2.1.3.md

Co-authored-by: Dom G. <domgarguilo@apache.org>

---------

Co-authored-by: Dom G. <domgarguilo@apache.org>
  • Loading branch information
dlmarion and DomGarguilo authored Aug 1, 2024
1 parent 0f9bc7c commit 469ce58
Showing 1 changed file with 19 additions and 10 deletions.
29 changes: 19 additions & 10 deletions _posts/release/2024-07-10-accumulo-2.1.3.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ Improvements that affect performance:
of unique names, larger batch sizes can reduce ZooKeeper contention because more file names can be
reserved with a single ZooKeeper call.
* {% ghi 3733 %} Avoid creating server side threads when failed writes are cancelled. In versions 2.1.2
and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, an
and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, a
new thrift method is available to test if a session is reserved and deletes it if it is not reserved
without creating an additional thread. If the new method is not available it falls back to the previous
close method to preserve interoperability between 2.x versions.
Expand All @@ -33,14 +33,16 @@ Improvements that affect performance:
subsequent GC Runs.
* {% ghi 3756 %} Added new RPC named cancelUpdate that reduces the amount of threads waiting to close failed
batch write sessions.
* {% ghi 4682 %} Changed the ScanServer ref format to sort by UUID to increase performance
* {% ghi 4536 %} Created ScanServerSelector that tries to use scan servers on the same host to leverage
* {% ghi 4682 %} Changed the ScanServer file reference format in the metadata table to sort by UUID to increase performance.
* {% ghi 4536 %} Created alternate ScanServerSelector implementation that tries to use scan servers on the same host to leverage
shared off-heap-cache usage.
* {% ghi 4544 %} Made scan servers refresh cached list of tablet files before expiration. Added new property
{% plink sserver.cache.metadata.refresh.percent %} to control when refresh happens.
* {% ghi 3813 %} Made compactors use cached address for compaction coordinator when getting next compaction job.
This lowers load on zookeeper when running many compactors.
* {% ghi 3706 %} Avoid unnescessary copying of hadoop config that was causing Accumulo GC slowdown.
* {% ghi 4709 %} Modified Manager balancer code such that the root, metadata, and user tables will be balanced
separately, and in that order. For example, balancing for user tables will not occur while the metadata table is unbalanced.

### Notable Bug Fixes

Expand All @@ -58,7 +60,7 @@ Improvements that affect performance:
* {% ghi 3744 %} Fixed bug regarding improperly created GCRun logger name.
* {% ghi 3737 %} Adds a custom Transport Factory to set transport message and frame size to avoid infinite loops
as described in {% ghi 3731 %}.
* {% ghi 3750 %} Fixed issue when deleting a compaction thread pool would leave tablets in a bad state.
* {% ghi 3750 %} Fixed issue when deleting a compaction thread pool that would leave tablets in a bad state.
* {% ghi 4117 %} Fixed a bug in compaction properties where the replacement `maxOpen` property was being
ignored in favor of the deprecated `open.max` property.
* {% ghi 4681 %} Stopped listing all compactors in each compactor to reduce load on Zookeeper.
Expand All @@ -68,17 +70,18 @@ Improvements that affect performance:
`compactor.message.size.max`,`compaction.coordinator.message.size.max`.
* {% ghi 3966 %} Changed the default value of the the property {% plink table.majc.compaction.strategy %}
to empty string to fix a compatibility bug with old and new compaction plugins.
* {% ghi 4554 %} Fixed a race condtion that could cause duplicate compactions to run. While harmless in
* {% ghi 4554 %} Fixed a race condition that could cause duplicate compactions to run. While harmless in
terms of data, the duplicate compactions could waste significant compute resources.
* {% ghi 4127 %} Updated new compaction plugins to honor {% plink table.file.max %} property. Implemented
* {% ghi 4127 %} Updated new compaction plugins to honor {% plink table.file.max %} property. Implemented
a much more efficient algorithm than old compaction plugins had for this property.
* {% ghi 4485 %} Interrupt compactions on tablet unload. This prevents long running compactions from blocking
* {% ghi 4485 %} Interrupt compactions on tablet unload. This prevents long running compactions from blocking
tablet migration.
* {% ghi 3512 %} Fixed issue with improperly cleaned up scans preventing metadata tablet unload.
* {% ghi 4456 %} Setting empty property value no longer deletes property
* {% ghi 4000 %} Fixed bug that could cause bulk import to lose files when errors happened in the tablet server.
* {% ghi 4462 %} Fixed bug that prevented listing Fate operations in some situations.
* {% ghi 4573 %} Modified CredentialProviderToken to no longer store password in serialized form.
* {% ghi 4684 %} Fixed an issue that was causing table creation to get progressively slower when creating a lot of tables.

### Improvements that help with administration:

Expand All @@ -90,7 +93,7 @@ Improvements that affect performance:
* {% ghi 3745 %} Adds prefix to gc deletion log messages. This makes it easier to isolate the deletion
actions of the garbage collector for analysis.
* {% ghi 3724 %} Adds logging of transactions when metadata and in-memory differences are detected.
* {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Modified default value of
* {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Modified default value of
property {% plink gc.candidate.batch.size %}.
* {% ghi 3684 %} Consolidated y/n prompts in the shell. Users can now exit out of multi-table delete operations
without accepting prompts for each one.
Expand All @@ -101,15 +104,21 @@ Improvements that affect performance:
to be used at the same time. Updated documentation on the property {% plink general.micrometer.factory %}
* {% ghi 4622 %} Added compactor busy and server idle metrics {% ghi 4740 %} to allow for proper scale-in operations.
Added property {% plink general.metrics.process.idle %} to configure idle time for metrics.
* {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties
* {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties
{% plink monitor.resources.external %} and {% plink tserver.compaction.major.service.meta.planner.opts.executors %} to use this new type.
* {% ghi 4223 %} Added properties {% plink compactor.wait.time.job.min %} and {% plink compactor.wait.time.job.max %} to
control the min and max times compactors use when polling for work.
* {% ghi 3998 %} Added instance name tag to metrics. This is useful for the case when metrics from multiple Accumulo instances
* {% ghi 3998 %} Added instance name tag to metrics. This is useful for the case when metrics from multiple Accumulo instances
are flowing into a single metrics system.
* {% ghi 4763 %} Improved the accumulo-cluster script and cluster.yaml file for the use case of starting and stopping specific
groups of compactors and scan servers.
* {% ghi 4487 %} Scan server properties can now be set in the shell.
* {% ghi 4768 %} Modified thread pool names so that the user will be able to easily find their location in the source code
when looking at thread pool metrics. This change affects the thread names in the output of a jstack on the process.
* {% ghi 4470 %} Added new metrics to indicate how many migrations are remaining.
* {% ghi 4558 %} Added a log message in the Manager when it has been waiting over 15 minutes for a tablet to unload.
* {% ghi 4495 %} Added `accumulo admin serviceStatus` command to quickly get system process status from the command line.


## Upgrading

Expand Down

0 comments on commit 469ce58

Please sign in to comment.