@@ -24,7 +24,7 @@ Improvements that affect performance:
24
24
of unique names, larger batch sizes can reduce ZooKeeper contention because more file names can be
25
25
reserved with a single ZooKeeper call.
26
26
* {% ghi 3733 %} Avoid creating server side threads when failed writes are cancelled. In versions 2.1.2
27
- and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, an
27
+ and earlier, the thrift close call creates a new thread to cancel the thrift session. With 2.1.3, a
28
28
new thrift method is available to test if a session is reserved and deletes it if it is not reserved
29
29
without creating an additional thread. If the new method is not available it falls back to the previous
30
30
close method to preserve interoperability between 2.x versions.
@@ -33,14 +33,16 @@ Improvements that affect performance:
33
33
subsequent GC Runs.
34
34
* {% ghi 3756 %} Added new RPC named cancelUpdate that reduces the amount of threads waiting to close failed
35
35
batch write sessions.
36
- * {% ghi 4682 %} Changed the ScanServer ref format to sort by UUID to increase performance
37
- * {% ghi 4536 %} Created ScanServerSelector that tries to use scan servers on the same host to leverage
36
+ * {% ghi 4682 %} Changed the ScanServer file reference format in the metadata table to sort by UUID to increase performance.
37
+ * {% ghi 4536 %} Created alternate ScanServerSelector implementation that tries to use scan servers on the same host to leverage
38
38
shared off-heap-cache usage.
39
39
* {% ghi 4544 %} Made scan servers refresh cached list of tablet files before expiration. Added new property
40
40
{% plink sserver.cache.metadata.refresh.percent %} to control when refresh happens.
41
41
* {% ghi 3813 %} Made compactors use cached address for compaction coordinator when getting next compaction job.
42
42
This lowers load on zookeeper when running many compactors.
43
43
* {% ghi 3706 %} Avoid unnescessary copying of hadoop config that was causing Accumulo GC slowdown.
44
+ * {% ghi 4709 %} Modified Manager balancer code such that the root, metadata, and user tables will be balanced
45
+ separately, and in that order. For example, balancing for user tables will not occur while the metadata table is unbalanced.
44
46
45
47
### Notable Bug Fixes
46
48
@@ -58,7 +60,7 @@ Improvements that affect performance:
58
60
* {% ghi 3744 %} Fixed bug regarding improperly created GCRun logger name.
59
61
* {% ghi 3737 %} Adds a custom Transport Factory to set transport message and frame size to avoid infinite loops
60
62
as described in {% ghi 3731 %}.
61
- * {% ghi 3750 %} Fixed issue when deleting a compaction thread pool would leave tablets in a bad state.
63
+ * {% ghi 3750 %} Fixed issue when deleting a compaction thread pool that would leave tablets in a bad state.
62
64
* {% ghi 4117 %} Fixed a bug in compaction properties where the replacement ` maxOpen ` property was being
63
65
ignored in favor of the deprecated ` open.max ` property.
64
66
* {% ghi 4681 %} Stopped listing all compactors in each compactor to reduce load on Zookeeper.
@@ -68,17 +70,18 @@ Improvements that affect performance:
68
70
` compactor.message.size.max ` ,` compaction.coordinator.message.size.max ` .
69
71
* {% ghi 3966 %} Changed the default value of the the property {% plink table.majc.compaction.strategy %}
70
72
to empty string to fix a compatibility bug with old and new compaction plugins.
71
- * {% ghi 4554 %} Fixed a race condtion that could cause duplicate compactions to run. While harmless in
73
+ * {% ghi 4554 %} Fixed a race condition that could cause duplicate compactions to run. While harmless in
72
74
terms of data, the duplicate compactions could waste significant compute resources.
73
- * {% ghi 4127 %} Updated new compaction plugins to honor {% plink table.file.max %} property. Implemented
75
+ * {% ghi 4127 %} Updated new compaction plugins to honor {% plink table.file.max %} property. Implemented
74
76
a much more efficient algorithm than old compaction plugins had for this property.
75
- * {% ghi 4485 %} Interrupt compactions on tablet unload. This prevents long running compactions from blocking
77
+ * {% ghi 4485 %} Interrupt compactions on tablet unload. This prevents long running compactions from blocking
76
78
tablet migration.
77
79
* {% ghi 3512 %} Fixed issue with improperly cleaned up scans preventing metadata tablet unload.
78
80
* {% ghi 4456 %} Setting empty property value no longer deletes property
79
81
* {% ghi 4000 %} Fixed bug that could cause bulk import to lose files when errors happened in the tablet server.
80
82
* {% ghi 4462 %} Fixed bug that prevented listing Fate operations in some situations.
81
83
* {% ghi 4573 %} Modified CredentialProviderToken to no longer store password in serialized form.
84
+ * {% ghi 4684 %} Fixed an issue that was causing table creation to get progressively slower when creating a lot of tables.
82
85
83
86
### Improvements that help with administration:
84
87
@@ -90,7 +93,7 @@ Improvements that affect performance:
90
93
* {% ghi 3745 %} Adds prefix to gc deletion log messages. This makes it easier to isolate the deletion
91
94
actions of the garbage collector for analysis.
92
95
* {% ghi 3724 %} Adds logging of transactions when metadata and in-memory differences are detected.
93
- * {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Modified default value of
96
+ * {% ghi 3725 %} Changed the gc batch size from bytes to memory percentage value. Modified default value of
94
97
property {% plink gc.candidate.batch.size %}.
95
98
* {% ghi 3684 %} Consolidated y/n prompts in the shell. Users can now exit out of multi-table delete operations
96
99
without accepting prompts for each one.
@@ -101,15 +104,21 @@ Improvements that affect performance:
101
104
to be used at the same time. Updated documentation on the property {% plink general.micrometer.factory %}
102
105
* {% ghi 4622 %} Added compactor busy and server idle metrics {% ghi 4740 %} to allow for proper scale-in operations.
103
106
Added property {% plink general.metrics.process.idle %} to configure idle time for metrics.
104
- * {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties
107
+ * {% ghi 3927 %} Added a new JSON property type that validates the value is json. Updated the properties
105
108
{% plink monitor.resources.external %} and {% plink tserver.compaction.major.service.meta.planner.opts.executors %} to use this new type.
106
109
* {% ghi 4223 %} Added properties {% plink compactor.wait.time.job.min %} and {% plink compactor.wait.time.job.max %} to
107
110
control the min and max times compactors use when polling for work.
108
- * {% ghi 3998 %} Added instance name tag to metrics. This is useful for the case when metrics from multiple Accumulo instances
111
+ * {% ghi 3998 %} Added instance name tag to metrics. This is useful for the case when metrics from multiple Accumulo instances
109
112
are flowing into a single metrics system.
110
113
* {% ghi 4763 %} Improved the accumulo-cluster script and cluster.yaml file for the use case of starting and stopping specific
111
114
groups of compactors and scan servers.
112
115
* {% ghi 4487 %} Scan server properties can now be set in the shell.
116
+ * {% ghi 4768 %} Modified thread pool names so that the user will be able to easily find their location in the source code
117
+ when looking at thread pool metrics. This change affects the thread names in the output of a jstack on the process.
118
+ * {% ghi 4470 %} Added new metrics to indicate how many migrations are remaining.
119
+ * {% ghi 4558 %} Added a log message in the Manager when it has been waiting over 15 minutes for a tablet to unload.
120
+ * {% ghi 4495 %} Added ` accumulo admin serviceStatus ` command to quickly get system process status from the command line.
121
+
113
122
114
123
## Upgrading
115
124
0 commit comments