forked from apache/hbase
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES.txt
6318 lines (5977 loc) · 375 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
HBase Change Log
Release 0.94.24 - 09/29/2014
Sub-task
[HBASE-11923] - Potential race condition in RecoverableZookeeper.checkZk()
[HBASE-11963] - Synchronize peer cluster replication connection attempts
[HBASE-12023] - HRegion.applyFamilyMapToMemstore creates too many iterator objects.
[HBASE-12077] - FilterLists create many ArrayList$Itr objects per row.
Bug
[HBASE-11405] - Multiple invocations of hbck in parallel disables balancer permanently
[HBASE-11957] - Backport to 0.94 HBASE-5974 Scanner retry behavior with RPC timeout on next() seems incorrect
[HBASE-12019] - hbase-daemon.sh overwrite HBASE_ROOT_LOGGER and HBASE_SECURITY_LOGGER variables
[HBASE-12020] - String formatting on each RPC Invoke
[HBASE-12022] - Payloads on Failure attempt to serialize the byte[] into strings.
[HBASE-12114] - Meta table cache hashing may access the wrong table
Improvement
[HBASE-12090] - Bytes: more Unsafe, more Faster
Task
[HBASE-12103] - Backport HFileV1Detector to 0.94
[HBASE-12113] - Backport to 0.94: HBASE-5525 Truncate and preserve region boundaries option
Release 0.94.23 - 08/26/2014
Bug
[HBASE-9746] - RegionServer can't start when replication tries to replicate to an unknown host
[HBASE-10834] - Better error messaging on issuing grant commands in non-authz mode
[HBASE-11232] - Add MultiRowMutation tests.
[HBASE-11536] - Puts of region location to Meta may be out of order which causes inconsistent of region location
[HBASE-11641] - TestDistributedLogSplitting.testMasterStartsUpWithLogSplittingWork fails frequently
[HBASE-11652] - Port HBASE-3270 and HBASE-11650 to 0.94 - create cluster id and version file in a tmp location and move it into place
[HBASE-11767] - [0.94] Unnecessary garbage produced by schema metrics during scanning
Improvement
[HBASE-11667] - Comment ClientScanner logic for NSREs.
[HBASE-11754] - [Shell] Record table property SPLITS_FILE in descriptor
Task
[HBASE-11690] - Backport HBASE-5934 (Add the ability for Performance Evaluation to set the table compression) to 0.94
[HBASE-11691] - Backport HBASE-7156 (Add Data Block Encoding and -D opts to Performance Evaluation) to 0.94
[HBASE-11693] - Backport HBASE-11026 (Provide option to filter out all rows in PerformanceEvaluation tool) to 0.94
Release 0.94.22 - 07/31/2014
Bug
[HBASE-10645] - Fix wrapping of Requests Counts Regionserver level metrics
[HBASE-11360] - SnapshotFileCache causes too many cache refreshes
[HBASE-11479] - SecureConnection can't be closed when SecureClient is stopping because InterruptedException won't be caught in SecureClient#setupIOstreams()
[HBASE-11496] - HBASE-9745 broke cygwin CLASSPATH translation
[HBASE-11552] - Read/Write requests count metric value is too short
[HBASE-11565] - Stale connection could stay for a while
[HBASE-11633] - [0.94] port HBASE-11217 Race between SplitLogManager task creation + TimeoutMonitor
Improvement
[HBASE-2217] - VM OPTS for shell only
[HBASE-7910] - Dont use reflection for security
[HBASE-11444] - Remove use of reflection for User#getShortName
[HBASE-11450] - Improve file size info in SnapshotInfo tool
[HBASE-11480] - ClientScanner might not close the HConnection created in construction
[HBASE-11623] - mutateRowsWithLocks might require updatesLock.readLock with waitTime=0
Release 0.94.21 - 06/27/2014
Bug
[HBASE-10692] - The Multi TableMap job don't support the security HBase cluster
[HBASE-11052] - Sending random data crashes thrift service
[HBASE-11096] - stop method of Master and RegionServer coprocessor is not invoked
[HBASE-11234] - FastDiffDeltaEncoder#getFirstKeyInBlock returns wrong result
[HBASE-11341] - ZKProcedureCoordinatorRpcs should respond only to members
[HBASE-11414] - Backport to 0.94: HBASE-7711 rowlock release problem with thread interruptions in batchMutate
Improvement
[HBASE-8495] - Change ownership of the directory to bulk load
[HBASE-10871] - Indefinite OPEN/CLOSE wait on busy RegionServers
New Feature
[HBASE-10935] - support snapshot policy where flush memstore can be skipped to prevent production cluster freeze
Release 0.94.20 - 05/23/2014
Sub-task
[HBASE-10936] - Add zeroByte encoding test
Bug
[HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some log entries from being replayed
[HBASE-11110] - Ability to load FilterList class is dependent on context classloader
[HBASE-11143] - Improve replication metrics
[HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is always shown
[HBASE-11212] - Fix increment index in KeyValueSortReducer
[HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented in PutSortReducer#reduce()'
[HBASE-11247] - [0.94] update maven-site-plugin to 3.3
Improvement
[HBASE-11008] - Align bulk load, flush, and compact to require Action.CREATE
[HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file on external file system
[HBASE-11128] - Add -target option to ExportSnapshot to export with a different name
[HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
Release 0.94.19 - 04/21/2014
Bug
[HBASE-10118] - Major compact keeps deletes with future timestamps
[HBASE-10312] - Flooding the cluster with administrative actions leads to collapse
[HBASE-10533] - commands.rb is giving wrong error messages on exceptions
[HBASE-10766] - SnapshotCleaner allows to delete referenced files
[HBASE-10805] - Speed up KeyValueHeap.next() a bit
[HBASE-10807] - -ROOT- still stale in table.jsp if it moved
[HBASE-10845] - Memstore snapshot size isn't updated in DefaultMemStore#rollback()
[HBASE-10847] - 0.94: drop non-secure builds, make security the default
[HBASE-10848] - Filter SingleColumnValueFilter combined with NullComparator does not work
[HBASE-10966] - RowCounter misinterprets column names that have colons in their qualifier
[HBASE-10991] - Port HBASE-10639 'Unload script displays wrong counts (off by one) when unloading regions' to 0.94
[HBASE-11003] - ExportSnapshot is using the wrong fs when staging dir is not in fs.defaultFS
[HBASE-11030] - HBaseTestingUtility.getMiniHBaseCluster should be able to return null
Task
[HBASE-10921] - Port HBASE-10323 'Auto detect data block encoding in HFileOutputFormat' to 0.94 / 0.96
Test
[HBASE-10782] - Hadoop2 MR tests fail occasionally because of mapreduce.jobhistory.address is no set in job conf
[HBASE-10969] - TestDistributedLogSplitting fails frequently in 0.94.
[HBASE-10982] - TestZKProcedure.testMultiCohortWithMemberTimeoutDuringPrepare fails frequently in 0.94
[HBASE-10987] - Increase timeout in TestZKLeaderManager.testLeaderSelection
[HBASE-10988] - Properly wait for server in TestThriftServerCmdLine
[HBASE-10989] - TestAccessController needs better timeout
[HBASE-10996] - TestTableSnapshotInputFormatScan fails frequently on 0.94
[HBASE-11010] - TestChangingEncoding is unnecessarily slow
[HBASE-11017] - TestHRegionBusyWait.testWritesWhileScanning fails frequently in 0.94
[HBASE-11022] - Increase timeout for TestHBaseFsck.testSplitDaughtersNotInMeta
[HBASE-11024] - TestSecureLoadIncrementalHFilesSplitRecovery should wait longer for ACL table
[HBASE-11029] - Increase wait in TestSplitTransactionOnCluster.split
[HBASE-11037] - Race condition in TestZKBasedOpenCloseRegion
[HBASE-11040] - TestAccessController, TestAccessControllerFilter, and TestTablePermissions need to wait longer to ACL table
[HBASE-11042] - TestForceCacheImportantBlocks OOMs occasionally in 0.94
Release 0.94.18 - 03/14/2014
Bug
[HBASE-9708] - Improve Snapshot Name Error Message
[HBASE-9778] - Add hint to ExplicitColumnTracker to avoid seeking
[HBASE-10514] - Forward port HBASE-10466, possible data loss when failed flushes
[HBASE-10549] - When there is a hole, LoadIncrementalHFiles will hang in an infinite loop.
[HBASE-10575] - ReplicationSource thread can't be terminated if it runs into the loop to contact peer's zk ensemble and fails continuously
[HBASE-10583] - backport HBASE-8402 to 0.94 - ScanMetrics depends on number of rpc calls to the server.
[HBASE-10594] - Speed up TestRestoreSnapshotFromClient
[HBASE-10598] - Written data can not be read out because MemStore#timeRangeTracker might be updated concurrently
[HBASE-10614] - Master could not be stopped
[HBASE-10622] - Improve log and Exceptions in Export Snapshot
[HBASE-10624] - Fix 2 new findbugs warnings introduced by HBASE-10598
[HBASE-10627] - A logic mistake in HRegionServer isHealthy
[HBASE-10631] - Avoid extra seek on FileLink open
[HBASE-10642] - Add M/R over snapshots to 0.94
[HBASE-10669] - [hbck tool] Usage is wrong for hbck tool for -sidelineCorruptHfiles option
[HBASE-10682] - region_mover.rb throws "can't convert nil into String" for regions moved
[HBASE-10712] - Backport HBASE-8304 to 0.94 and 0.96
[HBASE-10716] - [Configuration]: hbase.regionserver.region.split.policy should be part of hbase-default.xml
[HBASE-10718] - TestHLogSplit fails when it sets a KV size to be negative
[HBASE-10722] - [0.94] HRegion.computeHDFSBlocksDistribution does not account for links and reference files.
[HBASE-10731] - Fix environment variables typos in scripts
[HBASE-10738] - AssignmentManager should shut down executors on stop
[HBASE-10745] - Access ShutdownHook#fsShutdownHooks should be synchronized
[HBASE-10751] - TestHRegion testWritesWhileScanning occasional fail since HBASE-10514 went in
Improvement
[HBASE-8604] - improve reporting of incorrect peer address in replication
Test
[HBASE-9914] - Port fix for HBASE-9836 'Intermittent TestRegionObserverScannerOpenHook#testRegionObserverCompactionTimeStacking failure' to 0.94
Release 0.94.17 - 02/18/2014
Bug
[HBASE-7963] - HBase VerifyReplication not working when security enabled
[HBASE-10249] - TestReplicationSyncUpTool fails because failover takes too long
[HBASE-10274] - MiniZookeeperCluster should close ZKDatabase when shutdown ZooKeeperServers
[HBASE-10319] - HLog should roll periodically to allow DN decommission to eventually complete.
[HBASE-10320] - Avoid ArrayList.iterator() ExplicitColumnTracker
[HBASE-10335] - AuthFailedException in zookeeper may block replication forever
[HBASE-10340] - [BACKPORT] HBASE-9892 Add info port to ServerName to support multi instances in a node
[HBASE-10363] - [0.94] TestInputSampler and TestInputSamplerTool fail under hadoop 2.0/23 profiles.
[HBASE-10371] - Compaction creates empty hfile, then selects this file for compaction and creates empty hfile and over again
[HBASE-10383] - Secure Bulk Load for 'completebulkload' fails for version 0.94.15
[HBASE-10400] - [hbck] Continue if region dir missing on region merge attempt
[HBASE-10401] - [hbck] perform overlap group merges in parallel
[HBASE-10448] - ZKUtil create and watch methods don't set watch in some cases
[HBASE-10470] - Import generates huge log file while importing large amounts of data
[HBASE-10481] - API Compatibility JDiff script does not properly handle arguments in reverse order
[HBASE-10482] - ReplicationSyncUp doesn't clean up its ZK, needed for tests
[HBASE-10485] - PrefixFilter#filterKeyValue() should perform filtering on row key
[HBASE-10489] - TestImportExport fails in 0.94 with Hadoop2
[HBASE-10493] - InclusiveStopFilter#filterKeyValue() should perform filtering on row key
[HBASE-10501] - Improve IncreasingToUpperBoundRegionSplitPolicy to avoid too many regions
[HBASE-10505] - Import.filterKv does not call Filter.filterRowKey
[HBASE-10506] - Fail-fast if client connection is lost before the real call be executed in RPC layer
[HBASE-10508] - Backport HBASE-10365 'HBaseFsck should clean up connection properly when repair is completed' to 0.94 and 0.96
[HBASE-10539] - HRegion.addAndGetGlobalMemstoreSize returns previous size
[HBASE-10545] - RS Hangs waiting on region to close on shutdown; has to timeout before can go down
[HBASE-10546] - Two scanner objects are open for each hbase map task but only one scanner object is closed
[HBASE-10551] - Change local mode back to one RS thread by default
[HBASE-10552] - HFilePerformanceEvaluation.GaussianRandomReadBenchmark fails sometimes.
[HBASE-10555] - Backport HBASE-8519 to 0.94, Backup master will never come up if primary master dies during initialization
[HBASE-10562] - Fix TestMultiTableInputFormat for Hadoop 2 in 0.94
Improvement
[HBASE-10212] - New rpc metric: number of active handler
[HBASE-10423] - Report back the message of split or rollback failure to the master
[HBASE-10457] - Print corrupted file information in SnapshotInfo tool without -file option
Task
[HBASE-10473] - Add utility for adorning http Context
Test
[HBASE-10480] - TestLogRollPeriod#testWithEdits may fail due to insufficient waiting
Release 0.94.16 - 01/10/2014
Sub-task
[HBASE-10257] - [0.94] Master aborts due to assignment race
Bug
[HBASE-7226] - HRegion.checkAndMutate uses incorrect comparison result for <, <=, > and >=
[HBASE-8558] - Add timeout limit for HBaseClient dataOutputStream
[HBASE-8912] - [0.94] AssignmentManager throws IllegalStateException from PENDING_OPEN to OFFLINE
[HBASE-9346] - HBCK should provide an option to check if regions boundaries are the same in META and in stores.
[HBASE-10078] - Dynamic Filter - Not using DynamicClassLoader when using FilterList
[HBASE-10193] - Cleanup HRegion if one of the store fails to open at region initialization
[HBASE-10214] - Regionserver shutdown improperly and leaves the dir in .old not deleted
[HBASE-10215] - TableNotFoundException should be thrown after removing stale znode in ETH
[HBASE-10225] - Bug in calls to RegionObsever.postScannerFilterRow
[HBASE-10250] - [0.94] TestHLog fails occasionally
[HBASE-10268] - TestSplitLogWorker occasionally fails
[HBASE-10272] - Cluster becomes nonoperational if the node hosting the active Master AND ROOT/META table goes offline
[HBASE-10273] - AssignmentManager.regions and AssignmentManager.servers are not always updated in tandem
[HBASE-10279] - TestStore.testDeleteExpiredStoreFiles is flaky
[HBASE-10281] - TestMultiParallel.testFlushCommitsNoAbort fails frequently in 0.94
[HBASE-10284] - Build broken with svn 1.8
[HBASE-10286] - Revert HBASE-9593, breaks RS wildcard addresses
[HBASE-10306] - Backport HBASE-6820 to 0.94, MiniZookeeperCluster should ensure that ZKDatabase is closed upon shutdown()
Improvement
[HBASE-10285] - All for configurable policies in ChaosMonkey
Test
[HBASE-10259] - [0.94] Upgrade JUnit to 4.11
Release 0.94.15 - 12/17/2013
Bug
[HBASE-7886] - [replication] hlog zk node will not be deleted if client roll hlog
[HBASE-9485] - TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart
[HBASE-9995] - Not stopping ReplicationSink when using custom implementation for the ReplicationSink
[HBASE-10014] - HRegion#doMiniBatchMutation rollbacks the memstore even if there is nothing to rollback.
[HBASE-10015] - Replace intrinsic locking with explicit locks in StoreScanner
[HBASE-10026] - HBaseAdmin#createTable could fail if region splits too fast
[HBASE-10046] - Unmonitored HBase service could accumulate Status objects and OOM
[HBASE-10057] - TestRestoreFlushSnapshotFromClient and TestRestoreSnapshotFromClient fail to finish occasionally
[HBASE-10061] - TableMapReduceUtil.findOrCreateJar calls updateMap(null, ) resulting in thrown NPE
[HBASE-10064] - AggregateClient.validateParameters can throw NPE
[HBASE-10089] - Metrics intern table names cause eventual permgen OOM in 0.94
[HBASE-10111] - Verify that a snapshot is not corrupted before restoring it
[HBASE-10112] - Hbase rest query params for maxVersions and maxValues are not parsed
[HBASE-10117] - Avoid synchronization in HRegionScannerImpl.isFilterDone
[HBASE-10120] - start-hbase.sh doesn't respect --config in non-distributed mode
[HBASE-10179] - HRegionServer underreports readRequestCounts by 1 under certain conditions
[HBASE-10181] - HBaseObjectWritable.readObject catches DoNotRetryIOException and wraps it back in a regular IOException
Improvement
[HBASE-9931] - Optional setBatch for CopyTable to copy large rows in batches
[HBASE-10001] - Add a coprocessor to help testing the performances without taking into account the i/o
[HBASE-10007] - PerformanceEvaluation: Add sampling and latency collection to randomRead test
[HBASE-10010] - eliminate the put latency spike on the new log file beginning
[HBASE-10048] - Add hlog number metric in regionserver
[HBASE-10049] - Small improvments in region_mover.rb
[HBASE-10093] - Unregister ReplicationSource metric bean when the replication source thread is terminated
New Feature
[HBASE-9047] - Tool to handle finishing replication when the cluster is offline
[HBASE-10119] - Allow HBase coprocessors to clean up when they fail
Task
[HBASE-9927] - ReplicationLogCleaner#stop() calls HConnectionManager#deleteConnection() unnecessarily
[HBASE-9986] - Incorporate HTTPS support for HBase (0.94 port)
Test
[HBASE-10058] - Test for HBASE-9915 (avoid reading index blocks)
[HBASE-10189] - Intermittent TestReplicationSyncUpTool failure
Release 0.94.14 - 11/18/2013
Sub-task
[HBASE-9165] - Improvements to addDependencyJars
Bug
[HBASE-9138] - getHaseIntegrationTestingUtility() is misspelled
[HBASE-9799] - Change Hadoop 1.2 dependency to 1.2.1
[HBASE-9809] - RegionTooBusyException should provide region name which was too busy
[HBASE-9834] - Minimize byte[] copies for 'smart' clients
[HBASE-9849] - [REST] Forbidden schema delete in read only mode
[HBASE-9850] - Issues with UI for table compact/split operation completion. After split/compaction operation using UI, the page is not automatically redirecting back using IE8/Firefox.
[HBASE-9865] - Reused WALEdits in replication may cause RegionServers to go OOM
[HBASE-9872] - ModifyTable does not modify the attributes of a newly modified/changed ColumnDescriptor
[HBASE-9890] - MR jobs are not working if started by a delegated user
[HBASE-9902] - Region Server is starting normally even if clock skew is more than default 30 seconds(or any configured). -> Regionserver node time is greater than master node time
[HBASE-9906] - Restore snapshot fails to restore the meta edits sporadically
[HBASE-9915] - Performance: isSeeked() in EncodedScannerV2 always returns false
[HBASE-9952] - Snapshot restore may fail due to NullPointerException
[HBASE-9956] - Remove keyLength cache from KeyValue
[HBASE-9970] - HBase BulkLoad, table is creating with the timestamp key also as a column to the table.
[HBASE-9971] - Port part of HBASE-9958 to 0.94 - change lock scope in locateRegion
[HBASE-9975] - Not starting ReplicationSink when using custom implementation for the ReplicationSink.
[HBASE-9993] - 0.94: HBASE-9865 breaks coprocessor compatibility with WALEdit.
Improvement
[HBASE-4654] - [replication] Add a check to make sure we don't replicate to ourselves
[HBASE-8438] - Extend bin/hbase to print a "mapreduce classpath"
[HBASE-9715] - Backport -in_memory option support for LoadTestTool from trunk
[HBASE-9831] - 'hbasefsck.numthreads' property isn't passed to hbck via cmdline -D option
[HBASE-9894] - remove the inappropriate assert statement in Store.getSplitPoint()
[HBASE-9963] - Remove the ReentrantReadWriteLock in the MemStore
Test
[HBASE-8397] - improve unit-test coverage of package org.apache.hadoop.hbase.master.metrics (0.94)
[HBASE-8543] - fix coverage org.apache.hadoop.hbase.rest.client
[HBASE-8552] - fix coverage org.apache.hadoop.hbase.rest.filter
[HBASE-8556] - fix coverage org.apache.hadoop.hbase.metrics.histogram
[HBASE-8557] - fix coverage org.apache.hadoop.hbase.rest.metrics
[HBASE-8559] - increase unit-test coverage of package org.apache.hadoop.hbase.coprocessor
Release 0.94.13 - 10/29/2013
Sub-task
[HBASE-9711] - Improve HBASE-9428 - avoid copying bytes for RegexFilter unless necessary
Bug
[HBASE-7600] - TestAdmin.testCreateBadTables is failing occasionally
[HBASE-8521] - Cells cannot be overwritten with bulk loaded HFiles
[HBASE-9430] - Memstore heapSize calculation - DEEP_OVERHEAD is incorrect
[HBASE-9504] - Backport HBASE-1212 to 0.94
[HBASE-9548] - Cleanup SnapshotTestingUtils
[HBASE-9607] - Data loss after snapshot restore into cloned table
[HBASE-9649] - HFilePrettyPrinter should not throw a NPE if FirstKey or LastKey is null.
[HBASE-9651] - Backport HBASE-3890 'Scheduled tasks in distributed log splitting not in sync with ZK' to 0.94
[HBASE-9727] - HBase Rest Server - DELETE scanner operation is a no-op
[HBASE-9731] - updatesBlockedSeconds RegionServer metric should not be a histogram
[HBASE-9732] - Static AtomicLong updated in StoreFileScanner every (re)seek
[HBASE-9737] - Corrupt HFile cause resource leak leading to Region Server OOM
[HBASE-9745] - Append HBASE_CLASSPATH to end of Java classpath and use another env var for prefix
[HBASE-9747] - PrefixFilter with OR condition gives wrong results
[HBASE-9751] - Excessive readpoints checks in StoreFileScanner
[HBASE-9753] - Excessive readpoint checks in MemstoreScanner
[HBASE-9783] - o.a.h.h.r.HRegion.mutateRow() with non-existent CF cause NPE
[HBASE-9789] - Change logging for Coprocessor exec call to trace
[HBASE-9807] - block encoder unnecessarily copies the key for each reseek
[HBASE-9842] - Backport HBASE-9593 and HBASE-8667 to 0.94
[HBASE-9847] - HConnectionImplementation does not connect to new active master
Improvement
[HBASE-9221] - Provide interface for getting a User in the client
[HBASE-9488] - Improve performance for small scan
[HBASE-9716] - LoadTestTool should provide default min and max settings to the data generator
[HBASE-9749] - Custom threadpool for Coprocessor obtained HTables
Task
[HBASE-9819] - Backport HBASE-8372 'Provide mutability to CompoundConfiguration' to 0.94
Test
[HBASE-8553] - improve unit-test coverage of package org.apache.hadoop.hbase.mapreduce.hadoopbackport
[HBASE-9851] - TestHBaseFsck.testQuarantineMissingHFile is flaky
[HBASE-9852] - TestRpcMetrics.testCustomMetrics is flaky
Release 0.94.12 - 9/19/2013
Sub-task
[HBASE-9277] - REST should use listTableNames to list tables
[HBASE-9279] - Thrift should use listTableNames to list tables
Bug
[HBASE-7709] - Infinite loop possible in Master/Master replication
[HBASE-7954] - Fix the retrying logic of memstore flushes to avoid extra sleep
[HBASE-8760] - possible loss of data in snapshot taken after region split
[HBASE-8930] - Filter evaluates KVs outside requested columns
[HBASE-9167] - ServerCallable retries just once if timeout is not integer.max
[HBASE-9182] - Allow non-admin users to list all table names
[HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
[HBASE-9207] - An Offline SplitParent Region can be assigned breaking split references
[HBASE-9231] - Multipage book is generated to the wrong location
[HBASE-9233] - isTableAvailable() may be stuck if an offline parent was never assigned
[HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be deprecated in 0.94
[HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
[HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is synchronous
[HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't update if the slave regionserver is stalled
[HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
[HBASE-9303] - Snapshot restore of table which splits after snapshot was taken encounters 'Region is not online'
[HBASE-9326] - ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address. Revert HBASE-8640
[HBASE-9329] - SnapshotManager should check for directory existance before throwing a warning.
[HBASE-9344] - RegionServer not shutting down upon KeeperException in open region
[HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared incorrectly
[HBASE-9397] - Snapshots with the same name are allowed to proceed concurrently
[HBASE-9415] - In rpcServer, replicationQueue is initialized with the max queue size instead of the max queue lenght
[HBASE-9428] - Regex filters are at least an order of magnitude slower since 0.94.3
[HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration conf,byte[] tablename,boolean offlined) method
[HBASE-9432] - Backport HBASE-8781 to 0.94
[HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if talking to older servers
[HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7' to 0.94
[HBASE-9468] - Previous active master can still serves RPC request when it is trying recovering expired zk session
[HBASE-9482] - Do not enforce secure Hadoop for secure HBase
[HBASE-9506] - [0.94] Backport HBASE-9309 The links in the backup masters template are bad
[HBASE-9534] - Short-Circuit Coprocessor HTable access when on the same server
[HBASE-9566] - Add back WALEdit#get/setScopes method
[HBASE-9584] - Short-Circuit Coprocessor doesn't correctly lookup table when on server
Improvement
[HBASE-9243] - Add more useful statistics in the HFile tool
[HBASE-9314] - Dropping a table always prints a TableInfoMissingException in the master log
Task
[HBASE-9153] - Introduce/update a script to generate jdiff reports
[HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at large scale"
Test
[HBASE-9287] - TestCatalogTracker depends on the execution order
Release 0.94.11 - 8/13/2013
Sub-task
[HBASE-8779] - Add mutateRow method support to Thrift2
[HBASE-8946] - Add a new function to Thrift 2 to open scanner, get results and close scanner
[HBASE-8947] - Thrift 2 : Replace "bool writeToWAL" with "TDurability durability"
[HBASE-8948] - Bound table pool size in Thrift 2 server
Bug
[HBASE-6826] - [WINDOWS] TestFromClientSide failures
[HBASE-8067] - TestHFileArchiving.testArchiveOnTableDelete sometimes fails
[HBASE-8670] - [0.94] Backport HBASE-8449,HBASE-8204 and HBASE-8699 to 0.94 (Refactor recoverLease retries and pauses)
[HBASE-8698] - potential thread creation in MetaScanner.metaScan
[HBASE-8935] - IntegrationTestBigLinkedList fails under load on 0.94 due to some scan issues - add logging
[HBASE-8949] - hbase.mapreduce.hfileoutputformat.blocksize should configure with blocksize of a table
[HBASE-9026] - RestartRsHoldingRoot action in org.apache.hadoop.hbase.util.ChaosMonkey restarting the server holding .META. instead of -ROOT-
[HBASE-9032] - Result.getBytes() returns null if backed by KeyValue array
[HBASE-9048] - HCM throws NullPointerException under load
[HBASE-9050] - HBaseClient#call could hang
[HBASE-9060] - ExportSnapshot job fails if target path contains percentage character
[HBASE-9079] - FilterList getNextKeyHint skips rows that should be included in the results
[HBASE-9080] - Retain assignment should be used when re-enabling table(s)
[HBASE-9085] - Integration Tests fails because of bug in teardown phase where the cluster state is not being restored properly.
[HBASE-9087] - Handlers being blocked during reads
[HBASE-9097] - Set HBASE_CLASSPATH before rest of the classpath
[HBASE-9115] - HTableInterface.append operation may overwrites values
[HBASE-9120] - ClassFinder logs errors that are not
[HBASE-9146] - TestHTablePool hangs when run as part of runMediumTests profile
[HBASE-9158] - Serious bug in cyclic replication
[HBASE-9189] - IncreasingToUpperBoundRegionSplitPolicy.shouldSplit() should check all the stores before returning.
[HBASE-9200] - HFilePrettyPrinter finds incorrect largest row
Improvement
[HBASE-6580] - Deprecate HTablePool in favor of HConnection.getTable(...)
[HBASE-8995] - Add hadoop-1.2 profile
[HBASE-9019] - Port HBASE-8690: Reduce unnecessary getFileStatus hdfs calls in TTL hfile and hlog cleanners to 0.94
[HBASE-9029] - Backport HBASE-8706 Some improvement in snapshot to 0.94
[HBASE-9132] - Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94
[HBASE-9139] - Independent timeout configuration for rpc channel between cluster nodes
New Feature
[HBASE-7826] - Improve Hbase Thrift v1 to return results in sorted order
[HBASE-8663] - a HBase Shell command to list the tables replicated from current cluster
Test
[HBASE-8816] - Add support of loading multiple tables into LoadTestTool
[HBASE-9075] - [0.94] Backport HBASE-5760 Unit tests should write only under /target to 0.94
[HBASE-9090] - cleanup snapshot tests setup/teardown code
[HBASE-9106] - Do not fail TestAcidGuarantees for exceptions on table flush
[HBASE-9107] - [0.94] Backport HBASE-6950 TestAcidGuarantees system test now flushes too aggressively to 0.94
Release 0.94.10 - 7/19/2013
Sub-task
[HBASE-8774] - Add BatchSize and Filter to Thrift2
[HBASE-8819] - Port HBASE-5428 to Thrift 2
[HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
[HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
[HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to Thrift2 - Add BatchSize Test
[HBASE-8938] - Thrift2 does not close scanner instance
Bug
[HBASE-8432] - a table with unbalanced regions will balance indefinitely with the 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
[HBASE-8678] - Wrongly delete cells in some case which can not be deleted
[HBASE-8695] - The HBase thrift service ignores XML configuration
[HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
[HBASE-8782] - Thrift2 can not parse values when using framed transport
[HBASE-8794] - DependentColumnFilter.toString() throws NullPointerException
[HBASE-8811] - REST service ignores misspelled "check=" parameter, causing unexpected mutations
[HBASE-8814] - Possible NPE in split if a region has empty store files.
[HBASE-8858] - Backport hbase-6979 "recovered.edits file should not break distributed log splitting"
[HBASE-8910] - HMaster.abortNow shouldn't try to become a master again if it was stopped
[HBASE-8967] - Duplicate call to snapshotManager.stop() in HRegionServer
[HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log the master address which already read from the zk.
[HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
[HBASE-8988] - Reuse the thread pool in the shell to not run out of threads
Improvement
[HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is minimal
[HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
[HBASE-8806] - Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.
[HBASE-8809] - Include deletes in the scan (setRaw) method does not respect the time range or the filter
[HBASE-8847] - Filter.transform() always applies unconditionally, even when combined in a FilterList
[HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test to Test MTTR) to 0.94
[HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
[HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and Improve ExplicitColumnTracker performance.
Task
[HBASE-8829] - Improve failed TestMetaScanner assert message so can see where/why failure
Test
[HBASE-7770] - minor integration test framework fixes
[HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
[HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is flaky
[HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow addition of more actions and policies.
[HBASE-8934] - Fix bunch of flaky tests
[HBASE-8969] - Backport HBASE-8535+HBASE-8586 TestHCM#testDeleteForZKConnLeak enhancement to 0.94
Release 0.94.9 - 6/24/2013
Sub-task
[HBASE-8453] - TestImportExport failing again due to configuration issues
Bug
[HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
[HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
[HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
[HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
[HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
[HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
[HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
[HBASE-8656] - Rpc call may not be notified in SecureClient
[HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
[HBASE-8684] - Table Coprocessor can't access external HTable by default
[HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
[HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
[HBASE-8742] - HTableDescriptor Properties not preserved when cloning
[HBASE-8743] - upgrade hadoop-23 version to 0.23.7
[HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
[HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
[HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
Improvement
[HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
[HBASE-8609] - Make the CopyTable support startRow, stopRow options
[HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
[HBASE-8683] - Add major compaction support in CompactionTool
[HBASE-8702] - Make WALEditCodec pluggable
New Feature
[HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
Task
[HBASE-8603] - Backport HBASE-6921 to 0.94
Release 0.94.8 - 5/22/2013
Sub-task
[HBASE-8381] - TestTableInputFormatScan on Hadoop 2 fails because YARN kills our applications
[HBASE-8399] - TestTableInputFormatScan2#testScanFromConfiguration fails on hadoop2 profile
Bug
[HBASE-7122] - Proper warning message when opening a log file with no entries (idle cluster)
[HBASE-7210] - Backport HBASE-6059 to 0.94
[HBASE-7921] - TestHFileBlock.testGzipCompression should ignore the block checksum
[HBASE-8282] - User triggered flushes does not allow compaction to get triggered even if compaction criteria is met
[HBASE-8327] - Consolidate class loaders
[HBASE-8354] - Backport HBASE-7878 'recoverFileLease does not check return value of recoverLease' to 0.94
[HBASE-8355] - BaseRegionObserver#pre(Compact|Flush|Store)ScannerOpen returns null
[HBASE-8377] - IntegrationTestBigLinkedList calculates wrap for linked list size incorrectly
[HBASE-8379] - bin/graceful_stop.sh does not return the balancer to original state
[HBASE-8385] - [SNAPSHOTS]: Restore fails to restore snapshot of a deleted table
[HBASE-8389] - HBASE-8354 forces Namenode into loop with lease recovery requests
[HBASE-8413] - Snapshot verify region will always fail if the HFile has been archived
[HBASE-8451] - MetricsMBeanBase has concurrency issues in init
[HBASE-8455] - Update ExportSnapshot to reflect changes in HBASE-7419
[HBASE-8464] - FastDiffEncoder - valueOffset calculation is incorrect
[HBASE-8483] - HConnectionManager can leak ZooKeeper connections when using deleteStaleConnection
[HBASE-8493] - Backport HBASE-8422, 'Master won't go down', to 0.94
[HBASE-8503] - Backport hbase-8483 "HConnectionManager can leak ZooKeeper connections when using deleteStaleConnection" to 0.94
[HBASE-8505] - References to split daughters should not be deleted separately from parent META entry
[HBASE-8509] - ZKUtil#createWithParents won't set data during znode creation when parent folder doesn't exit
[HBASE-8513] - [0.94] Fix class files with CRLF endings
[HBASE-8516] - FSUtils.create() fail with ViewFS
[HBASE-8525] - Use sleep multilier when choosing sinks in ReplicationSource
[HBASE-8530] - Refine error message from ExportSnapshot when there is leftover snapshot in target cluster
[HBASE-8538] - HBaseAdmin#isTableEnabled() should check table existence before checking zk state.
[HBASE-8539] - Double(or tripple ...) ZooKeeper listeners of the same type when Master recovers from ZK SessionExpiredException
[HBASE-8540] - SnapshotFileCache logs too many times if snapshot dir doesn't exists
[HBASE-8547] - Fix java.lang.RuntimeException: Cached an already cached block
[HBASE-8550] - 0.94 ChaosMonkey grep for master is too broad
[HBASE-8563] - Double count of read requests for Gets
[HBASE-8588] - [Documentation]: Add information about adding REST and Thrift API kerberos principals to HBase ACL table
Improvement
[HBASE-5930] - Limits the amount of time an edit can live in the memstore.
[HBASE-6870] - HTable#coprocessorExec always scan the whole table
[HBASE-8345] - Add all available resources in o.a.h.h.rest.RootResource and VersionResource to o.a.h.h.rest.client.RemoteAdmin
[HBASE-8350] - enable ChaosMonkey to run commands as different users
[HBASE-8367] - LoadIncrementalHFiles does not return an error code nor throw Exception when failures occur due to timeouts
[HBASE-8383] - Support lib/*jar inside coprocessor jar
[HBASE-8405] - Add more custom options to how ClusterManager runs commands
[HBASE-8446] - Allow parallel snapshot of different tables
New Feature
[HBASE-7965] - Port table locking to 0.94 (HBASE-7305, HBASE-7546, HBASE-7933)
[HBASE-8415] - DisabledRegionSplitPolicy
Task
[HBASE-8574] - Add how to rename a table in the docbook
Test
[HBASE-8508] - improve unit-test coverage of package org.apache.hadoop.hbase.metrics.file
Release 0.94.7 - 4/24/2013
Sub-task
[HBASE-7615] - Add metrics for snapshots
[HBASE-7801] - Allow a deferred sync option per Mutation.
[HBASE-8210] - Backport the LoadTest portions of HBASE-7383
[HBASE-8316] - JoinedHeap for non essential column families should reseek instead of seek
Bug
[HBASE-7401] - Remove warning message about running 'hbase migrate'
[HBASE-7658] - grant with an empty string as permission should throw an exception
[HBASE-7817] - Suggested JDWP debug options in hbase-env.sh are wrong
[HBASE-7824] - Improve master start up time when there is log splitting work
[HBASE-7925] - Back port HBASE-6881 into 0.94
[HBASE-7961] - truncate on disabled table should throw TableNotEnabledException.
[HBASE-8014] - Backport HBASE-6915 to 0.94.
[HBASE-8030] - znode path of online region servers is hard coded in rolling_restart.sh
[HBASE-8044] - split/flush/compact/major_compact from hbase shell does not work for region key with \x format
[HBASE-8081] - Backport HBASE-7213 (separate hlog for meta tables) to 0.94
[HBASE-8092] - bulk assignment in 0.94 doesn't handle ZK errors very well
[HBASE-8096] - [replication] NPE while replicating a log that is acquiring a new block from HDFS
[HBASE-8118] - TestTablePermission depends on the execution order
[HBASE-8125] - HBASE-7435 breaks BuiltInGzipDecompressor on Hadoop < 1.0.x
[HBASE-8127] - Region of a disabling or disabled table could be stuck in transition state when RS dies during Master initialization
[HBASE-8128] - HTable#put improvements
[HBASE-8131] - Create table handler needs to handle failure cases.
[HBASE-8142] - Sporadic TestZKProcedureControllers failures on trunk
[HBASE-8146] - IntegrationTestBigLinkedList does not work on distributed setup
[HBASE-8150] - server should not produce RAITE for already-opening region in 0.94 (because master retry logic handles this case poorly)
[HBASE-8151] - Decode memstoreTS in HFileReaderV2 only when necessary
[HBASE-8158] - Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job"
[HBASE-8160] - HMaster#move doesn't check if master initialized
[HBASE-8166] - Avoid writing the memstoreTS into HFiles when possible
[HBASE-8169] - TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS may fail due to regions randomly assigned to a RS
[HBASE-8170] - HbaseAdmin.createTable cannot handle creating three regions
[HBASE-8176] - Backport HBASE-5335 "Dynamic Schema Configurations" to 0.94
[HBASE-8179] - JSON formatting for cluster status is sort of broken
[HBASE-8188] - Avoid unnecessary row compare in StoreScanner
[HBASE-8192] - Logic errror causes infinite loop in HRegion.bulkLoadHFiles(List)
[HBASE-8207] - Replication could have data loss when machine name contains hyphen "-"
[HBASE-8208] - In some situations data is not replicated to slaves when deferredLogSync is enabled
[HBASE-8211] - Support for NN HA for 0.94
[HBASE-8212] - Introduce a new separator instead of hyphen('-') for renaming recovered queues' znodes
[HBASE-8213] - global authorization may lose efficacy
[HBASE-8215] - Removing existing .regioninfo in writeRegioninfoOnFilesystem
[HBASE-8222] - User class should implement equals() and hashCode()
[HBASE-8225] - [replication] minor code bug when registering ReplicationLogCleaner
[HBASE-8226] - HBaseTestingUtility#waitUntilAllRegionsAssigned won't return if it counts "too many" regions
[HBASE-8229] - Replication code logs like crazy if a target table cannot be found.
[HBASE-8230] - Possible NPE on regionserver abort if replication service has not been started
[HBASE-8231] - delete tests in table_tests.rb(TestShell) always running on empty table.
[HBASE-8232] - TestAccessController occasionally fails with IndexOutOfBoundsException
[HBASE-8246] - Backport HBASE-6318 to 0.94 where SplitLogWorker exits due to ConcurrentModificationException
[HBASE-8259] - Snapshot backport in 0.94.6 breaks rolling restarts
[HBASE-8266] - Master cannot start if TableNotFoundException is thrown while partial table recovery
[HBASE-8270] - Backport HBASE-8097 'MetaServerShutdownHandler may potentially keep bumping up DeadServer.numProcessing' to 0.94
[HBASE-8274] - Backport to 94: HBASE-7488 Implement HConnectionManager.locateRegions which is currently returning null
[HBASE-8276] - Backport hbase-6738 to 0.94 "Too aggressive task resubmission from the distributed log manager"
[HBASE-8285] - HBaseClient never recovers for single HTable.get() calls with no retries when regions move
[HBASE-8288] - HBaseFileSystem: Refactoring and correct semantics for createPath methods
[HBASE-8303] - Increse the test timeout to 60s when they are less than 20s
[HBASE-8313] - Add Bloom filter testing for HFileOutputFormat
[HBASE-8326] - mapreduce.TestTableInputFormatScan times out frequently
[HBASE-8352] - Rename '.snapshot' directory
[HBASE-8427] - Apache Rat is incorrectly excluding test source files
Improvement
[HBASE-7410] - [snapshots] add snapshot/clone/restore/export docs to ref guide
[HBASE-7599] - Port HBASE-6066 (low hanging read path improvements) to 0.94
[HBASE-8148] - Allow IPC to bind on a specific address
[HBASE-8152] - Avoid creating empty reference file when splitkey is outside the key range of a store file
[HBASE-8174] - Backport HBASE-8161(setting blocking file count on table level doesn't work) to 0.94
[HBASE-8198] - Backport HBASE-8063(Filter HFiles based on first/last key) into 0.94
[HBASE-8199] - Eliminate exception for ExportSnapshot against the null table snapshot (with no data in)
[HBASE-8209] - Improve LoadTest extensibility
New Feature
[HBASE-1936] - ClassLoader that loads from hdfs; useful adding filters to classpath without having to restart services
[HBASE-7415] - [snapshots] Add task information to snapshot operation
Task
[HBASE-7929] - Reapply hbase-7507 "Make memstore flush be able to retry after exception" to 0.94 branch.
Test
[HBASE-8106] - Test to check replication log znodes move is done correctly
[HBASE-8260] - create generic integration test for trunk and 94 that is more deterministic, can be run for longer and is less aggressive
Release 0.94.6.1 - 4/13/2013
Bug
[HBASE-8259] - Snapshot backport in 0.94.6 breaks rolling restarts
Release 0.94.6 - 3/14/2013
Sub-task
[HBASE-7944] - Replication leaks file reader resource & not reset currentNbOperations
Bug
[HBASE-6132] - ColumnCountGetFilter & PageFilter not working with FilterList
[HBASE-6347] - -ROOT- and .META. are stale in table.jsp if they moved
[HBASE-6748] - Endless recursive of deleteNode happened in SplitLogManager#DeleteAsyncCallback
[HBASE-7111] - hbase zkcli will not start if the zookeeper server chosen to connect to is unavailable
[HBASE-7153] - print gc option in hbase-env.sh affects hbase zkcli
[HBASE-7507] - Make memstore flush be able to retry after exception
[HBASE-7521] - fix HBASE-6060 (regions stuck in opening state) in 0.94
[HBASE-7624] - Backport HBASE-5359 and HBASE-7596 to 0.94
[HBASE-7671] - Flushing memstore again after last failure could cause data loss
[HBASE-7700] - TestColumnSeeking is mathematically bound to fail
[HBASE-7723] - Remove NameNode URI from ZK splitlogs
[HBASE-7725] - Add ability to create custom compaction request
[HBASE-7761] - MemStore.USEMSLAB_DEFAULT is false, hbase-default.xml says it's true
[HBASE-7763] - Compactions not sorting based on size anymore.
[HBASE-7768] - zkcluster in local mode not seeing configurations in hbase-{site|default}.xml
[HBASE-7777] - HBCK check for lingering split parents should check for child regions
[HBASE-7813] - Bug in BulkDeleteEndpoint kills entire rows on COLUMN/VERSION Deletes
[HBASE-7814] - Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94
[HBASE-7829] - zookeeper kerberos conf keytab and principal parameters interchanged
[HBASE-7832] - Use User.getShortName() in FSUtils
[HBASE-7833] - 0.94 does not compile with Hadoop-0.20.205 and 0.22.0
[HBASE-7851] - Include the guava classes as a dependency for jobs using mapreduce.TableMapReduceUtil
[HBASE-7866] - TestSplitTransactionOnCluster.testSplitBeforeSettingSplittingInZK failed 3 times in a row
[HBASE-7867] - setPreallocSize is different with COMMENT in setupTestEnv in MiniZooKeeperCluster.java
[HBASE-7869] - Provide way to not start LogSyncer thread
[HBASE-7876] - Got exception when manually triggers a split on an empty region
[HBASE-7883] - Update memstore size when removing the entries in append operation
[HBASE-7884] - ByteBloomFilter's performance can be improved by avoiding multiplication when generating hash
[HBASE-7913] - Secure Rest server should login before getting an instance of Rest servlet
[HBASE-7914] - Port the fix of HBASE-6748 into 0.94 branch
[HBASE-7915] - Secure ThriftServer needs to login before calling HBaseHandler
[HBASE-7916] - HMaster uses wrong InetSocketAddress parameter to throw exception
[HBASE-7919] - Wrong key is used in ServerManager#getServerConnection() to retrieve from Map serverConnections
[HBASE-7920] - Move isFamilyEssential(byte[] name) out of Filter interface in 0.94
[HBASE-7945] - Remove flaky TestCatalogTrackerOnCluster
[HBASE-7986] - [REST] Make HTablePool size configurable
[HBASE-7991] - Backport HBASE-6479 'HFileReaderV1 caching the same parent META block could cause server abort when splitting' to 0.94
[HBASE-8007] - Adopt TestLoadAndVerify from BigTop
[HBASE-8019] - Port HBASE-7779 '[snapshot 130201 merge] Fix TestMultiParallel' to 0.94
[HBASE-8025] - zkcli fails when SERVER_GC_OPTS is enabled
[HBASE-8040] - Race condition in AM after HBASE-7521 (only 0.94)
[HBASE-8055] - Null check missing in StoreFile.Reader.getMaxTimestamp()
[HBASE-8061] - Missing test from TestFlushSnapshotFromClient in 0.94
[HBASE-8069] - TestHLog is dependent on the execution order
[HBASE-8085] - Backport the fix for Bytes.toStringBinary() into 94 (HBASE-6991)
[HBASE-8099] - ReplicationZookeeper.copyQueuesFromRSUsingMulti should not return any queues if it failed to execute.
[HBASE-8103] - Fix pom so 0.94 can generate site reports
Improvement
[HBASE-7818] - add region level metrics readReqeustCount and writeRequestCount
[HBASE-7827] - Improve the speed of Hbase Thirft Batch mutation for deletes
[HBASE-8031] - Adopt goraci as an Integration test
New Feature
[HBASE-4210] - Allow coprocessor to interact with batches per region sent from a client
[HBASE-7360] - Snapshot 0.94 Backport
Task
[HBASE-8088] - Versioning site: part one, put stake in the ground for 0.94 by copying current versions of book and site
[HBASE-8090] - Versioning site; part two, publish 0.94 site and add link from main site
Release 0.94.5 - 2/7/2013
Sub-task
[HBASE-2611] - Handle RS that fails while processing the failure of another one
[HBASE-7626] - Backport portions of HBASE-7460 to 0.94
[HBASE-7687] - TestCatalogTracker.testServerNotRunningIOException fails occasionally
[HBASE-7738] - REST server should publish metrics that are available via HTTP
Bug
[HBASE-5458] - Thread safety issues with Compression.Algorithm.GZ and CompressionTest
[HBASE-6513] - Test errors when building on MacOS
[HBASE-6824] - Introduce ${hbase.local.dir} and save coprocessor jars there
[HBASE-7034] - Bad version, failed OPENING to OPENED but master thinks it is open anyways
[HBASE-7293] - [replication] Remove dead sinks from ReplicationSource.currentPeers and pick new ones
[HBASE-7423] - HFileArchiver should not use the configuration from the Filesystem
[HBASE-7468] - TestSplitTransactionOnCluster hangs frequently
[HBASE-7476] - HBase shell count command doesn't escape binary output
[HBASE-7497] - TestDistributedLogSplitting.testDelayedDeleteOnFailure times out occasionally
[HBASE-7498] - Make REST server thread pool size configurable
[HBASE-7499] - TestScannerTimeout timeout is too aggressive.
[HBASE-7502] - TestScannerTimeout fails on snapshot branch
[HBASE-7504] - -ROOT- may be offline forever after FullGC of RS
[HBASE-7505] - Server will hang when stopping cluster, caused by waiting for split threads
[HBASE-7506] - Judgment of carrying ROOT/META will become wrong when expiring server
[HBASE-7513] - HDFSBlocksDistribution shouldn't send NPEs when something goes wrong
[HBASE-7515] - Store.loadStoreFiles should close opened files if there's an exception
[HBASE-7524] - hbase-policy.xml is improperly set thus all rules in it can be by-passed
[HBASE-7530] - [replication] Work around HDFS-4380 else we get NPEs
[HBASE-7531] - [replication] NPE in SequenceFileLogReader because ReplicationSource doesn't nullify the reader
[HBASE-7534] - [replication] TestReplication.queueFailover can fail because HBaseTestingUtility.createMultiRegions is dangerous
[HBASE-7545] - [replication] Break out TestReplication into manageable classes
[HBASE-7549] - Make HTableInterface#batch() javadoc proper
[HBASE-7550] - Synchronization problem in AssignmentManager
[HBASE-7551] - nodeChildrenChange event may happen after the transition to RS_ZK_REGION_SPLITTING in SplitTransaction causing the SPLIT event to be missed in the master side.
[HBASE-7562] - ZKUtil: missing "else condition" in multi processing
[HBASE-7575] - FSUtils#getTableStoreFilePathMap should all ignore non-table folders
[HBASE-7578] - TestCatalogTracker hangs occasionally
[HBASE-7581] - TestAccessController depends on the execution order
[HBASE-7584] - Improve TestAccessController.testAppend
[HBASE-7587] - Fix two findbugs warning in RowResource
[HBASE-7592] - HConnectionManager.getHTableDescriptor() compares too much
[HBASE-7602] - TestFromClientSide.testPoolBehavior is incorrect
[HBASE-7617] - TestHRegionOnCluster.testDataCorrectnessReplayingRecoveredEdits still fails occasionally.
[HBASE-7628] - Port HBASE-6509 fast-forwarding FuzzyRowFilter to 0.94
[HBASE-7643] - HFileArchiver.resolveAndArchive() race condition may lead to snapshot data loss
[HBASE-7644] - Port HBASE-4802 'Disable show table metrics in bulk loader' to 0.94
[HBASE-7646] - Make forkedProcessTimeoutInSeconds configurable
[HBASE-7647] - 0.94 hfiles v2.1 are not backwards compatible with HFilev2.0
[HBASE-7648] - TestAcidGuarantees.testMixedAtomicity hangs sometimes
[HBASE-7654] - Add List<String> getCoprocessors() to HTableDescriptor
[HBASE-7669] - ROOT region wouldn't be handled by PRI-IPC-Handler
[HBASE-7681] - Address some recent random test failures
[HBASE-7684] - NullPointerException in SecureClient when Call is cleaned up due to RPC timeout
[HBASE-7685] - Closing socket connection can't be removed from SecureClient
[HBASE-7693] - Hostname returned by TableInputFormatBase.reverseDNS contains trailing period
[HBASE-7694] - Secure HBase should use replication call queue
[HBASE-7698] - race between RS shutdown thread and openregionhandler causes region to get stuck
[HBASE-7702] - Adding filtering to Import jobs
[HBASE-7715] - FSUtils#waitOnSafeMode can incorrectly loop on standby NN
[HBASE-7717] - Wait until regions are assigned in TestSplitTransactionOnCluster
[HBASE-7728] - deadlock occurs between hlog roller and hlog syncer
[HBASE-7729] - TestCatalogTrackerOnCluster.testbadOriginalRootLocation fails occasionally
[HBASE-7730] - HBaseAdmin#synchronousBalanceSwitch is not compatible with 0.92
[HBASE-7731] - Append/Increment methods in HRegion don't check whether the table is readonly or not
[HBASE-7740] - Recheck matching row for joined scanners
[HBASE-7771] - Secure HBase Client in MR job causes tasks to wait forever
[HBASE-7772] - clusterId is not set in conf properly if only TableMapReduceUtil.initCredentials() is called
[HBASE-7776] - Use ErrorReporter/Log instead of System.out in hbck
[HBASE-7785] - rolling-restart.sh script unable to check expiration of master znode
[HBASE-7793] - Port HBASE-5564 Bulkload is discarding duplicate records to 0.94
Improvement
[HBASE-3996] - Support multiple tables and scanners as input to the mapper in map/reduce jobs
[HBASE-5416] - Improve performance of scans with some kind of filters.
[HBASE-5498] - Secure Bulk Load
[HBASE-5664] - CP hooks in Scan flow for fast forward when filter filters out a row
[HBASE-7441] - Make ClusterManager in IntegrationTestingUtility pluggable
[HBASE-7540] - Make znode dump to print a dump of replication znodes
[HBASE-7561] - Display the total number of regions for a given table on the master webUI
[HBASE-7757] - Add web UI to REST server and Thrift server
New Feature
[HBASE-6669] - Add BigDecimalColumnInterpreter for doing aggregations using AggregationClient
[HBASE-7748] - Add DelimitedKeyPrefixRegionSplitPolicy
Wish
[HBASE-7705] - Make the method getCurrentPoolSize of HTablePool public
Release 0.94.4 - 1/2/2013
Sub-task
[HBASE-3776] - Add Bloom Filter Support to HFileOutputFormat
[HBASE-6206] - Large tests fail with jdk1.7
[HBASE-7009] - Port HBaseCluster interface/tests to 0.94
[HBASE-7042] - Master Coprocessor Endpoint
[HBASE-7282] - Backport Compaction Tool to 0.94
[HBASE-7331] - Add access control for region open and close, row locking, and stopping the regionserver
[HBASE-7336] - HFileBlock.readAtOffset does not work well with multiple threads
[HBASE-7371] - Blocksize in TestHFileBlock is unintentionally small
[HBASE-7399] - Health check chore for HMaster
[HBASE-7406] - Example health checker script
[HBASE-7431] - TestSplitTransactionOnCluster tests still flaky
[HBASE-7438] - TestSplitTransactionOnCluster has too many infinite loops
Bug
[HBASE-6175] - TestFSUtils flaky on hdfs getFileStatus method
[HBASE-6317] - Master clean start up and Partially enabled tables make region assignment inconsistent.
[HBASE-6327] - HLog can be null when create table
[HBASE-6423] - Writes should not block reads on blocking updates to memstores
[HBASE-7091] - support custom GC options in hbase-env.sh
[HBASE-7158] - Allow CopyTable to identify the source cluster (for replication scenarios)
[HBASE-7165] - TestSplitLogManager.testUnassignedTimeout is flaky
[HBASE-7166] - TestSplitTransactionOnCluster tests are flaky
[HBASE-7172] - TestSplitLogManager.testVanishingTaskZNode() fails when run individually and is flaky
[HBASE-7177] - TestZooKeeperScanPolicyObserver.testScanPolicyObserver is flaky
[HBASE-7180] - RegionScannerImpl.next() is inefficient.
[HBASE-7205] - Coprocessor classloader is replicated for all regions in the HRegionServer
[HBASE-7214] - CleanerChore logs too much, so much so it obscures all else that is going on
[HBASE-7230] - port HBASE-7109 integration tests on cluster are not getting picked up from distribution to 0.94
[HBASE-7235] - TestMasterObserver is flaky
[HBASE-7251] - Avoid flood logs during client disconnect during batch get operation
[HBASE-7252] - TestSizeBasedThrottler fails occasionally
[HBASE-7259] - Deadlock in HBaseClient when KeeperException occured
[HBASE-7260] - Upgrade hadoop 1 dependency to hadoop 1.1.1
[HBASE-7273] - Upgrade zookeeper dependency to 3.4.5 for 0.94
[HBASE-7279] - Avoid copying the rowkey in RegionScanner, StoreScanner, and ScanQueryMatcher
[HBASE-7300] - HbckTestingUtil needs to keep a static executor to lower the number of threads used
[HBASE-7301] - Force ipv4 for unit tests
[HBASE-7307] - MetaReader.tableExists should not return false if the specified table regions has been split
[HBASE-7338] - Fix flaky condition for org.apache.hadoop.hbase.TestRegionRebalancing.testRebalanceOnRegionServerNumberChange
[HBASE-7342] - Split operation without split key incorrectly finds the middle key in off-by-one error
[HBASE-7343] - Fix flaky condition for TestDrainingServer
[HBASE-7357] - HBaseClient and HBaseServer should use hbase.security.authentication when negotiating authentication
[HBASE-7376] - Acquiring readLock does not apply timeout in HRegion#flushcache
[HBASE-7398] - [0.94 UNIT TESTS] TestAssignmentManager fails frequently on CentOS 5
[HBASE-7412] - Fix how HTableDescriptor handles default max file size and flush size