back_wt benchmark

Benchmarking OpenLDAP WiredTiger backend

Scenarios

LDAP ADD Benchmarking

Add 10000 entries with some concurrency levels.

LDAP SEARCH Benchmarking

Search 100000 times with random filters.

filter range:

"(cn=user1)" ... "(cn=user10000)"

LDAP BIND Benchmarking

Bind 100000 times with random dn.

dn range:

cn=user1,dc=example,dc=com ... cn=user10000,dc=example,dc=com

Results

LDAP ADD Rate (sync txn log)

add

Concurrency	back-wt	back-bdb	back-bdb
1	66.30	58.68	45.47
2	72.01	65.96	43.92
4	74.94	72.98	41.25
8	83.72	73.34	35.94
16	111.00	66.98	31.10
32	581.85	65.96	29.61
64	1207.39	73.00	27.86
128	2532.15	80.12	26.22
256	4068.88	72.98	24.92
512	5942.25	98.42	24.68

LDAP ADD Rate (no sync txn log)

add

Concurrency	back-wt	back-bdb	back-bdb
1	2206.62	1370.62	2115.95
2	5023.36	2451.37	2906.41
4	11376.48	3134.00	4427.37
8	19913.24	3312.07	5342.31
16	23899.62	2122.60	6102.16
32	25842.84	2081.11	6277.78
64	24178.08	1461.83	6112.39
128	15881.83	1315.02	6246.55
256	14708.68	1409.37	6281.42
512	17310.32	1122.85	6219.76

LDAP BIND Rate

bind

Concurrency	back-wt	back-bdb	back-bdb
1	4265.03	3360.61	4235.44
2	8663.01	7764.77	8862.33
4	17761.05	17040.12	17670.57
8	35098.59	34632.38	34904.55
16	41470.60	39563.85	40250.44
32	40232.70	39615.04	39522.16
64	39610.90	39280.80	38768.33
128	39706.42	39639.89	39098.96
256	40011.01	39761.41	39390.47
512	39763.13	39688.61	39367.47

LDAP SEARCH Rate

Concurrency	back-wt	back-bdb	back-bdb
1	2903.36	2674.04	2922.45
2	5577.44	5444.16	5667.37
4	11160.05	10270.10	10823.20
8	20578.08	19977.75	20421.37
16	27494.16	26277.03	27511.98
32	27093.60	26543.06	26661.58
64	26162.48	26088.70	26109.48
128	26326.29	26280.69	26314.12
256	27011.03	26745.31	26754.33
512	27028.15	26802.56	26862.37

Enviroment

Hardware

Model: PowerEdge R710
CPU: Xeon X5650(12 cores)
Memory: 50G
Disk: SAS 15,000 RPM

Software Version

OpenLDAP 2.4.40 with back-wt patch
BerkeleyDB 5.3.28
WiredTiger 2.5

Benchmarking tool

lb

Configration

common settings in slapd.conf

loglevel 0
threads 512
sockbuf_max_incoming    4194303

index   objectClass pres,eq
index   cn          pres,eq

setting for back-wt


database wt
wtconfig session_max=522
wtconfig cache_size=1000M
wtconfig log=(enabled)
wtconfig transaction_sync=(enabled=true)

modify following setting for nosync benchmarking

-wtconfig transaction_sync=(enabled=true)
+wtconfig transaction_sync=(enabled=false)

settings for back-bdb

database bdb
cachesize 100000
idlcachesize 300000

dbconfig set_cachesize 1 0 1
dbconfig set_lg_bsize 10485760
dbconfig set_lk_max_objects 5000
dbconfig set_lk_max_locks 5000
dbconfig set_lk_max_lockers 5000

add following setting for nosync benchmarking

dbnosync

settings for back-mdb

maxsize 1073741824