Update README and configs

TrustworthyComputing · Nov 12, 2024 · 39f1a9f · 39f1a9f
1 parent c90ae9a
commit 39f1a9f
Show file tree

Hide file tree

Showing 14 changed files with 52 additions and 21 deletions.
diff --git a/README.md b/README.md
@@ -49,6 +49,9 @@ cargo 1.74.0
 Next, build from sources using:
 ```bash
 ❯❯ cargo build --release
+
+...
+Finished `release` profile [optimized] target(s) in ...s
 ```
 
 ## Running
@@ -182,13 +185,13 @@ called `Result::unwrap()` on an `Err` value: Disconnected
 ```
 which is caused by the RPC batch sizes.
 
-To fix this reduce the batch sizes of either the reports or the FLPs (or both).
-Note that this does not affect the online running time, but it affects the
-upload time from the `driver` to the Mastic servers.
+To fix this, reduce the batch sizes of either the reports or the FLPs (or both).
 ```toml
 add_report_share_batch_size = 1000
 query_flp_batch_size = 100000
 ```
+**Note:** this does not affect the online running time, but it affects the
+upload time from the `driver` to the Mastic servers.
 
 ## Disclaimer
 

diff --git a/artifact/README.md b/artifact/README.md
@@ -248,7 +248,10 @@ histogram as in the print message: `4 histogram buckets`. Each string e.g.,
 
 Lastly, you can run both weighted heavy hitters and attribute based metrics with malicious clients by passing the `--malicious` and a percentage.
 
-### Experiments
+
+# Experiments
+
+## Understanding the configuration files
 Our experiments can be reproduced by using our config files: https://github.com/TrustworthyComputing/mastic/tree/main/src/configs and the values provided in the paper.
 
 For instance:
@@ -302,5 +305,30 @@ zipf_exponent = 1.03
 etc. These parameters are sufficient to reproduce all our results -- all our
 experiments in the paper specify the parameters used.
 
+## Reproducing Experiments and Figures
 To reproduce our experiments, use the configs from the [configs](./configs/)
 directory and the scripts from the [plots](../plots/) directory.
+
+## Troubleshooting
+As mentioned in the **Troubleshooting** section of the [README file](../README.md) file,
+Mastic relies on the [tarpc](https://github.com/google/tarpc) library which has
+a limit on the size of the RPC messages. As such, you might see an error similar
+to the following:
+```shell
+thread 'main' panicked at src/bin/driver.rs:335:
+called `Result::unwrap()` on an `Err` value: Disconnected
+```
+which is caused by the RPC batch sizes.
+
+In case you run into this issue, you can fix this easily by reducing the batch
+sizes of either the reports or the FLPs (or both).
+```toml
+add_report_share_batch_size = 1000
+query_flp_batch_size = 100000
+```
+**Note:** this does not affect the online running time, but it affects the
+upload time from the `driver` to the Mastic servers. In other words, this does
+not change the experiments but will make setting up the experiments faster. For
+this reason, most of the provided configs use the default batch sizes, which may
+cause crashes with more clients or bits, but this can be simply resolved by
+reducing the batch sizes.
diff --git a/artifact/configs/figure-3/Mastic-m=10,n=128.toml b/artifact/configs/figure-3/Mastic-m=10,n=128.toml
@@ -6,7 +6,7 @@ hist_buckets = 9
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
+add_report_share_batch_size = 50
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-3/Mastic-m=10,n=256.toml b/artifact/configs/figure-3/Mastic-m=10,n=256.toml
@@ -6,7 +6,7 @@ hist_buckets = 9
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
+add_report_share_batch_size = 50
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-3/Mastic-m=10,n=64.toml b/artifact/configs/figure-3/Mastic-m=10,n=64.toml
@@ -6,7 +6,7 @@ hist_buckets = 9
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
+add_report_share_batch_size = 50
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-3/Mastic-m=30,n=128.toml b/artifact/configs/figure-3/Mastic-m=30,n=128.toml
@@ -6,7 +6,7 @@ hist_buckets = 29
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
+add_report_share_batch_size = 50
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-3/Mastic-m=30,n=256.toml b/artifact/configs/figure-3/Mastic-m=30,n=256.toml
@@ -6,7 +6,7 @@ hist_buckets = 29
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
+add_report_share_batch_size = 50
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-3/Mastic-m=30,n=64.toml b/artifact/configs/figure-3/Mastic-m=30,n=64.toml
@@ -6,7 +6,7 @@ hist_buckets = 29
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
+add_report_share_batch_size = 50
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-4/Mastic-m=30.toml b/artifact/configs/figure-4/Mastic-m=30.toml
@@ -6,7 +6,7 @@ hist_buckets = 29
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 100
-query_flp_batch_size = 100000
+add_report_share_batch_size = 50
+query_flp_batch_size = 10000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-6/Mastic-A=1.toml b/artifact/configs/figure-6/Mastic-A=1.toml
@@ -6,7 +6,7 @@ hist_buckets = 100
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 1000
-query_flp_batch_size = 100000
+add_report_share_batch_size = 500
+query_flp_batch_size = 10000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-6/Mastic-A=1024.toml b/artifact/configs/figure-6/Mastic-A=1024.toml
@@ -6,7 +6,7 @@ hist_buckets = 100
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 1000
-query_flp_batch_size = 100000
+add_report_share_batch_size = 50
+query_flp_batch_size = 10000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-6/Mastic-A=128.toml b/artifact/configs/figure-6/Mastic-A=128.toml
@@ -6,7 +6,7 @@ hist_buckets = 100
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 1000
+add_report_share_batch_size = 100
 query_flp_batch_size = 100000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-6/Prio-A=1024.toml b/artifact/configs/figure-6/Prio-A=1024.toml
@@ -5,7 +5,7 @@ hist_buckets = 102400
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 1000
-query_flp_batch_size = 100000
+add_report_share_batch_size = 5
+query_flp_batch_size = 10000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03
diff --git a/artifact/configs/figure-6/Prio-A=128.toml b/artifact/configs/figure-6/Prio-A=128.toml
@@ -5,7 +5,7 @@ hist_buckets = 12800
 server_0 = "0.0.0.0:8000"
 server_1 = "0.0.0.0:8001"
 
-add_report_share_batch_size = 1000
-query_flp_batch_size = 100000
+add_report_share_batch_size = 10
+query_flp_batch_size = 10000
 zipf_unique_buckets = 1000
 zipf_exponent = 1.03