Comparing data and data


# SUMMARY
- LHS tests = 2313
- RHS tests = 2313
- LHS success = 0  (0.0%)
- RHS success = 0  (0.0%)


## METADATA

<details><summary>METADATA</summary>

# LHS
<pre>
Ramon benchmark for Z3
-
Job description: 
Job tag: smt_qf_nia_small
Runner: lev-ripper
Z3 repo: ilanashapiro/z3
Z3 commit: 4bd40e916b69b3878236a8b02db276d78f128e5d
Z3 branch: 
Z3 options: "smt.threads=4 tactic.default_tactic=smt -T:30 smt.threads_max_conflicts=800"
Z3 inputs: inputs/QF_NIA_small
Z3 commit message: turn off logging at level 0 for testing

</pre>
# RHS
<pre>
Ramon benchmark for Z3
-
Job description: 
Job tag: smt_qf_nia_small
Runner: lev-ripper
Z3 repo: ilanashapiro/z3
Z3 commit: 4bd40e916b69b3878236a8b02db276d78f128e5d
Z3 branch: 
Z3 options: "smt.threads=4 tactic.default_tactic=smt -T:30 smt.threads_max_conflicts=800"
Z3 inputs: inputs/QF_NIA_small
Z3 commit message: turn off logging at level 0 for testing

</pre>
</details>


## TOP 20 RUNTIME INCREASE

<details><summary>TOP 20 RUNTIME INCREASE</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 RUNTIME INCREASE (RELATIVE)

<details><summary>TOP 20 RUNTIME INCREASE (RELATIVE)</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 RUNTIME DECREASE

<details><summary>TOP 20 RUNTIME DECREASE</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 RUNTIME DECREASE (RELATIVE)

<details><summary>TOP 20 RUNTIME DECREASE (RELATIVE)</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 LHS FILES, BY RUNTIME

<details><summary>TOP 20 LHS FILES, BY RUNTIME</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|aproveSMT1619938986991890573.smt2                                                          |   0.030s |1560.0KiB|
|From_AProVE_2014__AlternatingGrowReduceRec2.jar-obl-9__term_unfeasibility_1_0.smt2         |   0.029s |1780.0KiB|
|From_AProVE_2014__Velroyen08-narrowKonv.jar-obl-8__p14411_terminationG_0.smt2              |   0.028s |1564.0KiB|
|1361.smt2                                                                                  |   0.027s |1560.0KiB|
|From_T2__slayer-5-filtered.t2__p22746_terminationG_0.smt2                                  |   0.026s |1788.0KiB|
|From_AProVE_2014__Test6.jar-obl-13__p12864_terminationG_0.smt2                             |   0.026s |1560.0KiB|
|From_T2__n-3.t2__p4196_terminationG_0.smt2                                                 |   0.026s |1400.0KiB|
|From_T2__s1-striped.t2__p14281_safety_0.smt2                                               |   0.025s |1792.0KiB|
|1607.smt2                                                                                  |   0.025s |1560.0KiB|
|From_T2__slayer-3-new.t2__p21954_terminationG_0.smt2                                       |   0.025s |1560.0KiB|
|From_T2__ex36.t2__p25811_safety_0.smt2                                                     |   0.025s |1560.0KiB|
|aproveSMT6155317075733447430.smt2                                                          |   0.024s |1788.0KiB|
|aproveSMT1256079449125527892.smt2                                                          |   0.024s |1560.0KiB|
|From_AProVE_2014__juLinkedListCreateRemoveAll.jar-obl-11__terminationS_28_0.smt2           |   0.023s |1788.0KiB|
|From_AProVE_2014__juHashMapCreateSize.jar-obl-10__p7295_safety_0.smt2                      |   0.023s |1560.0KiB|
|term-fu8ErM.smt2                                                                           |   0.023s |1564.0KiB|
|From_T2__n-21.t2_fixed__p3838_terminationG_0.smt2                                          |   0.023s |1788.0KiB|
|From_T2__pentagon.t2__p7069_edge_closing_0.smt2                                            |   0.023s |1560.0KiB|
|From_AProVE_2014__Test13Loops.jar-obl-10__p12748_edge_closing_0.smt2                       |   0.022s |1560.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p7826_safety_0.smt2               |   0.022s |1560.0KiB|
</details>


## TOP 20 RHS FILES, BY RUNTIME

<details><summary>TOP 20 RHS FILES, BY RUNTIME</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|aproveSMT1619938986991890573.smt2                                                          |   0.030s |1560.0KiB|
|From_AProVE_2014__AlternatingGrowReduceRec2.jar-obl-9__term_unfeasibility_1_0.smt2         |   0.029s |1780.0KiB|
|From_AProVE_2014__Velroyen08-narrowKonv.jar-obl-8__p14411_terminationG_0.smt2              |   0.028s |1564.0KiB|
|1361.smt2                                                                                  |   0.027s |1560.0KiB|
|From_T2__slayer-5-filtered.t2__p22746_terminationG_0.smt2                                  |   0.026s |1788.0KiB|
|From_AProVE_2014__Test6.jar-obl-13__p12864_terminationG_0.smt2                             |   0.026s |1560.0KiB|
|From_T2__n-3.t2__p4196_terminationG_0.smt2                                                 |   0.026s |1400.0KiB|
|From_T2__s1-striped.t2__p14281_safety_0.smt2                                               |   0.025s |1792.0KiB|
|1607.smt2                                                                                  |   0.025s |1560.0KiB|
|From_T2__slayer-3-new.t2__p21954_terminationG_0.smt2                                       |   0.025s |1560.0KiB|
|From_T2__ex36.t2__p25811_safety_0.smt2                                                     |   0.025s |1560.0KiB|
|aproveSMT6155317075733447430.smt2                                                          |   0.024s |1788.0KiB|
|aproveSMT1256079449125527892.smt2                                                          |   0.024s |1560.0KiB|
|From_AProVE_2014__juLinkedListCreateRemoveAll.jar-obl-11__terminationS_28_0.smt2           |   0.023s |1788.0KiB|
|From_AProVE_2014__juHashMapCreateSize.jar-obl-10__p7295_safety_0.smt2                      |   0.023s |1560.0KiB|
|term-fu8ErM.smt2                                                                           |   0.023s |1564.0KiB|
|From_T2__n-21.t2_fixed__p3838_terminationG_0.smt2                                          |   0.023s |1788.0KiB|
|From_T2__pentagon.t2__p7069_edge_closing_0.smt2                                            |   0.023s |1560.0KiB|
|From_AProVE_2014__Test13Loops.jar-obl-10__p12748_edge_closing_0.smt2                       |   0.022s |1560.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p7826_safety_0.smt2               |   0.022s |1560.0KiB|
</details>


## TOP 20 MEMORY INCREASE

<details><summary>TOP 20 MEMORY INCREASE</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 MEMORY INCREASE (RELATIVE)

<details><summary>TOP 20 MEMORY INCREASE (RELATIVE)</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 MEMORY DECREASE

<details><summary>TOP 20 MEMORY DECREASE</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 MEMORY DECREASE (RELATIVE)

<details><summary>TOP 20 MEMORY DECREASE (RELATIVE)</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 LHS FILES, BY PEAK MEMORY USAGE

<details><summary>TOP 20 LHS FILES, BY PEAK MEMORY USAGE</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|From_T2__s1-striped.t2_fixed__p10512_safety_0.smt2                                         |   0.004s |2040.0KiB|
|aproveSMT6461796824751951221.smt2                                                          |   0.005s |1864.0KiB|
|problem-006538.cvc.1.smt2                                                                  |   0.003s |1844.0KiB|
|722.smt2                                                                                   |   0.004s |1816.0KiB|
|From_T2__s1-striped.t2__p14281_safety_0.smt2                                               |   0.025s |1792.0KiB|
|From_T2__slayer-3-new.t2__p22063_safety_0.smt2                                             |   0.012s |1792.0KiB|
|From_AProVE_2014__MirrorBinTreeRec.jar-obl-9__p10900_terminationG_0.smt2                   |   0.007s |1792.0KiB|
|aproveSMT4812740542900327077.smt2                                                          |   0.007s |1792.0KiB|
|From_T2__agafp.t2__p15648_terminationG_0.smt2                                              |   0.007s |1792.0KiB|
|From_AProVE_2014__juHashMapCreateContainsKey.jar-obl-11__p31214_safety_0.smt2              |   0.005s |1792.0KiB|
|From_T2__streamserver-succeed.t2__p24825_edge_closing_0.smt2                               |   0.004s |1792.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8741_safety_0.smt2               |   0.004s |1792.0KiB|
|From_AProVE_2014__juHashMapCreateRemove.jar-obl-11__terminationS_0_0.smt2                  |   0.003s |1792.0KiB|
|From_T2__slayer-5-filtered.t2__p22746_terminationG_0.smt2                                  |   0.026s |1788.0KiB|
|aproveSMT6155317075733447430.smt2                                                          |   0.024s |1788.0KiB|
|From_AProVE_2014__juLinkedListCreateRemoveAll.jar-obl-11__terminationS_28_0.smt2           |   0.023s |1788.0KiB|
|From_T2__n-21.t2_fixed__p3838_terminationG_0.smt2                                          |   0.023s |1788.0KiB|
|From_AProVE_2014__juHashMapCreatePut.jar-obl-10__p5427_safety_0.smt2                       |   0.021s |1788.0KiB|
|From_T2__ex36.t2__p28143_safety_0.smt2                                                     |   0.021s |1788.0KiB|
|From_AProVE_2014__FlattenTree.jar-obl-9__p29513_terminationG_0.smt2                        |   0.020s |1788.0KiB|
</details>


## TOP 20 RHS FILES, BY PEAK MEMORY USAGE

<details><summary>TOP 20 RHS FILES, BY PEAK MEMORY USAGE</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|From_T2__s1-striped.t2_fixed__p10512_safety_0.smt2                                         |   0.004s |2040.0KiB|
|aproveSMT6461796824751951221.smt2                                                          |   0.005s |1864.0KiB|
|problem-006538.cvc.1.smt2                                                                  |   0.003s |1844.0KiB|
|722.smt2                                                                                   |   0.004s |1816.0KiB|
|From_T2__s1-striped.t2__p14281_safety_0.smt2                                               |   0.025s |1792.0KiB|
|From_T2__slayer-3-new.t2__p22063_safety_0.smt2                                             |   0.012s |1792.0KiB|
|From_AProVE_2014__MirrorBinTreeRec.jar-obl-9__p10900_terminationG_0.smt2                   |   0.007s |1792.0KiB|
|aproveSMT4812740542900327077.smt2                                                          |   0.007s |1792.0KiB|
|From_T2__agafp.t2__p15648_terminationG_0.smt2                                              |   0.007s |1792.0KiB|
|From_AProVE_2014__juHashMapCreateContainsKey.jar-obl-11__p31214_safety_0.smt2              |   0.005s |1792.0KiB|
|From_T2__streamserver-succeed.t2__p24825_edge_closing_0.smt2                               |   0.004s |1792.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8741_safety_0.smt2               |   0.004s |1792.0KiB|
|From_AProVE_2014__juHashMapCreateRemove.jar-obl-11__terminationS_0_0.smt2                  |   0.003s |1792.0KiB|
|From_T2__slayer-5-filtered.t2__p22746_terminationG_0.smt2                                  |   0.026s |1788.0KiB|
|aproveSMT6155317075733447430.smt2                                                          |   0.024s |1788.0KiB|
|From_AProVE_2014__juLinkedListCreateRemoveAll.jar-obl-11__terminationS_28_0.smt2           |   0.023s |1788.0KiB|
|From_T2__n-21.t2_fixed__p3838_terminationG_0.smt2                                          |   0.023s |1788.0KiB|
|From_AProVE_2014__juHashMapCreatePut.jar-obl-10__p5427_safety_0.smt2                       |   0.021s |1788.0KiB|
|From_T2__ex36.t2__p28143_safety_0.smt2                                                     |   0.021s |1788.0KiB|
|From_AProVE_2014__FlattenTree.jar-obl-9__p29513_terminationG_0.smt2                        |   0.020s |1788.0KiB|
</details>


## FULL COMPARISON

<details><summary>FULL COMPARISON</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>