Comparing data and data


# SUMMARY
- LHS tests = 2313
- RHS tests = 2313
- LHS success = 0  (0.0%)
- RHS success = 0  (0.0%)


## METADATA

<details><summary>METADATA</summary>

# LHS
<pre>
Ramon benchmark for Z3
-
Job description: 
Job tag: smt_qfnia-threads-4-global_bb_pos_neg_DEBUG4
Runner: rise-runner-2
Z3 repo: ilanashapiro/z3
Z3 commit: dfd5a818585f68f69d1946719ac97774604c17ec
Z3 branch: smts_tree_algorithms_bugfix
Z3 options: "-T:60 -v:0 smt.threads=4 tactic.default_tactic=smt smt.auto_config=false smt_parallel.num_global_bb_threads=2"
Z3 inputs: inputs/QF_NIA_small
Z3 commit message: fix cancellation to unknown status

</pre>
# RHS
<pre>
Ramon benchmark for Z3
-
Job description: 
Job tag: smt_qfnia-threads-4-global_bb_pos_neg_DEBUG4
Runner: rise-runner-2
Z3 repo: ilanashapiro/z3
Z3 commit: dfd5a818585f68f69d1946719ac97774604c17ec
Z3 branch: smts_tree_algorithms_bugfix
Z3 options: "-T:60 -v:0 smt.threads=4 tactic.default_tactic=smt smt.auto_config=false smt_parallel.num_global_bb_threads=2"
Z3 inputs: inputs/QF_NIA_small
Z3 commit message: fix cancellation to unknown status

</pre>
</details>


## TOP 20 RUNTIME INCREASE

<details><summary>TOP 20 RUNTIME INCREASE</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 RUNTIME INCREASE (RELATIVE)

<details><summary>TOP 20 RUNTIME INCREASE (RELATIVE)</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 RUNTIME DECREASE

<details><summary>TOP 20 RUNTIME DECREASE</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 RUNTIME DECREASE (RELATIVE)

<details><summary>TOP 20 RUNTIME DECREASE (RELATIVE)</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 LHS FILES, BY RUNTIME

<details><summary>TOP 20 LHS FILES, BY RUNTIME</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|aproveSMT4553505495713257009.smt2                                                          |   0.055s |2004.0KiB|
|From_AProVE_2014__mirrorInterv_rec.jar-obl-8__p10946_edge_closing_0.smt2                   |   0.055s |2004.0KiB|
|From_T2__zlib-crc32-BYFOUR.c.t2_fixed__p26393_terminationG_0.smt2                          |   0.055s |2004.0KiB|
|From_T2__mc91test.t2__p3367_terminationG_0.smt2                                            |   0.055s |2000.0KiB|
|From_T2__simple.t2__p21460_terminationG_0.smt2                                             |   0.055s |2008.0KiB|
|From_T2__bakery.t2__p17134_terminationG_0.smt2                                             |   0.055s |2000.0KiB|
|From_T2__n-3.t2__p4212_terminationG_0.smt2                                                 |   0.055s |1996.0KiB|
|From_T2__bakery.t2__p17150_terminationG_0.smt2                                             |   0.055s |2228.0KiB|
|From_AProVE_2014__juHashMapCreateClear.jar-obl-11__p30674_safety_0.smt2                    |   0.055s |2228.0KiB|
|From_AProVE_2014__juHashMapCreatePut.jar-obl-10__p6223_safety_0.smt2                       |   0.054s |2004.0KiB|
|From_T2__s1-striped.t2_fixed__p11249_safety_0.smt2                                         |   0.054s |2228.0KiB|
|From_T2__walk.t2__p25613_edge_closing_0.smt2                                               |   0.054s |2000.0KiB|
|From_AProVE_2014__sumGeneric_rec.jar-obl-8__p12350_terminationG_0.smt2                     |   0.054s |2000.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8741_safety_0.smt2               |   0.054s |2004.0KiB|
|From_AProVE_2014__juHashMapCreateIteratorEntryLoop.jar-obl-12__p3295_safety_0.smt2         |   0.054s |2228.0KiB|
|From_T2__svdcmp.c.i.svdcmp.pl.t2.fixed.t2__terminationS_37_0.smt2                          |   0.052s |2000.0KiB|
|From_T2__janne_complex.t2_fixed__p1996_terminationG_0.smt2                                 |   0.051s |2004.0KiB|
|From_AProVE_2014__DivTernary.jar-obl-10__terminationS_14_0.smt2                            |   0.046s |2000.0KiB|
|From_T2__n-3a.t2_fixed__p4168_edge_closing_0.smt2                                          |   0.042s |2228.0KiB|
|From_T2__consts4nt.t2_fixed__p18242_terminationG_0.smt2                                    |   0.041s |2000.0KiB|
</details>


## TOP 20 RHS FILES, BY RUNTIME

<details><summary>TOP 20 RHS FILES, BY RUNTIME</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|aproveSMT4553505495713257009.smt2                                                          |   0.055s |2004.0KiB|
|From_AProVE_2014__mirrorInterv_rec.jar-obl-8__p10946_edge_closing_0.smt2                   |   0.055s |2004.0KiB|
|From_T2__zlib-crc32-BYFOUR.c.t2_fixed__p26393_terminationG_0.smt2                          |   0.055s |2004.0KiB|
|From_T2__mc91test.t2__p3367_terminationG_0.smt2                                            |   0.055s |2000.0KiB|
|From_T2__simple.t2__p21460_terminationG_0.smt2                                             |   0.055s |2008.0KiB|
|From_T2__bakery.t2__p17134_terminationG_0.smt2                                             |   0.055s |2000.0KiB|
|From_T2__n-3.t2__p4212_terminationG_0.smt2                                                 |   0.055s |1996.0KiB|
|From_T2__bakery.t2__p17150_terminationG_0.smt2                                             |   0.055s |2228.0KiB|
|From_AProVE_2014__juHashMapCreateClear.jar-obl-11__p30674_safety_0.smt2                    |   0.055s |2228.0KiB|
|From_AProVE_2014__juHashMapCreatePut.jar-obl-10__p6223_safety_0.smt2                       |   0.054s |2004.0KiB|
|From_T2__s1-striped.t2_fixed__p11249_safety_0.smt2                                         |   0.054s |2228.0KiB|
|From_T2__walk.t2__p25613_edge_closing_0.smt2                                               |   0.054s |2000.0KiB|
|From_AProVE_2014__sumGeneric_rec.jar-obl-8__p12350_terminationG_0.smt2                     |   0.054s |2000.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8741_safety_0.smt2               |   0.054s |2004.0KiB|
|From_AProVE_2014__juHashMapCreateIteratorEntryLoop.jar-obl-12__p3295_safety_0.smt2         |   0.054s |2228.0KiB|
|From_T2__svdcmp.c.i.svdcmp.pl.t2.fixed.t2__terminationS_37_0.smt2                          |   0.052s |2000.0KiB|
|From_T2__janne_complex.t2_fixed__p1996_terminationG_0.smt2                                 |   0.051s |2004.0KiB|
|From_AProVE_2014__DivTernary.jar-obl-10__terminationS_14_0.smt2                            |   0.046s |2000.0KiB|
|From_T2__n-3a.t2_fixed__p4168_edge_closing_0.smt2                                          |   0.042s |2228.0KiB|
|From_T2__consts4nt.t2_fixed__p18242_terminationG_0.smt2                                    |   0.041s |2000.0KiB|
</details>


## TOP 20 MEMORY INCREASE

<details><summary>TOP 20 MEMORY INCREASE</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 MEMORY INCREASE (RELATIVE)

<details><summary>TOP 20 MEMORY INCREASE (RELATIVE)</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 MEMORY DECREASE

<details><summary>TOP 20 MEMORY DECREASE</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 MEMORY DECREASE (RELATIVE)

<details><summary>TOP 20 MEMORY DECREASE (RELATIVE)</summary>

|FILE                                                                                        |MEM_L         |MEM_R         |DIFF            |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>


## TOP 20 LHS FILES, BY PEAK MEMORY USAGE

<details><summary>TOP 20 LHS FILES, BY PEAK MEMORY USAGE</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|From_T2__n-40.t2__p4288_terminationG_0.smt2                                                |   0.010s |2364.0KiB|
|73.smt2                                                                                    |   0.010s |2332.0KiB|
|From_T2__s1.t2_fixed__p16158_safety_0.smt2                                                 |   0.012s |2304.0KiB|
|Stroeder_15__svcomp_ex2.c__p25847_terminationG_0.smt2                                      |   0.014s |2272.0KiB|
|From_AProVE_2014__juHashMapCreateContainsKey.jar-obl-11__p31120_safety_0.smt2              |   0.012s |2256.0KiB|
|From_T2__s1-striped.t2_fixed__p11010_safety_0.smt2                                         |   0.007s |2256.0KiB|
|From_T2__n-21.t2__p3904_terminationG_0.smt2                                                |   0.006s |2252.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8988_safety_0.smt2               |   0.005s |2252.0KiB|
|From_AProVE_2014__TaylorSeriesRec.jar-obl-13__terminationS_9_0.smt2                        |   0.020s |2248.0KiB|
|aproveSMT7315824316795347455.smt2                                                          |   0.013s |2248.0KiB|
|From_T2__slayer-3-new.t2__p21970_terminationG_0.smt2                                       |   0.008s |2248.0KiB|
|From_T2__hqr.t2_fixed__term_unfeasibility_1_0.smt2                                         |   0.007s |2248.0KiB|
|From_T2__rlft3.t2__p9177_terminationG_0.smt2                                               |   0.031s |2240.0KiB|
|From_AProVE_2014__juHashMapCreateSize.jar-obl-10__p7143_safety_0.smt2                      |   0.010s |2240.0KiB|
|From_T2__broydn.t2_fixed__term_unfeasibility_3_0.smt2                                      |   0.010s |2236.0KiB|
|From_T2__s1.t2__p18399_safety_0.smt2                                                       |   0.006s |2236.0KiB|
|From_T2__destroy_seg_leak.t2_fixed__p18843_safety_0.smt2                                   |   0.035s |2232.0KiB|
|From_T2__agafp.t2__terminationQ_12_0.smt2                                                  |   0.021s |2232.0KiB|
|58.smt2                                                                                    |   0.018s |2232.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8544_safety_0.smt2               |   0.017s |2232.0KiB|
</details>


## TOP 20 RHS FILES, BY PEAK MEMORY USAGE

<details><summary>TOP 20 RHS FILES, BY PEAK MEMORY USAGE</summary>

|FILE                                                                                       |TIME     |MEM        |
|------------|----------:|---------:|
|From_T2__n-40.t2__p4288_terminationG_0.smt2                                                |   0.010s |2364.0KiB|
|73.smt2                                                                                    |   0.010s |2332.0KiB|
|From_T2__s1.t2_fixed__p16158_safety_0.smt2                                                 |   0.012s |2304.0KiB|
|Stroeder_15__svcomp_ex2.c__p25847_terminationG_0.smt2                                      |   0.014s |2272.0KiB|
|From_AProVE_2014__juHashMapCreateContainsKey.jar-obl-11__p31120_safety_0.smt2              |   0.012s |2256.0KiB|
|From_T2__s1-striped.t2_fixed__p11010_safety_0.smt2                                         |   0.007s |2256.0KiB|
|From_T2__n-21.t2__p3904_terminationG_0.smt2                                                |   0.006s |2252.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8988_safety_0.smt2               |   0.005s |2252.0KiB|
|From_AProVE_2014__TaylorSeriesRec.jar-obl-13__terminationS_9_0.smt2                        |   0.020s |2248.0KiB|
|aproveSMT7315824316795347455.smt2                                                          |   0.013s |2248.0KiB|
|From_T2__slayer-3-new.t2__p21970_terminationG_0.smt2                                       |   0.008s |2248.0KiB|
|From_T2__hqr.t2_fixed__term_unfeasibility_1_0.smt2                                         |   0.007s |2248.0KiB|
|From_T2__rlft3.t2__p9177_terminationG_0.smt2                                               |   0.031s |2240.0KiB|
|From_AProVE_2014__juHashMapCreateSize.jar-obl-10__p7143_safety_0.smt2                      |   0.010s |2240.0KiB|
|From_T2__broydn.t2_fixed__term_unfeasibility_3_0.smt2                                      |   0.010s |2236.0KiB|
|From_T2__s1.t2__p18399_safety_0.smt2                                                       |   0.006s |2236.0KiB|
|From_T2__destroy_seg_leak.t2_fixed__p18843_safety_0.smt2                                   |   0.035s |2232.0KiB|
|From_T2__agafp.t2__terminationQ_12_0.smt2                                                  |   0.021s |2232.0KiB|
|58.smt2                                                                                    |   0.018s |2232.0KiB|
|From_AProVE_2014__juLinkedListCreateAddAllAt.jar-obl-17__p8544_safety_0.smt2               |   0.017s |2232.0KiB|
</details>


## FULL COMPARISON

<details><summary>FULL COMPARISON</summary>

|FILE                                                                                        |TIME_L     |TIME_R     |DIFF(s)    |DIFF(%)|
|-------------|-------------:|-------------:|--------------:|------------:|
</details>