Jülich crowd test runs (2026-10-07), from the Render session on the Windows desktop Protocol: engine 1189447 experiment/peds/protocol-peds-juelich.json; inputs: conv/ (engine 1d0f37d checksums), 109 runs Code: livingworlds/render d39b15a render-studio/src/render_studio/pedreplay.py, unchanged (git diff against d39b15a empty) Settings: use_groups=True, spring=True, density_aware=True, walls=True, walkable=.wkt, matched speeds; models jupedsim, socialforce, orca One pass, one process, runs in sorted order, nothing changed between runs. Not scored. Outcome: 189 of 327 model runs completed (63 runs x 3 models). 138 failed (46 runs x 3 models), all with the same error: IndexError('index 0 is out of bounds for axis 0 with size 0') in pedreplay.groups(), line 102: f = np.intersect1d(tl[:, 0], ti[:, 0])[0] Cause: group membership is transitive (union-find): a follower can be linked to the leader only through another member, and never share a frame with the leader inside the first 2 s; the offset to the leader then has no common frame. Failed by experiment: bidirectional 14/15 runs, crossing90 21/43, tjunction 11/11, bottleneck 0/40. Not adjusted, as the protocol requires. Per-run log (run, model, people, group followers, rows, seconds, status): run model people group_followers rows seconds status bidirectional__bi_corr_400_a_01 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_01 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_01 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_02 jupedsim - - - 0.5 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_02 socialforce - - - 0.5 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_02 orca - - - 0.5 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_03 jupedsim - - - 0.7 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_03 socialforce - - - 0.7 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_03 orca - - - 0.7 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_04 jupedsim - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_04 socialforce - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_04 orca - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_05 jupedsim - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_05 socialforce - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_a_05 orca - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_01 jupedsim 141 36 2626 0.3 ok bidirectional__bi_corr_400_b_01 socialforce 141 36 2712 0.7 ok bidirectional__bi_corr_400_b_01 orca 141 36 2516 1.3 ok bidirectional__bi_corr_400_b_02 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_02 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_02 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_03 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_03 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_03 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_04 jupedsim - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_04 socialforce - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_04 orca - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_05 jupedsim - - - 0.7 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_05 socialforce - - - 0.7 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_05 orca - - - 0.7 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_06 jupedsim - - - 1.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_06 socialforce - - - 1.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_06 orca - - - 1.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_07 jupedsim - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_07 socialforce - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_07 orca - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_08 jupedsim - - - 1.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_08 socialforce - - - 1.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_08 orca - - - 1.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_09 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_09 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_09 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_10 jupedsim - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_10 socialforce - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bidirectional__bi_corr_400_b_10 orca - - - 0.8 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') bottleneck__00_01a jupedsim 46 0 2360 1.0 ok bottleneck__00_01a socialforce 46 0 5196 1.6 ok bottleneck__00_01a orca 46 0 2445 7.6 ok bottleneck__00_01b jupedsim 46 17 1391 0.6 ok bottleneck__00_01b socialforce 46 17 2783 0.7 ok bottleneck__00_01b orca 46 17 1194 1.9 ok bottleneck__00_02 jupedsim 46 13 2027 0.7 ok bottleneck__00_02 socialforce 46 13 3932 0.9 ok bottleneck__00_02 orca 46 13 2145 3.5 ok bottleneck__00_03 jupedsim 46 4 1769 0.7 ok bottleneck__00_03 socialforce 46 4 3348 1.0 ok bottleneck__00_03 orca 46 4 1569 3.8 ok bottleneck__00_04a jupedsim 46 15 1831 0.6 ok bottleneck__00_04a socialforce 46 15 2751 0.7 ok bottleneck__00_04a orca 46 15 1481 2.1 ok bottleneck__00_04b jupedsim 46 13 1406 0.5 ok bottleneck__00_04b socialforce 46 13 3394 0.7 ok bottleneck__00_04b orca 46 13 1342 2.5 ok bottleneck__00_05 jupedsim 46 1 1763 0.8 ok bottleneck__00_05 socialforce 46 1 2971 1.0 ok bottleneck__00_05 orca 46 1 1359 3.3 ok bottleneck__00_06a jupedsim 22 15 297 0.0 ok bottleneck__00_06a socialforce 22 15 404 0.1 ok bottleneck__00_06a orca 22 15 288 0.1 ok bottleneck__00_06b jupedsim 23 5 430 0.1 ok bottleneck__00_06b socialforce 23 5 613 0.2 ok bottleneck__00_06b orca 23 5 393 0.4 ok bottleneck__00_07 jupedsim 46 29 842 0.2 ok bottleneck__00_07 socialforce 46 29 1416 0.4 ok bottleneck__00_07 orca 46 29 826 0.7 ok bottleneck__00_08 jupedsim 44 14 1398 0.6 ok bottleneck__00_08 socialforce 44 14 2314 0.7 ok bottleneck__00_08 orca 44 14 1220 1.8 ok bottleneck__01_01 jupedsim 46 2 1832 0.7 ok bottleneck__01_01 socialforce 46 2 3444 1.1 ok bottleneck__01_01 orca 46 2 1559 3.6 ok bottleneck__01_02 jupedsim 46 3 1815 0.7 ok bottleneck__01_02 socialforce 46 3 3793 1.2 ok bottleneck__01_02 orca 46 3 1838 4.4 ok bottleneck__01_03a jupedsim 46 0 1729 0.7 ok bottleneck__01_03a socialforce 46 0 3380 1.1 ok bottleneck__01_03a orca 46 0 1733 4.7 ok bottleneck__01_03b jupedsim 46 1 1791 0.6 ok bottleneck__01_03b socialforce 46 1 3501 1.1 ok bottleneck__01_03b orca 46 1 1721 4.1 ok bottleneck__01_04a jupedsim 46 20 2098 0.4 ok bottleneck__01_04a socialforce 46 20 3996 0.7 ok bottleneck__01_04a orca 46 20 1929 1.4 ok bottleneck__01_04b jupedsim 46 41 615 0.1 ok bottleneck__01_04b socialforce 46 41 807 0.2 ok bottleneck__01_04b orca 46 41 618 0.1 ok bottleneck__01_05 jupedsim 46 6 1352 0.6 ok bottleneck__01_05 socialforce 46 6 2264 0.7 ok bottleneck__01_05 orca 46 6 1222 2.7 ok bottleneck__01_06a jupedsim 46 1 1330 0.5 ok bottleneck__01_06a socialforce 46 1 2541 0.8 ok bottleneck__01_06a orca 46 1 1130 2.8 ok bottleneck__01_06b jupedsim 46 14 1281 0.4 ok bottleneck__01_06b socialforce 46 14 1872 0.5 ok bottleneck__01_06b orca 46 14 1184 1.6 ok bottleneck__01_06c jupedsim 46 22 894 0.3 ok bottleneck__01_06c socialforce 46 22 1291 0.4 ok bottleneck__01_06c orca 46 22 809 0.9 ok bottleneck__01_07 jupedsim 44 20 948 0.3 ok bottleneck__01_07 socialforce 44 20 1390 0.4 ok bottleneck__01_07 orca 44 20 993 1.0 ok bottleneck__01_08a jupedsim 42 30 1086 0.1 ok bottleneck__01_08a socialforce 42 30 3641 0.2 ok bottleneck__01_08a orca 42 30 974 0.4 ok bottleneck__01_08b jupedsim 42 18 1048 0.2 ok bottleneck__01_08b socialforce 42 18 2711 0.4 ok bottleneck__01_08b orca 42 18 1034 1.0 ok bottleneck__01_08c jupedsim 40 23 727 0.2 ok bottleneck__01_08c socialforce 40 23 973 0.2 ok bottleneck__01_08c orca 40 23 736 0.5 ok bottleneck__01_09 jupedsim 51 1 788 0.1 ok bottleneck__01_09 socialforce 51 1 781 0.4 ok bottleneck__01_09 orca 51 1 784 0.2 ok bottleneck__02_01 jupedsim 46 19 1542 0.5 ok bottleneck__02_01 socialforce 46 19 4395 0.8 ok bottleneck__02_01 orca 46 19 1447 1.9 ok bottleneck__02_02a jupedsim 46 31 2704 0.3 ok bottleneck__02_02a socialforce 46 31 4131 0.5 ok bottleneck__02_02a orca 46 31 2204 0.8 ok bottleneck__02_02b jupedsim 46 0 1838 0.8 ok bottleneck__02_02b socialforce 46 0 3633 1.2 ok bottleneck__02_02b orca 46 0 1846 4.7 ok bottleneck__02_03a jupedsim 46 6 1765 0.6 ok bottleneck__02_03a socialforce 46 6 3372 1.1 ok bottleneck__02_03a orca 46 6 1715 3.3 ok bottleneck__02_03b jupedsim 46 11 1647 0.7 ok bottleneck__02_03b socialforce 46 11 2919 0.9 ok bottleneck__02_03b orca 46 11 1462 2.5 ok bottleneck__02_03c jupedsim 46 0 1856 0.8 ok bottleneck__02_03c socialforce 46 0 3563 1.1 ok bottleneck__02_03c orca 46 0 1515 3.6 ok bottleneck__02_04a jupedsim 46 9 1578 0.5 ok bottleneck__02_04a socialforce 46 9 2991 0.8 ok bottleneck__02_04a orca 46 9 1303 2.4 ok bottleneck__02_04aa jupedsim 46 2 1339 0.5 ok bottleneck__02_04aa socialforce 46 2 2474 0.8 ok bottleneck__02_04aa orca 46 2 1184 2.8 ok bottleneck__02_04b jupedsim 46 14 1313 0.4 ok bottleneck__02_04b socialforce 46 14 1961 0.6 ok bottleneck__02_04b orca 46 14 1129 1.7 ok bottleneck__02_05a jupedsim 46 8 1355 0.5 ok bottleneck__02_05a socialforce 46 8 2699 0.7 ok bottleneck__02_05a orca 46 8 1214 2.4 ok bottleneck__02_05b jupedsim 46 1 1518 0.9 ok bottleneck__02_05b socialforce 46 1 2587 0.8 ok bottleneck__02_05b orca 46 1 1239 3.0 ok bottleneck__02_06 jupedsim 44 15 1159 0.3 ok bottleneck__02_06 socialforce 44 15 1952 0.6 ok bottleneck__02_06 orca 44 15 1064 1.6 ok bottleneck__02_07 jupedsim 44 2 1406 0.7 ok bottleneck__02_07 socialforce 44 2 2492 0.8 ok bottleneck__02_07 orca 44 2 1149 2.6 ok bottleneck__02_07x jupedsim 44 6 1208 0.5 ok bottleneck__02_07x socialforce 44 6 1936 0.6 ok bottleneck__02_07x orca 44 6 1008 1.9 ok crossing90__crossing_90_a_01 jupedsim - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_01 socialforce - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_01 orca - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_02 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_02 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_02 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_03 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_03 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_03 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_04 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_04 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_04 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_05 jupedsim - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_05 socialforce - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_05 orca - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_06 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_06 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_06 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_07 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_07 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_07 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_08 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_08 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_08 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_09 jupedsim 299 24 7637 1.2 ok crossing90__crossing_90_a_09 socialforce 299 24 10627 3.0 ok crossing90__crossing_90_a_09 orca 299 24 6981 6.5 ok crossing90__crossing_90_a_10 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_10 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_a_10 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_02 jupedsim 326 3 7410 1.2 ok crossing90__crossing_90_b_02 socialforce 326 3 8376 2.7 ok crossing90__crossing_90_b_02 orca 326 3 7036 4.5 ok crossing90__crossing_90_b_03 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_03 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_03 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_04 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_04 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_04 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_05 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_05 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_05 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_06 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_06 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_06 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_07 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_07 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_b_07 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_01 jupedsim 321 3 7667 1.1 ok crossing90__crossing_90_c_01 socialforce 321 3 8753 2.7 ok crossing90__crossing_90_c_01 orca 321 3 7245 5.0 ok crossing90__crossing_90_c_02 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_02 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_02 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_03 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_03 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_03 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_04 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_04 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_04 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_05 jupedsim - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_05 socialforce - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_05 orca - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_06 jupedsim - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_06 socialforce - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_06 orca - - - 0.4 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_07 jupedsim - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_07 socialforce - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_07 orca - - - 0.3 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_08 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_08 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_c_08 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') crossing90__crossing_90_d_1 jupedsim 655 0 22763 0.6 ok crossing90__crossing_90_d_1 socialforce 655 0 22763 0.6 ok crossing90__crossing_90_d_1 orca 655 0 22763 0.6 ok crossing90__crossing_90_d_2 jupedsim 606 0 20838 0.5 ok crossing90__crossing_90_d_2 socialforce 606 0 20838 0.5 ok crossing90__crossing_90_d_2 orca 606 0 20838 0.5 ok crossing90__crossing_90_d_3 jupedsim 620 0 18262 0.4 ok crossing90__crossing_90_d_3 socialforce 620 0 18262 0.4 ok crossing90__crossing_90_d_3 orca 620 0 18262 0.4 ok crossing90__crossing_90_d_5 jupedsim 625 0 23809 0.6 ok crossing90__crossing_90_d_5 socialforce 625 0 23809 0.6 ok crossing90__crossing_90_d_5 orca 625 0 23809 0.6 ok crossing90__crossing_90_d_6 jupedsim 600 0 34660 0.8 ok crossing90__crossing_90_d_6 socialforce 600 0 34660 0.8 ok crossing90__crossing_90_d_6 orca 600 0 34660 0.8 ok crossing90__crossing_90_d_7 jupedsim 623 0 41248 1.1 ok crossing90__crossing_90_d_7 socialforce 623 0 41248 1.1 ok crossing90__crossing_90_d_7 orca 623 0 41248 1.1 ok crossing90__crossing_90_d_8 jupedsim 623 0 43558 1.3 ok crossing90__crossing_90_d_8 socialforce 623 0 43558 1.2 ok crossing90__crossing_90_d_8 orca 623 0 43558 1.2 ok crossing90__crossing_90_e_1 jupedsim 600 0 26391 0.5 ok crossing90__crossing_90_e_1 socialforce 600 0 26391 0.5 ok crossing90__crossing_90_e_1 orca 600 0 26391 0.5 ok crossing90__crossing_90_e_2 jupedsim 606 0 23664 0.5 ok crossing90__crossing_90_e_2 socialforce 606 0 23664 0.5 ok crossing90__crossing_90_e_2 orca 606 0 23664 0.5 ok crossing90__crossing_90_e_3 jupedsim 599 0 22398 0.5 ok crossing90__crossing_90_e_3 socialforce 599 0 22398 0.5 ok crossing90__crossing_90_e_3 orca 599 0 22398 0.5 ok crossing90__crossing_90_e_4 jupedsim 599 0 29253 0.6 ok crossing90__crossing_90_e_4 socialforce 599 0 29253 0.6 ok crossing90__crossing_90_e_4 orca 599 0 29253 0.6 ok crossing90__crossing_90_e_5 jupedsim 602 0 34975 0.7 ok crossing90__crossing_90_e_5 socialforce 602 0 34975 0.7 ok crossing90__crossing_90_e_5 orca 602 0 34975 0.7 ok crossing90__crossing_90_e_6 jupedsim 595 0 42282 1.0 ok crossing90__crossing_90_e_6 socialforce 595 0 42282 1.0 ok crossing90__crossing_90_e_6 orca 595 0 42282 1.0 ok crossing90__crossing_90_f_1 jupedsim 606 0 62496 1.3 ok crossing90__crossing_90_f_1 socialforce 606 0 62496 1.3 ok crossing90__crossing_90_f_1 orca 606 0 62496 1.3 ok crossing90__crossing_90_f_2 jupedsim 604 0 59154 1.3 ok crossing90__crossing_90_f_2 socialforce 604 0 59154 1.3 ok crossing90__crossing_90_f_2 orca 604 0 59154 1.3 ok crossing90__crossing_90_f_3 jupedsim 599 0 96895 3.7 ok crossing90__crossing_90_f_3 socialforce 599 0 96895 3.7 ok crossing90__crossing_90_f_3 orca 599 0 96895 3.7 ok crossing90__crossing_90_g_1 jupedsim 601 0 80393 2.4 ok crossing90__crossing_90_g_1 socialforce 601 0 80393 2.4 ok crossing90__crossing_90_g_1 orca 601 0 80393 2.4 ok crossing90__crossing_90_g_2 jupedsim 599 0 87797 2.3 ok crossing90__crossing_90_g_2 socialforce 599 0 87797 2.3 ok crossing90__crossing_90_g_2 orca 599 0 87797 2.3 ok crossing90__crossing_90_g_3 jupedsim 590 0 51678 1.2 ok crossing90__crossing_90_g_3 socialforce 590 0 51678 1.2 ok crossing90__crossing_90_g_3 orca 590 0 51678 1.2 ok tjunction__ko-240-050-240 jupedsim - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-050-240 socialforce - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-050-240 orca - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-060-240 jupedsim - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-060-240 socialforce - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-060-240 orca - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-080-240 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-080-240 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-080-240 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-100-240 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-100-240 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-100-240 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-120-240 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-120-240 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-120-240 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-150-240 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-150-240 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-150-240 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-240-240 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-240-240 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-240-240-240 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-050-300 jupedsim - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-050-300 socialforce - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-050-300 orca - - - 0.0 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-080-300 jupedsim - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-080-300 socialforce - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-080-300 orca - - - 0.1 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-120-300 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-120-300 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-120-300 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-150-300 jupedsim - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-150-300 socialforce - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0') tjunction__ko-300-150-300 orca - - - 0.2 FAILED: IndexError('index 0 is out of bounds for axis 0 with size 0')