Leaderboards for Link Prediction
Click the column corresponding to the metric to sort.
Reddit
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9760 ± 0.0006 |
0.9514 ± 0.0045 |
0.9488 ± 0.0043 |
0.9381 ± 0.0090 |
3.4 |
RTX 4090 (24GB) |
1-May-23 |
|
[2019] DyRep |
0.9803 ± 0.0005 |
0.9583 ± 0.0004 |
0.9549 ± 0.0029 |
0.9525 ± 0.0050 |
4.1 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGN |
0.9871 ± 0.0001 |
0.9760 ± 0.0002 |
0.9742 ± 0.0004 |
0.9811 ± 0.0004 |
92.2 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGAT |
0.9810 ± 0.0002 |
0.9651 ± 0.0002 |
0.9639 ± 0.0004 |
0.9597 ± 0.0043 |
398.3 |
RTX 4090 (24GB) |
1-May-23 |
|
[2021] CAWN |
0.9891 ± 0.0000 |
0.9869 ± 0.0000 |
0.9848 ± 0.0002 |
0.9952 ± 0.0016 |
10,896.8 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NeurTW |
0.9841 ± 0.0016 |
0.9802 ± 0.0011 |
0.9789 ± 0.0017 |
0.9875 ± 0.0004 |
5.7 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NAT |
0.9854 ± 0.002 |
0.9906 ± 0.0034 |
0.9949 ± 0.0017 |
0.9954 ± 0.0011 |
38.6 |
RTX 4090 (24GB) |
1-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9718 ± 0.0022 |
0.9427 ± 0.0118 |
0.9399 ± 0.0112 |
0.9199 ± 0.0167 |
3.4 |
RTX 4090 (24GB) |
1-May-23 |
|
[2019] DyRep |
0.9808 ± 0.0006 |
0.9582 ± 0.0003 |
0.9552 ± 0.0027 |
0.9384 ± 0.0064 |
4.1 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGN |
0.9874 ± 0.0002 |
0.9767 ± 0.0003 |
0.9749 ± 0.0006 |
0.9727 ± 0.0004 |
92.2 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGAT |
0.9822 ± 0.0003 |
0.9667 ± 0.0003 |
0.9659 ± 0.0004 |
0.9523 ± 0.0056 |
398.3 |
RTX 4090 (24GB) |
1-May-23 |
|
[2021] CAWN |
0.9904 ± 0.0001 |
0.9889 ± 0.0001 |
0.9871 ± 0.0003 |
0.9958 ± 0.0017 |
10,896.8 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NeurTW |
0.9855 ± 0.0013 |
0.9821 ± 0.0006 |
0.9810 ± 0.0015 |
0.9890 ± 0.0003 |
5.7 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NAT |
0.9868 ± 0.0017 |
0.9912 ± 0.0027 |
0.9947 ± 0.0014 |
0.9951 ± 0.0005 |
38.6 |
RTX 4090 (24GB) |
1-May-23 |
Wikipedia
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9505 ± 0.0032 |
0.9305 ± 0.0020 |
0.9084 ± 0.0043 |
0.9349 ± 0.0051 |
9.37 |
RTX 4090 (24GB) |
1-May-23 |
|
[2019] DyRep |
0.9426 ± 0.0007 |
0.9099 ± 0.0031 |
0.8821 ± 0.0031 |
0.9261 ± 0.0030 |
10.02 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGN |
0.9846 ± 0.0003 |
0.9781 ± 0.0005 |
0.9703 ± 0.0008 |
0.9858 ± 0.0007 |
12.17 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGAT |
0.9509 ± 0.0017 |
0.9343 ± 0.0031 |
0.9178 ± 0.0023 |
0.9580 ± 0.0039 |
109.24 |
RTX 4090 (24GB) |
1-May-23 |
|
[2021] CAWN |
0.9889 ± 0.0 |
0.9890 ± 0.0003 |
0.9886 ± 0.0002 |
0.9934 ± 0.0005 |
270.83 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NeurTW |
0.9912 ± 0.0001 |
0.9904 ± 0.0002 |
0.9878 ± 0.0002 |
0.9960 ± 0.0001 |
4,388.59 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NAT |
0.9786 ± 0.0035 |
0.9962 ± 0.0026 |
0.9963 ± 0.0021 |
0.9984 ± 0.0008 |
6.15 |
RTX 4090 (24GB) |
1-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9471 ± 0.0056 |
0.9316 ± 0.0049 |
0.9127 ± 0.0078 |
0.9307 ± 0.0060 |
9.37 |
RTX 4090 (24GB) |
1-May-23 |
|
[2019] DyRep |
0.9464 ± 0.0010 |
0.9181 ± 0.0037 |
0.8947 ± 0.0040 |
0.9329 ± 0.0028 |
10.02 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGN |
0.9852 ± 0.0003 |
0.9791 ± 0.0004 |
0.9724 ± 0.0008 |
0.9822 ± 0.0009 |
12.17 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGAT |
0.9536 ± 0.0022 |
0.9389 ± 0.0035 |
0.9223 ± 0.0021 |
0.9592 ± 0.0039 |
109.24 |
RTX 4090 (24GB) |
1-May-23 |
|
[2021] CAWN |
0.9906 ± 0.0001 |
0.9903 ± 0.0002 |
0.9901 ± 0.0002 |
0.9941 ± 0.0004 |
270.83 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NeurTW |
0.9918 ± 0.0001 |
0.9912 ± 0.0004 |
0.9884 ± 0.0007 |
0.9963 ± 0.0003 |
4,388.59 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NAT |
0.9819 ± 0.0026 |
0.9962 ± 0.0021 |
0.9959 ± 0.0018 |
0.9979 ± 0.0009 |
6.15 |
RTX 4090 (24GB) |
1-May-23 |
MOOC
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7899 ± 0.0208 |
0.7779 ± 0.0575 |
0.7910 ± 0.0475 |
0.7065 ± 0.0165 |
30.19 |
RTX 4090 (24GB) |
1-May-23 |
|
[2019] DyRep |
0.8243 ± 0.0323 |
0.8269 ± 0.0182 |
0.8274 ± 0.0132 |
0.7217 ± 0.0178 |
33.54 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGN |
0.8999 ± 0.0213 |
0.8869 ± 0.0249 |
0.8808 ± 0.0326 |
0.8762 ± 0.0038 |
41.48 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGAT |
0.7391 ± 0.0056 |
0.7370 ± 0.006 |
0.7438 ± 0.0063 |
0.7403 ± 0.0057 |
256.26 |
RTX 4090 (24GB) |
1-May-23 |
|
[2021] CAWN |
0.9459 ± 0.0008 |
0.9481 ± 0.0006 |
0.9490 ± 0.0016 |
0.9422 ± 0.0003 |
1,913.38 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NeurTW |
0.8071 ± 0.0193 |
0.8045 ± 0.0224 |
0.8052 ± 0.0244 |
0.8048 ± 0.0087 |
13,497.27 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NAT |
0.7568 ± 0.0305 |
0.7325 ± 0.0433 |
0.7487 ± 0.0459 |
0.6562 ± 0.0287 |
16.48 |
RTX 4090 (24GB) |
1-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7364 ± 0.0370 |
0.7282 ± 0.0686 |
0.7366 ± 0.5977 |
0.6623 ± 0.0189 |
9.37 |
RTX 4090 (24GB) |
1-May-23 |
|
[2019] DyRep |
0.7933 ± 0.0348 |
0.7985 ± 0..0153 |
0.8011 ± 0.0092 |
0.7135 ± 0.0148 |
10.02 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGN |
0.8830 ± 0.0242 |
0.8726 ± 0.0267 |
0.8669 ± 0.0328 |
0.8651 ± 0.0059 |
12.17 |
RTX 4090 (24GB) |
1-May-23 |
|
[2020] TGAT |
0.7185 ± 0.0051 |
0.7204 ± 0.0055 |
0.7263 ± 0.0059 |
0.7239 ± 0.0052 |
109.24 |
RTX 4090 (24GB) |
1-May-23 |
|
[2021] CAWN |
0.9369 ± 0.0009 |
0.9394 ± 0.0005 |
0.9408 ± 0.0022 |
0.9350 ± 0.0009 |
270.83 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NeurTW |
0.7943 ± 0.0248 |
0.7903 ± 0.0307 |
0.7907 ± 0.0336 |
0.7871 ± 0.0221 |
4,388.59 |
RTX 4090 (24GB) |
1-May-23 |
|
[2022] NAT |
0.7537 ± 0.0191 |
0.7474 ± 0.0214 |
0.7677 ± 0.0175 |
0.6654 ± 0.0155 |
6.15 |
RTX 4090 (24GB) |
1-May-23 |
LastFM
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.6766 ± 0.0590 |
0.8011 ± 0.0344 |
0.7305 ± 0.0051 |
0.8852 ± 0.0090 |
29.42 |
RTX 4090 (24GB) |
2-May-23 |
|
[2019] DyRep |
0.6793 ± 0.0553 |
0.7990 ± 0.0444 |
0.6980 ± 0.0364 |
0.8683 ± 0.0160 |
39.61 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGN |
0.7743 ± 0.0256 |
0.8284 ± 0.0142 |
0.7630 ± 0.0231 |
0.8754 ± 0.0011 |
45.98 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGAT |
0.5094 ± 0.0071 |
0.5196 ± 0.0144 |
0.5189 ± 0.003 |
0.5092 ± 0.0333 |
882.36 |
RTX 4090 (24GB) |
2-May-23 |
|
[2021] CAWN |
0.8746 ± 0.0013 |
0.9082 ± 0.0015 |
0.8678 ± 0.0030 |
0.9697 ± 0.0002 |
5,527.12 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NeurTW |
0.8390 ± 0.0 |
0.8840 ± 0.0 |
0.8311 ± 0.0 |
0.9628 ± 0.0 |
51,007.30 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NAT |
0.8536 ± 0.0027 |
0.9139 ± 0.0038 |
0.9144 ± 0.0013 |
0.9743 ± 0.0015 |
51.95 |
RTX 4090 (24GB) |
2-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.6762 ± 0.0678 |
0.8057 ± 0.0424 |
0.7448 ± 0.0034 |
0.8558 ± 0.0110 |
29.42 |
RTX 4090 (24GB) |
2-May-23 |
|
[2019] DyRep |
0.6736 ± 0.0768 |
0.7956 ± 0.0631 |
0.7024 ± 0.0532 |
0.8388 ± 0.0209 |
39.61 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGN |
0.7694 ± 0.0276 |
0.8261 ± 0.0145 |
0.7661 ± 0.0232 |
0.8121 ± 0.0046 |
45.98 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGAT |
0.5375 ± 0.0044 |
0.5454 ± 0.0094 |
0.5447 ± 0.0023 |
0.5360 ± 0.0217 |
882.36 |
RTX 4090 (24GB) |
2-May-23 |
|
[2021] CAWN |
0.8946 ± 0.0006 |
0.9225 ± 0.0009 |
0.8906 ± 0.0021 |
0.9716 ± 0.0008 |
5,527.12 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NeurTW |
0.8405 ± 0.0 |
0.8842 ± 0.0 |
0.8350 ± 0.0 |
0.9585 ± 0.0 |
51,007.30 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NAT |
0.8729 ± 0.0022 |
0.9235 ± 0.0028 |
0.9235 ± 0.001 |
0.9722 ± 0.0013 |
51.95 |
RTX 4090 (24GB) |
2-May-23 |
Enron
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.8293 ± 0.0148 |
0.8038 ± 0.0223 |
0.7859 ± 0.0134 |
0.6800 ± 0.0017 |
2.41 |
RTX 4090 (24GB) |
2-May-23 |
|
[2019] DyRep |
0.7986 ± 0.0358 |
0.7120 ± 0.0600 |
0.6915 ± 0.0650 |
0.6571 ± 0.0521 |
3.45 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGN |
0.8621 ± 0.0173 |
0.8159 ± 0.0231 |
0.8100 ± 0.0204 |
0.7644 ± 0.0179 |
4.13 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGAT |
0.6161 ± 0.0214 |
0.5529 ± 0.015 |
0.5589 ± 0.0235 |
0.5310 ± 0.0179 |
92.24 |
RTX 4090 (24GB) |
2-May-23 |
|
[2021] CAWN |
0.9159 ± 0.0032 |
0.9162 ± 0.0016 |
0.9185 ± 0.003 |
0.9609 ± 0.0051 |
398.38 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NeurTW |
0.8956 ± 0.0045 |
0.9051 ± 0.0027 |
0.9007 ± 0.0039 |
0.9387 ± 0.0000 |
10,896.81 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NAT |
0.9212 ± 0.0029 |
0.9520 ± 0.0057 |
0.9491 ± 0.0079 |
0.9687 ± 0.0051 |
5.70 |
RTX 4090 (24GB) |
2-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7841 ± 0.0254 |
0.7640 ± 0.0310 |
0.7526 ± 0.0158 |
0.6525 ± 0.0146 |
2.41 |
RTX 4090 (24GB) |
2-May-23 |
|
[2019] DyRep |
0.7648 ± 0.0418 |
0.6883 ± 0.0635 |
0.6742 ± 0.0632 |
0.6312 ± 0.0449 |
3.45 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGN |
0.8472 ± 0.0173 |
0.7982 ± 0.0237 |
0.7918 ± 0.0209 |
0.7391 ± 0.0196 |
4.13 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGAT |
0.6063 ± 0.0194 |
0.5661 ± 0.0134 |
0.5729 ± 0.0189 |
0.538 ± 0.0093 |
92.24 |
RTX 4090 (24GB) |
2-May-23 |
|
[2021] CAWN |
0.9142 ± 0.0052 |
0.9160 ± 0.001 |
0.9168 ± 0.0061 |
0.9556 ± 0.0055 |
398.38 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NeurTW |
0.8847 ± 0.0079 |
0.8940 ± 0.0025 |
0.8925 ± 0.0090 |
0.9358 ± 0.0008 |
10,896.81 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NAT |
0.9044 ± 0.0036 |
0.9308 ± 0.0085 |
0.9319 ± 0.0092 |
0.9503 ± 0.0079 |
5.70 |
RTX 4090 (24GB) |
2-May-23 |
SocialEvo
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.8666 ± 0.0233 |
0.8963 ± 0.0228 |
0.8953 ± 0.0303 |
0.6484 ± 0.0491 |
27.77 |
RTX 4090 (24GB) |
2-May-23 |
|
[2019] DyRep |
0.9020 ± 0.0026 |
0.9158 ± 0.0039 |
0.9182 ± 0.0050 |
0.7740 ± 0.0215 |
42.57 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGN |
0.9520 ± 0.0003 |
0.9244 ± 0.0084 |
0.9257 ± 0.0086 |
0.8791 ± 0.0045 |
51.35 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGAT |
0.7851 ± 0.0047 |
0.6748 ± 0.0021 |
0.6840 ± 0.0034 |
0.4659 ± 0.0068 |
1,544.52 |
RTX 4090 (24GB) |
2-May-23 |
|
[2021] CAWN |
0.9337 ± 0.0003 |
0.9298 ± 0.0002 |
0.9155 ± 0.0002 |
0.9318 ± 0.0003 |
12,292.31 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NeurTW |
null |
null |
null |
null |
null |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NAT |
0.9202 ± 0.0065 |
0.896 ± 0.0164 |
0.8793 ± 0.0318 |
0.9275 ± 0.0471 |
84.72 |
RTX 4090 (24GB) |
2-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7982 ± 0.0476 |
0.8527 ± 0.0303 |
0.8521 ± 0.0403 |
0.5958 ± 0.0391 |
27.77 |
RTX 4090 (24GB) |
2-May-23 |
|
[2019] DyRep |
0.8816 ± 0.0042 |
0.8954 ± 0.0034 |
0.8999 ± 0.0046 |
0.7312 ± 0.0103 |
42.57 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGN |
0.9325 ± 0.0006 |
0.8944 ± 0.0102 |
0.8972 ± 0.0107 |
0.8268 ± 0.003 |
51.35 |
RTX 4090 (24GB) |
2-May-23 |
|
[2020] TGAT |
0.7724 ± 0.0052 |
0.6497 ± 0.004 |
0.6578 ± 0.0041 |
0.5096 ± 0.0097 |
1,544.52 |
RTX 4090 (24GB) |
2-May-23 |
|
[2021] CAWN |
0.9188 ± 0.0011 |
0.9118 ± 0.0003 |
0.8830 ± 0.0008 |
0.9150 ± 0.0013 |
12,292.31 |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NeurTW |
null |
null |
null |
null |
null |
RTX 4090 (24GB) |
2-May-23 |
|
[2022] NAT |
0.8989 ± 0.0096 |
0.8682 ± 0.0324 |
0.8437 ± 0.0569 |
0.9112 ± 0.0563 |
84.72 |
RTX 4090 (24GB) |
2-May-23 |
UCI
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
JODIE |
0.8786 ± 0.0017 |
0.7517 ± 0.0059 |
0.7139 ± 0.0112 |
0.6393 ± 0.0158 |
1.89 |
RTX 4090 (24GB) |
3-May-23 |
|
DyRep |
0.5086 ± 0.0651 |
0.4297 ± 0.0428 |
0.4259 ± 0.0397 |
0.4771 ± 0.0100 |
2.49 |
RTX 4090 (24GB) |
3-May-23 |
|
TGN |
0.8875 ± 0.0161 |
0.8083 ± 0.0237 |
0.8015 ± 0.0269 |
0.8051 ± 0.021 |
2.72 |
RTX 4090 (24GB) |
3-May-23 |
|
TGAT |
0.7998 ± 0.0052 |
0.7024 ± 0.0048 |
0.6842 ± 0.0078 |
0.7680 ± 0.0041 |
57.49 |
RTX 4090 (24GB) |
3-May-23 |
|
CAWN |
0.9189 ± 0.0017 |
0.9177 ± 0.0015 |
0.9176 ± 0.0028 |
0.9245 ± 0.0027 |
121.41 |
RTX 4090 (24GB) |
3-May-23 |
|
NeurTW |
0.9670 ± 0.0031 |
0.9686 ± 0.0031 |
0.9696 ± 0.0039 |
0.9716 ± 0.0016 |
3,801.79 |
RTX 4090 (24GB) |
3-May-23 |
|
NAT |
0.9076 ± 0.0116 |
0.9622 ± 0.0167 |
0.9748 ± 0.0163 |
0.9472 ± 0.0262 |
2.90 |
RTX 4090 (24GB) |
3-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.8436 ± 0.0110 |
0.7298 ± 0.0152 |
0.6891 ± 0.0166 |
0.6249 ± 0.0198 |
1.89 |
RTX 4090 (24GB) |
3-May-23 |
|
[2019] DyRep |
0.4913 ± 0.0367 |
0.4606 ± 0.0209 |
0.4574 ± 0.0207 |
0.5062 ± 0.0032 |
2.49 |
RTX 4090 (24GB) |
3-May-23 |
|
[2020] TGN |
0.8914 ± 0.0138 |
0.8306 ± 0.0177 |
0.8243 ± 0.0205 |
0.8393 ± 0.0155 |
2.72 |
RTX 4090 (24GB) |
3-May-23 |
|
[2020] TGAT |
0.7790 ± 0.0052 |
0.7040 ± 0.0046 |
0.6826 ± 0.0084 |
0.7758 ± 0.0033 |
57.49 |
RTX 4090 (24GB) |
3-May-23 |
|
[2021] CAWN |
0.9425 ± 0.001 |
0.9421 ± 0.0012 |
0.9414 ± 0.002 |
0.9488 ± 0.0012 |
121.41 |
RTX 4090 (24GB) |
3-May-23 |
|
[2022] NeurTW |
0.9702 ± 0.0021 |
0.9720 ± 0.0024 |
0.9732 ± 0.0040 |
0.9736 ± 0.0008 |
3,801.79 |
RTX 4090 (24GB) |
3-May-23 |
|
[2022] NAT |
0.9253 ± 0.0083 |
0.9658 ± 0.0125 |
0.9768 ± 0.0127 |
0.9518 ± 0.0211 |
2.90 |
RTX 4090 (24GB) |
3-May-23 |
CollegeMsg
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.5730 ± 0.0690 |
0.5097 ± 0.0306 |
0.5168 ± 0.0360 |
0.5320 ± 0.0269 |
1.87 |
RTX 4090 (24GB) |
3-May-23 |
|
[2019] DyRep |
0.5382 ± 0.0058 |
0.4838 ± 0.0116 |
0.4808 ± 0.0279 |
0.5269 ± 0.0049 |
2.42 |
RTX 4090 (24GB) |
3-May-23 |
|
[2020] TGN |
0.8419 ± 0.084 |
0.7770 ± 0.0522 |
0.7725 ± 0.0365 |
0.7969 ± 0.0111 |
2.85 |
RTX 4090 (24GB) |
3-May-23 |
|
[2020] TGAT |
0.8084 ± 0.0032 |
0.715 ± 0.0007 |
0.7012 ± 0.005 |
0.7832 ± 0.0026 |
45.80 |
RTX 4090 (24GB) |
3-May-23 |
|
[2021] CAWN |
0.9156 ± 0.004 |
0.9163 ± 0.0038 |
0.9166 ± 0.0032 |
0.9304 ± 0.0024 |
111.96 |
RTX 4090 (24GB) |
3-May-23 |
|
[2022] NeurTW |
0.9698 ± 0.0 |
0.9726 ± 0.0002 |
0.968 ± 0.0018 |
0.9762 ± 0.0008 |
2,097.39 |
RTX 4090 (24GB) |
3-May-23 |
|
[2022] NAT |
0.9059 ± 0.0122 |
0.9603 ± 0.0173 |
0.9725 ± 0.0189 |
0.9404 ± 0.0371 |
2.83 |
RTX 4090 (24GB) |
3-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.5276 ± 0.0493 |
0.4960 ± 0.0193 |
0.5000 ± 0.0227 |
0.5212 ± 0.0244 |
1.87 |
RTX 4090 (24GB) |
3-May-23 |
|
[2019] DyRep |
0.5070 ± 0.0049 |
0.4858 ± 0.0051 |
0.4834 ± 0.0177 |
0.5328 ± 0.0117 |
2.42 |
RTX 4090 (24GB) |
3-May-23 |
|
[2020] TGN |
0.8418 ± 0.0847 |
0.7983 ± 0.049 |
0.7954 ± 0.0349 |
0.8244 ± 0.0098 |
2.85 |
RTX 4090 (24GB) |
3-May-23 |
|
[2020] TGAT |
0.7902 ± 0.0033 |
0.7184 ± 0.0014 |
0.7010 ± 0.0058 |
0.7929 ± 0.0029 |
45.80 |
RTX 4090 (24GB) |
3-May-23 |
|
[2021] CAWN |
0.9401 ± 0.0025 |
0.9410 ± 0.0026 |
0.9407 ± 0.0017 |
0.9484 ± 0.0039 |
111.96 |
RTX 4090 (24GB) |
3-May-23 |
|
[2022] NeurTW |
0.9727 ± 0.0001 |
0.9762 ± 0.0 |
0.9719 ± 0.0014 |
0.9797 ± 0.0008 |
2,097.39 |
RTX 4090 (24GB) |
3-May-23 |
|
[2022] NAT |
0.9241 ± 0.0086 |
0.9642 ± 0.0124 |
0.9763 ± 0.0133 |
0.9500 ± 0.0257 |
2.83 |
RTX 4090 (24GB) |
3-May-23 |
CanParl
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7939 ± 0.0063 |
0.5012 ± 0.0155 |
0.5078 ± 0.0005 |
0.4347 ± 0.0090 |
1.96 |
RTX 4090 (24GB) |
4-May-23 |
|
[2019] DyRep |
0.7737 ± 0.0255 |
0.5532 ± 0.0088 |
0.5393 ± 0.0204 |
0.4430 ± 0.0068 |
2.44 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGN |
0.7575 ± 0.0694 |
0.5727 ± 0.0268 |
0.5691 ± 0.0223 |
0.5625 ± 0.0396 |
3.03 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGAT |
0.7077 ± 0.0218 |
0.5802 ± 0.0069 |
0.5724 ± 0.0063 |
0.5955 ± 0.0074 |
46.28 |
RTX 4090 (24GB) |
4-May-23 |
|
[2021] CAWN |
0.7197 ± 0.0905 |
0.7154 ± 0.0967 |
0.7231 ± 0.085 |
0.7005 ± 0.1241 |
234.65 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NeurTW |
0.8920 ± 0.0173 |
0.8871 ± 0.0139 |
0.8847 ± 0.0102 |
0.8882 ± 0.0045 |
4,566.24 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NAT |
0.6917 ± 0.0722 |
0.6214 ± 0.0734 |
0.6277 ± 0.0811 |
0.5685 ± 0.0326 |
3.79 |
RTX 4090 (24GB) |
4-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7030 ± 0.0077 |
0.5148 ± 0.0119 |
0.5143 ± 0.0043 |
0.4697 ± 0.0043 |
1.96 |
RTX 4090 (24GB) |
4-May-23 |
|
[2019] DyRep |
0.6860 ± 0.0256 |
0.5365 ± 0.0064 |
0.5168 ± 0.0170 |
0.4794 ± 0.0057 |
2.44 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGN |
0.6765 ± 0.0615 |
0.5596 ± 0.0141 |
0.5520 ± 0.0135 |
0.5553 ± 0.0258 |
3.03 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGAT |
0.6811 ± 0.0157 |
0.5814 ± 0.0041 |
0.5740 ± 0.0054 |
0.6004 ± 0.0087 |
46.28 |
RTX 4090 (24GB) |
4-May-23 |
|
[2021] CAWN |
0.6916 ± 0.0546 |
0.6915 ± 0.0578 |
0.6952 ± 0.0518 |
0.6671 ± 0.0795 |
234.65 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NeurTW |
0.8528 ± 0.0213 |
0.8469 ± 0.0161 |
0.8417 ± 0.0132 |
0.8511 ± 0.0079 |
4,566.24 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NAT |
0.6593 ± 0.0764 |
0.6058 ± 0.0812 |
0.6027 ± 0.0787 |
0.5989 ± 0.0571 |
3.79 |
RTX 4090 (24GB) |
4-May-23 |
Contact
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9379 ± 0.0073 |
0.9358 ± 0.0025 |
0.9345 ± 0.0027 |
0.7531 ± 0.0059 |
41.99 |
RTX 4090 (24GB) |
4-May-23 |
|
[2019] DyRep |
0.9276 ± 0.0206 |
0.8650 ± 0.0431 |
0.8574 ± 0.0454 |
0.6602 ± 0.0395 |
58.20 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGN |
0.9769 ± 0.0032 |
0.952 ± 0.0056 |
0.9527 ± 0.0052 |
0.9118 ± 0.0053 |
69.60 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGAT |
0.5582 ± 0.009 |
0.5571 ± 0.0047 |
0.556 ± 0.0039 |
0.5449 ± 0.0056 |
1,645.10 |
RTX 4090 (24GB) |
4-May-23 |
|
[2021] CAWN |
0.9685 ± 0.0028 |
0.9691 ± 0.0031 |
0.9691 ± 0.0028 |
0.9652 ± 0.0012 |
12,100.94 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NeurTW |
0.9840 ± 0.0 |
0.9842 ± 0.0 |
0.9841 ± 0.0 |
0.9820 ± 0.0 |
114,274.38 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NAT |
0.9463 ± 0.021 |
0.9466 ± 0.0127 |
0.9351 ± 0.0202 |
0.9495 ± 0.0034 |
96.35 |
RTX 4090 (24GB) |
4-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9087 ± 0.0114 |
0.9162 ± 0.0051 |
0.9150 ± 0.0058 |
0.7381 ± 0.0145 |
41.99 |
RTX 4090 (24GB) |
4-May-23 |
|
[2019] DyRep |
0.9016 ± 0.0319 |
0.8334 ± 0.0620 |
0.8253 ± 0.0637 |
0.6601 ± 0.0432 |
58.20 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGN |
0.9699 ± 0.0045 |
0.9411 ± 0.0071 |
0.9421 ± 0.0055 |
0.8916 ± 0.0075 |
69.60 |
RTX 4090 (24GB) |
4-May-23 |
|
[2020] TGAT |
0.5888 ± 0.0065 |
0.5922 ± 0.0056 |
0.5915 ± 0.0049 |
0.5779 ± 0.0044 |
1,645.10 |
RTX 4090 (24GB) |
4-May-23 |
|
[2021] CAWN |
0.9677 ± 0.0024 |
0.9688 ± 0.0023 |
0.9689 ± 0.0029 |
0.9670 ± 0.0031 |
12,100.94 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NeurTW |
0.9756 ± 0.0 |
0.9762 ± 0.0 |
0.9757 ± 0.0 |
0.9704 ± 0.0 |
114,274.38 |
RTX 4090 (24GB) |
4-May-23 |
|
[2022] NAT |
0.9450 ± 0.0168 |
0.9489 ± 0.0091 |
0.9384 ± 0.0175 |
0.9535 ± 0.0044 |
96.35 |
RTX 4090 (24GB) |
4-May-23 |
Flights
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9449 ± 0.0073 |
0.9218 ± 0.0094 |
0.9172 ± 0.0114 |
0.9303 ± 0.0083 |
180.80 |
RTX 4090 (24GB) |
5-May-23 |
|
[2019] DyRep |
0.8981 ± 0.0056 |
0.8689 ± 0.0128 |
0.8650 ± 0.0126 |
0.8900 ± 0.0266 |
197.61 |
RTX 4090 (24GB) |
5-May-23 |
|
[2020] TGN |
0.9787 ± 0.0025 |
0.9519 ± 0.0043 |
0.9503 ± 0.0043 |
0.9652 ± 0.0022 |
262.51 |
RTX 4090 (24GB) |
5-May-23 |
|
[2020] TGAT |
0.9016 ± 0.0027 |
0.8321 ± 0.0041 |
0.8285 ± 0.0038 |
0.8570 ± 0.0056 |
1,195.30 |
RTX 4090 (24GB) |
5-May-23 |
|
[2021] CAWN |
0.9861 ± 0.0002 |
0.9834 ± 0.0001 |
0.9828 ± 0.0002 |
0.9873 ± 0.0009 |
12,105.70 |
RTX 4090 (24GB) |
5-May-23 |
|
[2022] NeurTW |
0.9302 ± 0.0 |
0.9158 ± 0.0 |
0.9127 ± 0.0 |
0.9411 ± 0.0 |
143,731.99 |
RTX 4090 (24GB) |
5-May-23 |
|
[2022] NAT |
0.9747 ± 0.0061 |
0.9827 ± 0.003 |
0.986 ± 0.0034 |
0.9905 ± 0.0014 |
76.91 |
RTX 4090 (24GB) |
5-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.9389 ± 0.0075 |
0.9190 ± 0.0081 |
0.9128 ± 0.0095 |
0.9250 ± 0.0065 |
180.80 |
RTX 4090 (24GB) |
5-May-23 |
|
[2019] DyRep |
0.8836 ± 0.0078 |
0.8707 ± 0.0121 |
0.8657 ± 0.0117 |
0.6312 ± 0.0449 |
197.61 |
RTX 4090 (24GB) |
5-May-23 |
|
[2020] TGN |
0.9764 ± 0.0025 |
0.9439 ± 0.0043 |
0.9412 ± 0.0039 |
0.9644 ± 0.0015 |
262.51 |
RTX 4090 (24GB) |
5-May-23 |
|
[2020] TGAT |
0.899 ± 0.0025 |
0.8361 ± 0.0039 |
0.8330 ± 0.0031 |
0.8608 ± 0.0049 |
1,195.30 |
RTX 4090 (24GB) |
5-May-23 |
|
[2021] CAWN |
0.9860 ± 0.0002 |
0.9834 ± 0.0002 |
0.9827 ± 0.0002 |
0.9882 ± 0.0009 |
12,105.70 |
RTX 4090 (24GB) |
5-May-23 |
|
[2022] NeurTW |
0.9321 ± 0.0 |
0.9201 ± 0.0 |
0.9161 ± 0.0 |
0.9496 ± 0.0 |
143,731.99 |
RTX 4090 (24GB) |
5-May-23 |
|
[2022] NAT |
0.9749 ± 0.0048 |
0.9817 ± 0.0026 |
0.9845 ± 0.0033 |
0.9906 ± 0.0009 |
76.91 |
RTX 4090 (24GB) |
5-May-23 |
UNTrade
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.6786 ± 0.0103 |
0.6727 ± 0.0132 |
0.6650 ± 0.0106 |
0.5922 ± 0.0085 |
7.89 |
RTX 4090 (24GB) |
6-May-23 |
|
[2019] DyRep |
0.6377 ± 0.0032 |
0.6467 ± 0.0112 |
0.6306 ± 0.0139 |
0.5362 ± 0.0147 |
11.75 |
RTX 4090 (24GB) |
6-May-23 |
|
[2020] TGN |
0.6543 ± 0.01 |
0.5977 ± 0.014 |
0.5959 ± 0.0171 |
0.5068 ± 0.0061 |
14.17 |
RTX 4090 (24GB) |
6-May-23 |
|
[2020] TGAT |
--- |
--- |
--- |
--- |
-- |
RTX 4090 (24GB) |
6-May-23 |
|
[2021] CAWN |
0.7511 ± 0.0012 |
0.7398 ± 0.0007 |
0.7413 ± 0.001 |
0.7458 ± 0.0081 |
1,860.84 |
RTX 4090 (24GB) |
6-May-23 |
|
[2022] NeurTW |
0.5924 ± 0.0368 |
0.5915 ± 0.0328 |
0.5965 ± 0.0371 |
0.5938 ± 0.0600 |
39,402.43 |
RTX 4090 (24GB) |
6-May-23 |
|
[2022] NAT |
0.783 ± 0.0472 |
0.6475 ± 0.0664 |
0.5812 ± 0.0957 |
0.6876 ± 0.0177 |
21.57 |
RTX 4090 (24GB) |
6-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.6329 ± 0.0102 |
0.6392 ± 0.0132 |
0.6333 ± 0.0102 |
0.5801 ± 0.0112 |
7.89 |
RTX 4090 (24GB) |
6-May-23 |
|
[2019] DyRep |
0.6099 ± 0.0057 |
0.6232 ± 0.0188 |
0.6101 ± 0.0196 |
0.5344 ± 0.0130 |
11.75 |
RTX 4090 (24GB) |
6-May-23 |
|
[2020] TGN |
0.6059 ± 0.0086 |
0.5603 ± 0.0106 |
0.5622 ± 0.014 |
0.5164 ± 0.0056 |
14.17 |
RTX 4090 (24GB) |
6-May-23 |
|
[2020] TGAT |
--- |
--- |
--- |
--- |
-- |
RTX 4090 (24GB) |
6-May-23 |
|
[2021] CAWN |
0.7488 ± 0.0005 |
0.7361 ± 0.0009 |
0.7375 ± 0.001 |
0.7404 ± 0.0023 |
1,860.84 |
RTX 4090 (24GB) |
6-May-23 |
|
[2022] NeurTW |
0.5648 ± 0.0167 |
0.5640 ± 0.0137 |
0.5692 ± 0.0185 |
0.5685 ± 0.0298 |
39,402.43 |
RTX 4090 (24GB) |
6-May-23 |
|
[2022] NAT |
0.7514 ± 0.0615 |
0.6586 ± 0.0543 |
0.5844 ± 0.053 |
0.6785 ± 0.0289 |
21.57 |
RTX 4090 (24GB) |
6-May-23 |
USLegis
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.8278 ± 0.0024 |
0.5840 ± 0.0129 |
0.5801 ± 0.0213 |
0.5390 ± 0.0075 |
2.15 |
RTX 4090 (24GB) |
7-May-23 |
|
[2019] DyRep |
0.7425 ± 0.0374 |
0.5980 ± 0.0097 |
0.5673 ± 0.0098 |
0.5640 ± 0.0192 |
2.73 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGN |
0.8137 ± 0.002 |
0.6128 ± 0.0046 |
0.5741 ± 0.0148 |
0.5626 ± 0.0195 |
2.93 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGAT |
0.7738 ± 0.0062 |
0.5568 ± 0.0078 |
0.5596 ± 0.0092 |
0.5324 ± 0.0294 |
36.69 |
RTX 4090 (24GB) |
7-May-23 |
|
[2021] CAWN |
0.9643 ± 0.0043 |
0.9665 ± 0.0032 |
0.9672 ± 0.0029 |
0.9738 ± 0.0058 |
220.41 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NeurTW |
0.9715 ± 0.0009 |
0.9708 ± 0.0009 |
0.9682 ± 0.0018 |
0.9787 ± 0.0004 |
3,208.23 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NAT |
0.7820 ± 0.0261 |
0.7453 ± 0.0286 |
0.5310 ± 0.1 |
0.8897 ± 0.0225 |
3.16 |
RTX 4090 (24GB) |
7-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.7585 ± 0.0032 |
0.5557 ± 0.0107 |
0.5567 ± 0.0106 |
0.5250 ± 0.0045 |
2.15 |
RTX 4090 (24GB) |
7-May-23 |
|
[2019] DyRep |
0.6808 ± 0.0368 |
0.5687 ± 0.0008 |
0.5490 ± 0.0143 |
0.5523 ± 0.0127 |
2.73 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGN |
0.7398 ± 0.0027 |
0.6048 ± 0.0047 |
0.5651 ± 0.0131 |
0.5582 ± 0.02 |
2.93 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGAT |
0.7206 ± 0.0071 |
0.5637 ± 0.0048 |
0.5695 ± 0.0099 |
0.5434 ± 0.0203 |
36.69 |
RTX 4090 (24GB) |
7-May-23 |
|
[2021] CAWN |
0.9682 ± 0.0048 |
0.9694 ± 0.0028 |
0.9703 ± 0.0027 |
0.9767 ± 0.0055 |
220.41 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NeurTW |
0.9713 ± 0.0013 |
0.971 ± 0.0009 |
0.9671 ± 0.0027 |
0.9803 ± 0.0005 |
3,208.23 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NAT |
0.7425 ± 0.016 |
0.6946 ± 0.0198 |
0.5024 ± 0.0511 |
0.8627 ± 0.0196 |
3.16 |
RTX 4090 (24GB) |
7-May-23 |
UNVote
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.6523 ± 0.0082 |
0.5121 ± 0.0005 |
0.5208 ± 0.0075 |
0.4913 ± 0.0203 |
22.31 |
RTX 4090 (24GB) |
7-May-23 |
|
[2019] DyRep |
0.6236 ± 0.0305 |
0.4993 ± 0.0103 |
0.5023 ± 0.0204 |
0.4728 ± 0.0033 |
25.53 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGN |
0.7176 ± 0.0109 |
0.5881 ± 0.0118 |
0.5889 ± 0.0106 |
0.5663 ± 0.0093 |
28.97 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGAT |
0.5134 ± 0.0026 |
0.4770 ± 0.0047 |
0.4787 ± 0.0033 |
0.5000 ± 0.006 |
686.15 |
RTX 4090 (24GB) |
7-May-23 |
|
[2021] CAWN |
0.6037 ± 0.0019 |
0.5911 ± 0.0006 |
0.5933 ± 0.0007 |
0.5775 ± 0.0022 |
6,414.90 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NeurTW |
0.5871 ± 0.0 |
0.5860 ± 0.0 |
0.5878 ± 0.0 |
0.5669 ± 0.0 |
88,939.57 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NAT |
0.6776 ± 0.0411 |
0.779 ± 0.0082 |
0.7789 ± 0.0192 |
0.7198 ± 0.0748 |
40.51 |
RTX 4090 (24GB) |
7-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.6090 ± 0.0076 |
0.5242 ± 0.0050 |
0.5348 ± 0.0072 |
0.4973 ± 0.0145 |
22.31 |
RTX 4090 (24GB) |
7-May-23 |
|
[2019] DyRep |
0.5855 ± 0.0225 |
0.5118 ± 0.0037 |
0.5126 ± 0.0103 |
0.4856 ± 0.0078 |
25.53 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGN |
0.6694 ± 0.0095 |
0.5702 ± 0.0099 |
0.5724 ± 0.0107 |
0.5502 ± 0.0096 |
28.97 |
RTX 4090 (24GB) |
7-May-23 |
|
[2020] TGAT |
0.5388 ± 0.002 |
0.5204 ± 0.004 |
0.5196 ± 0.0022 |
0.5337 ± 0.0046 |
686.15 |
RTX 4090 (24GB) |
7-May-23 |
|
[2021] CAWN |
0.6175 ± 0.0013 |
0.6014 ± 0.0013 |
0.6050 ± 0.0019 |
0.5830 ± 0.0076 |
6,414.90 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NeurTW |
0.6008 ± 0.0 |
0.6025 ± 0.0 |
0.6036 ± 0.0 |
0.5964 ± 0.0 |
88,939.57 |
RTX 4090 (24GB) |
7-May-23 |
|
[2022] NAT |
0.6449 ± 0.033 |
0.7637 ± 0.0023 |
0.7598 ± 0.0167 |
0.7549 ± 0.035 |
40.51 |
RTX 4090 (24GB) |
7-May-23 |
Taobao
AUC
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.8405 ± 0.0006 |
0.701 ± 0.0013 |
0.6988 ± 0.0024 |
0.7169 ± 0.0013 |
32.17 |
RTX 4090 (24GB) |
8-May-23 |
|
[2019] DyRep |
0.8409 ± 0.0012 |
0.7026 ± 0.0006 |
0.6992 ± 0.0001 |
0.7170 ± 0.0011 |
38.03 |
RTX 4090 (24GB) |
8-May-23 |
|
[2020] TGN |
0.8654 ± 0.0005 |
0.7017 ± 0.0026 |
0.7025 ± 0.0038 |
0.7082 ± 0.001 |
34.51 |
RTX 4090 (24GB) |
8-May-23 |
|
[2020] TGAT |
0.5396 ± 0.009 |
0.5261 ± 0.0119 |
0.5266 ± 0.0239 |
0.5226 ± 0.0054 |
29.15 |
RTX 4090 (24GB) |
8-May-23 |
|
[2021] CAWN |
0.7708 ± 0.0026 |
0.7737 ± 0.0027 |
0.7574 ± 0.0032 |
0.7847 ± 0.0148 |
135.04 |
RTX 4090 (24GB) |
8-May-23 |
|
[2022] NeurTW |
0.8759 ± 0.0009 |
0.8843 ± 0.0016 |
0.8617 ± 0.0032 |
0.9083 ± 0.0013 |
1,156.96 |
RTX 4090 (24GB) |
8-May-23 |
|
[2022] NAT |
0.8937 ± 0.0015 |
0.9992 ± 0.0002 |
0.9997 ± 0.0001 |
0.9996 ± 0.0001 |
4.12 |
RTX 4090 (24GB) |
8-May-23 |
AP
| Rank |
Model |
Transductive |
Inductive |
Inductive New-Old |
Inductive New-New |
Runtimes (s) |
Hardware |
Date |
|
[2019] JODIE |
0.8080 ± 0.0015 |
0.6696 ± 0.0025 |
0.6838 ± 0.0045 |
0.6764 ± 0.0013 |
32.17 |
RTX 4090 (24GB) |
8-May-23 |
|
[2019] DyRep |
0.8074 ± 0.0014 |
0.6717 ± 0.0006 |
0.6884 ± 0.0013 |
0.6760 ± 0.0011 |
38.03 |
RTX 4090 (24GB) |
8-May-23 |
|
[2020] TGN |
0.8618 ± 0.0004 |
0.6761 ± 0.0015 |
0.6944 ± 0.0038 |
0.6739 ± 0.0016 |
34.51 |
RTX 4090 (24GB) |
8-May-23 |
|
[2020] TGAT |
0.5508 ± 0.0093 |
0.5293 ± 0.0096 |
0.5309 ± 0.0189 |
0.5222 ± 0.0033 |
29.15 |
RTX 4090 (24GB) |
8-May-23 |
|
[2021] CAWN |
0.7464 ± 0.0027 |
0.7389 ± 0.0026 |
0.7374 ± 0.0032 |
0.7390 ± 0.0147 |
135.04 |
RTX 4090 (24GB) |
8-May-23 |
|
[2022] NeurTW |
0.8808 ± 0.0012 |
0.8815 ± 0.0045 |
0.8687 ± 0.0010 |
0.9025 ± 0.0035 |
1,156.96 |
RTX 4090 (24GB) |
8-May-23 |
|
[2022] NAT |
0.8933 ± 0.0007 |
0.9992 ± 0.0001 |
0.9997 ± 0.0001 |
0.9997 ± 0.0001 |
4.12 |
RTX 4090 (24GB) |
8-May-23 |