Skip to content

Latest commit

 

History

History
60 lines (47 loc) · 4.99 KB

ablation_length.md

File metadata and controls

60 lines (47 loc) · 4.99 KB

Effects of generated sequence length on model performance

Model Length DTW (STD) TDE (STD) Eye (STD)
ScanGAN 10 4.2684 (1.1924) 0.1560 (0.0356) 0.0479 (0.0237)
ScanDMM 10 4.5523 (1.3288) 0.1623 (0.0405) 0.0502 (0.0252)
Chen et al 10
ScanGUI 10

Effects of resolution on model performance

The generated sequence length is 10.

ScanGAN

Model Resolution DTW (STD) TDE (STD) Eye (STD) REC (STD) DET (STD)
ScanGAN sample1 64*64 4.3473 (1.3714) 0.1559 (0.0412) 0.0529 (0.0271) 1.8426 (2.5941) 1.8619 (11.7620)
ScanGAN sample2 64*64 4.3406 (1.3642) 0.1554 (0.0407) 0.0529 (0.0263) 1.7292 (2.4946) 2.2192 (13.3158)
ScanGAN sample3 64*64 4.3416 (1.3705) 0.1552 (0.0411) 0.0525 (0.0267) 1.7692 (2.4886) 1.2693 (9.2431)
Model Resolution DTW (STD) TDE (STD) Eye (STD) REC (STD) DET (STD)
ScanGAN sample1 128*128 4.1958 (1.2386) 0.1543 (0.0411) 0.0515 (0.0260) 1.7422 (2.3394) 1.0082 (8.9798)
ScanGAN sample2 128*128 4.2006 (1.2373) 0.1543 (0.0409) 0.0513 (0.0258) 1.6994 (2.2403) 0.9763 (9.0094)
ScanGAN sample3 128*128 4.2019 (1.2409) 0.1545 (0.0409) 0.0513 (0.0259) 1.8100 (2.3200) 0.8629 (8.5249)
Model Resolution DTW (STD) TDE (STD) Eye (STD) REC (STD) DET (STD)
ScanGAN sample1 225*225 4.2228 (1.1964) 0.1551 (0.0395) 0.0489 (0.0251) 1.8476 (2.4474) 1.0536 (8.8898)
ScanGAN sample2 225*225 4.2193 (1.1972) 0.1551 (0.0396) 0.0490 (0.0252) 1.8757 (2.5631) 1.6122 (10.4929)
ScanGAN sample3 225*225 4.2213 (1.1928) 0.1551 (0.0394) 0.0488 (0.0250) 1.8209 (2.3698) 1.5168 (10.9950)

ScanDMM

Model Resolution DTW (STD) TDE (STD) Eye (STD) REC (STD) DET (STD)
ScanDMM sample1 128*128 4.7174 0.1674 0.0478 1.2310 0.2952
ScanDMM sample2 128*128 4.7894 0.1718 0.0478 1.2493 0.6585
ScanDMM sample3 128*128 4.8362 0.1705 0.0479 1.3878 0.4087
ScanDMM sample4 128*128 4.7450 0.1717 0.0485 1.3424 0.4995
ScanDMM sample5 128*128 4.7218 0.1685 0.0467 1.3161 0.7428
Model Resolution DTW (STD) TDE (STD) Eye (STD) REC (STD) DET (STD)
ScanDMM sample1 225*225 4.8123 0.1683 0.0548 1.3655 0.9764
ScanDMM sample2 225*225 4.7743 0.1678 0.0525 1.3230 1.1224
ScanDMM sample3 225*225 4.7081 0.1672 0.0560 1.4759 0.7720
ScanDMM sample4 225*225 4.7230 0.1636 0.0515 1.3480 0.6630
ScanDMM sample5 225*225 4.7718 0.1640 0.0524 1.4299 1.2443

Chen et al

To avoid the effect of RL, the ablation study is run without using the RL framework. This method is different from both ScanGAN and ScanDMM, as the network has to be changed to fit different input image sizes.

Model Resolution DTW (STD) TDE (STD) Eye (STD) REC (STD) DET (STD)
chen et al 64*64 4.3958 (1.2717) 0.1602 (0.0425) 0.0496 (0.0250) 1.8831 (2.3331) 1.1833 (9.7462)
chen et al 128*128 4.2217 (1.2213) 0.1541 (0.0412) 0.0439 (0.0246) 2.4912 (2.7742) 2.5182 (13.8787)
chen et al 225*225 4.2288 (1.2796) 0.1521 (0.0412) 0.0419 (0.0246) 2.3261 (2.7603) 1.5032 (10.4092)