FP BF Precision

vs_FP32 MAE_Similarity SSIM_Similarity
FP16 96.2 % 96.6 %
BF16 95.6 % 95.2 %
MXFP8 94.2 % 93.3 %
FP8_scaled 93.5 % 93.2 %
FP8 87.5 % 73.3 %
NVFP4 88.4 % 78.9 %

Measurement Data

FP32

FP32_1 FP32_2 FP32_3 FP32_6 FP32_5
FP32 MAE_Similarity SSIM_Similarity Time (sec)
No.1 100.0 % 100.0 % 371.6
No.2 100.0 % 100.0 % 360.9
No.3 100.0 % 100.0 % 361.4
No.4 100.0 % 100.0 % 361.4
No.5 100.0 % 100.0 % 359.8
median 100.0 % 100.0 % 361.4

FP16

FP16_1 FP16_2 FP16_3 FP16_6 FP16_5
FP16 MAE_Similarity SSIM_Similarity Time (sec)
No.1 96.2 % 96.6 % 103.4
No.2 94.0 % 82.9 % 98.3
No.3 95.2 % 93.4 % 97.9
No.4 95.3 % 91.0 % 98.2
No.5 97.3 % 97.5 % 98.3
median 95.3 % 93.4 % 98.3

BF16

BF16_1 BF16_2 BF16_3 BF16_6 BF16_5
BF16 MAE_Similarity SSIM_Similarity Time (sec)
No.1 95.6 % 95.2 % 102.6
No.2 93.0 % 80.4 % 96.9
No.3 94.9 % 92.9 % 97.1
No.4 95.4 % 91.1 % 96.9
No.5 97.2 % 97.6 % 96.8
median 95.4 % 92.9 % 96.9

MXFP8

MXFP8_1 MXFP8_2 MXFP8_3 MXFP8_6 MXFP8_5
MXFP8 MAE_Similarity SSIM_Similarity Time (sec)
No.1 94.2 % 93.3 % 115.9
No.2 92.5 % 78.0 % 112.8
No.3 93.0 % 87.8 % 112.8
No.4 95.2 % 92.1 % 112.9
No.5 96.1 % 96.2 % 112.8
median 94.2 % 92.1 % 112.8

FP8_scaled

FP8_scaled_1 FP8_scaled_2 FP8_scaled_3 FP8_scaled_6 FP8_scaled_5
FP8_scaled MAE_Similarity SSIM_Similarity Time (sec)
No.1 93.5 % 93.2 % 76.4
No.2 91.3 % 76.8 % 73.4
No.3 93.2 % 91.0 % 73.4
No.4 93.4 % 85.3 % 73.4
No.5 94.6 % 92.2 % 73.4
median 93.4 % 91.0 % 73.4

FP8

FP8_1 FP8_2 FP8_3 FP8_6 FP8_5
FP8 MAE_Similarity SSIM_Similarity Time (sec)
No.1 87.5 % 73.3 % 94.75
No.2 82.9 % 35.0 % 92.06
No.3 89.7 % 77.9 % 92.06
No.4 83.7 % 39.6 % 92.06
No.5 87.5 % 72.5 % 92.07
median 87.5 % 72.5 % 92.06

NVFP4

NVFP4_1 NVFP4_2 NVFP4_3 NVFP4_6 NVFP4_5
NVFP4 MAE_Similarity SSIM_Similarity Time (sec)
No.1 88.4 % 78.9 % 93.5
No.2 88.4 % 57.7 % 90.4
No.3 89.5 % 79.5 % 90.4
No.4 84.1 % 39.7 % 90.4
No.5 90.3 % 81.1 % 90.4
median 88.4 % 78.9 % 90.4

BF16_20steps

BF16_20steps_1 BF16_20steps_2 BF16_20steps_3 BF16_20steps_6 BF16_20steps_5
BF16_20steps MAE_Similarity SSIM_Similarity Time (sec)
No.1 94.8 % 94.2 % 86.5
No.2 92.3 % 79.8 % 80.7
No.3 93.6 % 89.2 % 81.0
No.4 95.2 % 92.1 % 80.7
No.5 97.2 % 97.6 % 80.8
median 94.8 % 92.1 % 80.8