ComfyUI-TeaCache
Evaluate ComfyUI-TeaCache's performance on AI Image Journey. Analyze processing times, MAE, and SSIM across max_skip settings, with visual comparisons and torch.compile results, highlighting efficiency and image quality trade-offs.

ComfyUI-TeaCache
TeaCache
max_skip_1
.png)
max_skip_1 | sec | MAE | MAE similarity | SSIM | SSIM similarity |
---|---|---|---|---|---|
rel_l1_0 | 212.39 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.05 | 212.95 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.1 | 212.82 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.15 | 212.86 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.2 | 150.76 | 16.12 | 93.7 % | 0.91 | 91.0 % |
rel_l1_0.25 | 130.29 | 16.28 | 93.7 % | 0.91 | 91.1 % |
rel_l1_0.3 | 116.47 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.35 | 116.48 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.4 | 116.41 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.45 | 116.6 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.5 | 116.51 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.55 | 116.38 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.6 | 116.45 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.65 | 116.55 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.7 | 116.48 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.8 | 116.43 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.9 | 116.43 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_1 | 116.44 | 22.79 | 91.1 % | 0.85 | 85.2 % |
max_skip_2
.png)
max_skip_2 | sec | MAE | MAE similarity | SSIM | SSIM similarity |
---|---|---|---|---|---|
rel_l1_0 | 213.16 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.05 | 213.09 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.1 | 213.33 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.15 | 213.32 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.2 | 150.59 | 16.08 | 93.7 % | 0.91 | 91.1 % |
rel_l1_0.25 | 130.2 | 16.12 | 93.7 % | 0.91 | 91.1 % |
rel_l1_0.3 | 116.48 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.35 | 116.42 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.4 | 95.88 | 21.6 | 91.6 % | 0.87 | 87.1 % |
rel_l1_0.45 | 95.96 | 27.81 | 89.1 % | 0.81 | 80.6 % |
rel_l1_0.5 | 88.9 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.55 | 88.85 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.6 | 88.91 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.65 | 88.89 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.7 | 88.95 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.8 | 88.97 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.9 | 82.89 | 28.09 | 89.0 % | 0.8 | 80.3 % |
rel_l1_1 | 81.98 | 28.09 | 89.0 % | 0.8 | 80.3 % |
max_skip_3
.png)
max_skip_3 | sec | MAE | MAE similarity | SSIM | SSIM similarity |
---|---|---|---|---|---|
rel_l1_0 | 213.6 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.05 | 213.44 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.1 | 213.37 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.15 | 213.35 | 0 | 100.0 % | 1 | 100.0 % |
rel_l1_0.2 | 151.45 | 16.12 | 93.7 % | 0.91 | 91.0 % |
rel_l1_0.25 | 130.61 | 16.08 | 93.7 % | 0.91 | 91.1 % |
rel_l1_0.3 | 116.85 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.35 | 116.79 | 22.79 | 91.1 % | 0.85 | 85.2 % |
rel_l1_0.4 | 96.11 | 21.6 | 91.6 % | 0.87 | 87.1 % |
rel_l1_0.45 | 96.19 | 27.81 | 89.1 % | 0.81 | 80.6 % |
rel_l1_0.5 | 89.43 | 27.83 | 89.1 % | 0.81 | 80.5 % |
rel_l1_0.55 | 82.46 | 28.83 | 88.7 % | 0.79 | 79.2 % |
rel_l1_0.6 | 75.6 | 28.86 | 88.7 % | 0.79 | 79.1 % |
rel_l1_0.65 | 75.53 | 30.96 | 87.9 % | 0.76 | 76.3 % |
rel_l1_0.7 | 75.59 | 30.96 | 87.9 % | 0.76 | 76.3 % |
rel_l1_0.8 | 75.76 | 30.96 | 87.9 % | 0.76 | 76.3 % |
rel_l1_0.9 | 68.79 | 30.96 | 87.9 % | 0.76 | 76.3 % |
rel_l1_1 | 69.49 | 31.14 | 87.8 % | 0.76 | 76.1 % |
SSIM approximation curve per max_skip

Maximum settings vs original image

torch.compile
ComfyUI default (Beta) TorchCompileModel node
No1 | No2 | No3 | mediun | Time (%) | MAE | MAE similarity | MAE Quality | SSIM | SSIM similarity | SSIM Quality | |
---|---|---|---|---|---|---|---|---|---|---|---|
inductor | 284.35 | 215.52 | 213.43 | 215.52 | -- 0.1 % | 0 | 100.0 % | - 0.0 % | 1 | 100.0 % | - 0.0 % |
cudagraph | 281.1 | 215.56 | 213.39 | 215.56 | -- 0.2 % | 0 | 100.0 % | - 0.0 % | 1 | 100.0 % | - 0.0 % |
ComfyUI-TeaCache Compile Model node
mode | backend | fullgraph | dynamic | Time1 | Time2 | Time3 | mediun | Time (%) | MAE | MAE similarity | SSIM | SSIM similarity |
---|---|---|---|---|---|---|---|---|---|---|---|---|
default | inductor | false | false | 285 | 215 | 214 | 215 | - 0.1 % | 18.81 | 92.7 % | 0.88 | 87.7 % |
true | false | 291 | 185 | 183 | 185 | - 14.1 % | 18.87 | 92.6 % | 0.88 | 87.6 % | ||
false | true | 412 | 185 | 183 | 185 | - 14.1 % | 18.91 | 92.6 % | 0.88 | 87.6 % | ||
true | true | 253 | 185 | 183 | 185 | - 13.9 % | 18.91 | 92.6 % | 0.88 | 87.6 % | ||
cudagraph | false | false | 332 | 185 | 183 | 185 | - 14.0 % | 0 | 100.0 % | 1 | 100.0 % | |
true | false | 255 | 185 | 183 | 185 | - 14.0 % | 0 | 100.0 % | 1 | 100.0 % | ||
false | true | 326 | 183 | 183 | 183 | - 14.9 % | 0 | 100.0 % | 1 | 100.0 % | ||
true | true | 346 | 185 | 183 | 185 | - 14.0 % | 0 | 100.0 % | 1 | 100.0 % | ||
max_autotune | inductor | false | false | 334 | 214 | 213 | 214 | - 0.6 % | 18.79 | 92.7 % | 0.88 | 87.7 % |
true | false | 284 | 215 | 213 | 215 | - 0.1 % | 18.79 | 92.7 % | 0.88 | 87.7 % | ||
false | true | 285 | 215 | 214 | 215 | - 0.0 % | 18.86 | 92.6 % | 0.88 | 87.7 % | ||
true | true | 288 | 215 | 213 | 215 | - 0.0 % | 18.76 | 92.7 % | 0.88 | 87.7 % | ||
cudagraph | false | false | 288 | 215 | 213 | 215 | - 0.0 % | 0 | 100.0 % | 1 | 100.0 % | |
true | false | 282 | 215 | 213 | 215 | - 0.1 % | 0 | 100.0 % | 1 | 100.0 % | ||
false | true | 282 | 215 | 213 | 215 | - 0.0 % | 0 | 100.0 % | 1 | 100.0 % | ||
true | true | 279 | 215 | 213 | 215 | - 0.1 % | 0 | 100.0 % | 1 | 100.0 % |
mode | backend | fullgraph | dynamic | Time (%) | MAE Quality | SSIM Quality |
---|---|---|---|---|---|---|
default | inductor | false | false | - 0.1 % | - 7.3 % | - 12.3 % |
true | false | - 14.1 % | - 7.4 % | - 12.4 % | ||
false | true | - 14.1 % | - 7.4 % | - 12.4 % | ||
true | true | - 13.9 % | - 7.4 % | - 12.4 % | ||
cudagraph | false | false | - 14.0 % | - 0.0 % | - 0.0 % | |
true | false | - 14.0 % | - 0.0 % | - 0.0 % | ||
false | true | - 14.9 % | - 0.0 % | - 0.0 % | ||
true | true | - 14.0 % | - 0.0 % | - 0.0 % | ||
max_autotune | inductor | false | false | - 0.6 % | - 7.3 % | - 12.3 % |
true | false | - 0.1 % | - 7.3 % | - 12.3 % | ||
false | true | - 0.0 % | - 7.4 % | - 12.3 % | ||
true | true | - 0.0 % | - 7.3 % | - 12.3 % | ||
cudagraph | false | false | - 0.0 % | - 0.0 % | - 0.0 % | |
true | false | - 0.1 % | - 0.0 % | - 0.0 % | ||
false | true | - 0.0 % | - 0.0 % | - 0.0 % | ||
true | true | - 0.1 % | - 0.0 % | - 0.0 % |