Model Zoo

Here we document the performance of various models currently implemented with PDEArena. The tables below provide results and useful statistics about training and inference.

Model	Name	Num. Params	Model Size (MB)	Peak GPU Memory (MB)	Eag. Fwd. Time (s)	Comp. Fwd. Time (s)	Forward+Backward Time (s)
DilResNet128	DilResNet-128	4.2 M	16.7	4886.0	0.106	0.118	0.330
DilResNet-128-norm	DilResNet-128-norm	4.2 M	16.7	6959.0	0.161	0.167	0.401
FNO128-8modes16	FNO-128-16m	134 M	537.5	2964.01	0.042	0.042	0.129
FNO128-8modes8	FNO-128-8m	33.7 M	134.9	2173.5	0.040	0.040	0.119
FNO128-4modes16	FNOs-128-16m	67.2 M	268.8	1866.45	0.022	0.022	0.068
FNO128-4modes32	FNOs-128-32m	268 M	1074.1	3434.51	0.027	0.027	0.097
FNO64-4modes32	FNOs-64-32m	67.1 M	268.5	1225.52	0.012	0.012	0.040
FNO96-4modes32	FNOs-96-32m	151 M	604.2	2195.01	0.020	0.020	0.064
ResNet128	ResNet-128	1.2 M	4.9	2500.03	0.040	0.043	0.090
ResNet256	ResNet-256	4.9 M	19.4	4958.0	0.112	0.101	0.254
U-F1Netmodes16	U-FNet1-16m	160 M	643.6	4054.3	0.083	0.156	0.197
U-F1Netmodes16-1x1	U-FNet1-16m-1x1	160 M	643.6	4056.31	0.082	0.156	0.195
U-F1Netmodes8	U-FNet1-8m	148 M	593.3	3949.85	0.083	0.200	0.196
U-F1Netmodes8-1x1	U-FNet1-8m-1x1	148 M	593.3	3953.76	0.082	0.168	0.194
U-F2Netmodes16,8	U-FNet2-16m	175 M	700.5	4172.36	0.084	0.093	0.201
U-F2Netmodes16,8-1x1	U-FNet2-16m-1x1	175 M	700.5	4167.87	0.083	0.092	0.200
U-F2Netmodes16,16	U-FNet2-16mc	219 M	876.7	4514.14	0.085	0.092	0.206
U-F2Netmodes8,4	U-FNet2-8m	151 M	606.2	3984.61	0.083	0.145	0.199
U-F2Netmodes8,4-1x1	U-FNet2-8m-1x1	151 M	606.1	3979.97	0.083	0.107	0.197
U-F2Netmodes8,8	U-FNet2-8mc	162 M	650.2	4064.52	0.084	0.099	0.200
U-F2Netatt,modes16,8	U-FNet2attn-16m	179 M	717.3	4247.5	0.086	0.168	0.208
U-F2Netatt,modes16,8-1x1	U-FNet2attn-16m-1x1	179 M	717.3	4246.0	0.085	0.098	0.206
U-F3Netmodes16,8,4	U-FNet3-16m	187 M	751.9	4267.51	0.085	0.091	0.204
U-F3Netmodes16,8,4-1x1	U-FNet3-16m-1x1	187 M	751.9	4271.79	0.084	0.090	0.202
U-F3Netmodes8,4,2	U-FNet3-8m	164 M	657.5	4080.25	0.084	0.092	0.202
U-F3Netmodes8,4,2-1x1	U-FNet3-8m-1x1	164 M	657.5	4079.46	0.083	0.091	0.200
UNO128	UNO-128	440 M	1761.8	5525.0	0.152	0.155	0.342
UNO64	UNO-64	110 M	440.5	1946.17	0.062	0.066	0.135
U-Net2015128	Unet2015-128	124 M	496.5	3015.0	0.043	0.043	0.119
U-Net201564	Unet2015-64	31.0 M	124.2	1357.08	0.013	0.013	0.038
U-Netbase128	Unetbase-128	124 M	496.6	3016.0	0.055	0.044	0.135
U-Netbase64	Unetbase-64	31.1 M	124.2	1291.83	0.020	0.013	0.046
U-Netmod64	Unetmod-64	144 M	577.1	3917.08	0.080	0.058	0.187
U-Netmod64-1x1	Unetmod-64-1x1	144 M	577.0	3917.95	0.080	0.057	0.185
U-Netatt64	Unetmodattn-64	148 M	593.9	3991.47	0.082	0.060	0.193
U-Netatt64-1x1	Unetmodattn-64-1x1	148 M	593.8	3994.42	0.082	0.059	0.191
MaxwellFNO3D~96-1x1	MaxwellFNO3D	55 M
MaxwellCFNO3D~32-1x1	MaxwellCFNO3D	55 M

• Date Created: 2023-03-27 01:42:54.528237
• GPU: Tesla V100-PCIE-16GB