Push model using huggingface_hub.
Browse files- README.md +64 -0
- config.json +14 -0
- model.safetensors +3 -0
README.md
ADDED
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets: polymathic-ai/viscoelastic_instability
|
3 |
+
tags:
|
4 |
+
- physics
|
5 |
+
---
|
6 |
+
|
7 |
+
# Benchmarking Models on the Well
|
8 |
+
|
9 |
+
[The Well](https://github.com/PolymathicAI/the_well) is a 15TB dataset collection of physics simulations. This model is part of the models that have been benchmarked on the Well.
|
10 |
+
|
11 |
+
|
12 |
+
The models have been trained for a fixed time of 12 hours or up to 500 epochs, whichever happens first. The training was performed on a NVIDIA H100 96GB GPU.
|
13 |
+
In the time dimension, the context length was set to 4. The batch size was set to maximize the memory usage. We experiment with 5 different learning rates for each model on each dataset.
|
14 |
+
We use the model performing best on the validation set to report test set results.
|
15 |
+
|
16 |
+
The reported results are here to provide a simple baseline. **They should not be considered as state-of-the-art**. We hope that the community will build upon these results to develop better architectures for PDE surrogate modeling.
|
17 |
+
|
18 |
+
# Fourier Neural Operator
|
19 |
+
|
20 |
+
Implementation of the [Fourier Neural Operator](https://arxiv.org/abs/2010.08895) provided by [`neuraloperator v0.3.0`](https://neuraloperator.github.io/dev/index.html).
|
21 |
+
|
22 |
+
## Model Details
|
23 |
+
|
24 |
+
For benchmarking on the Well, we used the following parameters.
|
25 |
+
|
26 |
+
| Parameters | Values |
|
27 |
+
|-------------|--------|
|
28 |
+
| Modes | 16 |
|
29 |
+
| Blocks | 4 |
|
30 |
+
| Hidden Size | 128 |
|
31 |
+
|
32 |
+
|
33 |
+
## Trained Model Versions
|
34 |
+
|
35 |
+
Below is the list of checkpoints available for the training of FNO on different datasets of the Well.
|
36 |
+
|
37 |
+
| Dataset | Best Learning Rate | Epochs | VRMSE |
|
38 |
+
|----------------------------------------|--------------------|--------|--------|
|
39 |
+
| [acoustic_scattering_maze](https://huggingface.co/polymathic-ai/FNO-acoustic_scattering_maze) | 1E-3 | 27 | 0.5033 |
|
40 |
+
| [active_matter](https://huggingface.co/polymathic-ai/FNO-active_matter) | 5E-3 | 239 | 0.3157 |
|
41 |
+
| [convective_envelope_rsg](https://huggingface.co/polymathic-ai/FNO-convective_envelope_rsg) | 1E-4 | 14 | 0.0224 |
|
42 |
+
| [gray_scott_reaction_diffusion](https://huggingface.co/polymathic-ai/FNO-gray_scott_reaction_diffusion) | 1E-3 | 46 | 0.2044 |
|
43 |
+
| [helmholtz_staircase](https://huggingface.co/polymathic-ai/FNO-helmholtz_staircase) | 5E-4 | 132 | 0.00160|
|
44 |
+
| [MHD_64](https://huggingface.co/polymathic-ai/FNO-MHD_64) | 5E-3 | 170 | 0.3352 |
|
45 |
+
| [planetswe](https://huggingface.co/polymathic-ai/FNO-planetswe) | 5E-4 | 49 | 0.0855 |
|
46 |
+
| [post_neutron_star_merger](https://huggingface.co/polymathic-ai/FNO-post_neutron_star_merger) | 5E-4 | 104 | 0.4144 |
|
47 |
+
| [rayleigh_benard](https://huggingface.co/polymathic-ai/FNO-rayleigh_benard) | 1E-4 | 32 | 0.6049 |
|
48 |
+
| [rayleigh_taylor_instability](https://huggingface.co/polymathic-ai/FNO-rayleigh_taylor_instability) | 5E-3 | 177 | 0.4013 |
|
49 |
+
| [shear_flow](https://huggingface.co/polymathic-ai/FNO-shear_flow) | 1E-3 | 24 | 0.4450 |
|
50 |
+
| [supernova_explosion_64](https://huggingface.co/polymathic-ai/FNO-supernova_explosion_64) | 1E-4 | 40 | 0.3804 |
|
51 |
+
| [turbulence_gravity_cooling](https://huggingface.co/polymathic-ai/FNO-turbulence_gravity_cooling) | 1E-4 | 13 | 0.2381 |
|
52 |
+
| [turbulent_radiative_layer_2D](https://huggingface.co/polymathic-ai/FNO-turbulent_radiative_layer_2D) | 5E-3 | 500 | 0.4906 |
|
53 |
+
| [viscoelastic_instability](https://huggingface.co/polymathic-ai/FNO-viscoelastic_instability) | 5E-3 | 205 | 0.7195 |
|
54 |
+
|
55 |
+
|
56 |
+
## Loading the model from Hugging Face
|
57 |
+
|
58 |
+
To load the FNO model trained on the `viscoelastic_instability` of the Well, use the following commands.
|
59 |
+
|
60 |
+
```python
|
61 |
+
from the_well.benchmark.models import FNO
|
62 |
+
|
63 |
+
model = FNO.from_pretrained("polymathic-ai/FNO-viscoelastic_instability")
|
64 |
+
```
|
config.json
ADDED
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{
|
2 |
+
"dim_in": 32,
|
3 |
+
"dim_out": 8,
|
4 |
+
"gradient_checkpointing": false,
|
5 |
+
"hidden_channels": 128,
|
6 |
+
"modes1": 16,
|
7 |
+
"modes2": 16,
|
8 |
+
"modes3": 16,
|
9 |
+
"n_spatial_dims": 2,
|
10 |
+
"spatial_resolution": [
|
11 |
+
512,
|
12 |
+
512
|
13 |
+
]
|
14 |
+
}
|
model.safetensors
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3c3b68712579a86e576b41b1d052cd7cd21c32dfe243fabd469cef25de9a6089
|
3 |
+
size 76069152
|