Safetensors
physics
LTMeyer commited on
Commit
a8f5caf
·
verified ·
1 Parent(s): 5ef2272

Push model using huggingface_hub.

Browse files
Files changed (3) hide show
  1. README.md +64 -0
  2. config.json +14 -0
  3. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets: polymathic-ai/viscoelastic_instability
3
+ tags:
4
+ - physics
5
+ ---
6
+
7
+ # Benchmarking Models on the Well
8
+
9
+ [The Well](https://github.com/PolymathicAI/the_well) is a 15TB dataset collection of physics simulations. This model is part of the models that have been benchmarked on the Well.
10
+
11
+
12
+ The models have been trained for a fixed time of 12 hours or up to 500 epochs, whichever happens first. The training was performed on a NVIDIA H100 96GB GPU.
13
+ In the time dimension, the context length was set to 4. The batch size was set to maximize the memory usage. We experiment with 5 different learning rates for each model on each dataset.
14
+ We use the model performing best on the validation set to report test set results.
15
+
16
+ The reported results are here to provide a simple baseline. **They should not be considered as state-of-the-art**. We hope that the community will build upon these results to develop better architectures for PDE surrogate modeling.
17
+
18
+ # Fourier Neural Operator
19
+
20
+ Implementation of the [Fourier Neural Operator](https://arxiv.org/abs/2010.08895) provided by [`neuraloperator v0.3.0`](https://neuraloperator.github.io/dev/index.html).
21
+
22
+ ## Model Details
23
+
24
+ For benchmarking on the Well, we used the following parameters.
25
+
26
+ | Parameters | Values |
27
+ |-------------|--------|
28
+ | Modes | 16 |
29
+ | Blocks | 4 |
30
+ | Hidden Size | 128 |
31
+
32
+
33
+ ## Trained Model Versions
34
+
35
+ Below is the list of checkpoints available for the training of FNO on different datasets of the Well.
36
+
37
+ | Dataset | Best Learning Rate | Epochs | VRMSE |
38
+ |----------------------------------------|--------------------|--------|--------|
39
+ | [acoustic_scattering_maze](https://huggingface.co/polymathic-ai/FNO-acoustic_scattering_maze) | 1E-3 | 27 | 0.5033 |
40
+ | [active_matter](https://huggingface.co/polymathic-ai/FNO-active_matter) | 5E-3 | 239 | 0.3157 |
41
+ | [convective_envelope_rsg](https://huggingface.co/polymathic-ai/FNO-convective_envelope_rsg) | 1E-4 | 14 | 0.0224 |
42
+ | [gray_scott_reaction_diffusion](https://huggingface.co/polymathic-ai/FNO-gray_scott_reaction_diffusion) | 1E-3 | 46 | 0.2044 |
43
+ | [helmholtz_staircase](https://huggingface.co/polymathic-ai/FNO-helmholtz_staircase) | 5E-4 | 132 | 0.00160|
44
+ | [MHD_64](https://huggingface.co/polymathic-ai/FNO-MHD_64) | 5E-3 | 170 | 0.3352 |
45
+ | [planetswe](https://huggingface.co/polymathic-ai/FNO-planetswe) | 5E-4 | 49 | 0.0855 |
46
+ | [post_neutron_star_merger](https://huggingface.co/polymathic-ai/FNO-post_neutron_star_merger) | 5E-4 | 104 | 0.4144 |
47
+ | [rayleigh_benard](https://huggingface.co/polymathic-ai/FNO-rayleigh_benard) | 1E-4 | 32 | 0.6049 |
48
+ | [rayleigh_taylor_instability](https://huggingface.co/polymathic-ai/FNO-rayleigh_taylor_instability) | 5E-3 | 177 | 0.4013 |
49
+ | [shear_flow](https://huggingface.co/polymathic-ai/FNO-shear_flow) | 1E-3 | 24 | 0.4450 |
50
+ | [supernova_explosion_64](https://huggingface.co/polymathic-ai/FNO-supernova_explosion_64) | 1E-4 | 40 | 0.3804 |
51
+ | [turbulence_gravity_cooling](https://huggingface.co/polymathic-ai/FNO-turbulence_gravity_cooling) | 1E-4 | 13 | 0.2381 |
52
+ | [turbulent_radiative_layer_2D](https://huggingface.co/polymathic-ai/FNO-turbulent_radiative_layer_2D) | 5E-3 | 500 | 0.4906 |
53
+ | [viscoelastic_instability](https://huggingface.co/polymathic-ai/FNO-viscoelastic_instability) | 5E-3 | 205 | 0.7195 |
54
+
55
+
56
+ ## Loading the model from Hugging Face
57
+
58
+ To load the FNO model trained on the `viscoelastic_instability` of the Well, use the following commands.
59
+
60
+ ```python
61
+ from the_well.benchmark.models import FNO
62
+
63
+ model = FNO.from_pretrained("polymathic-ai/FNO-viscoelastic_instability")
64
+ ```
config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "dim_in": 32,
3
+ "dim_out": 8,
4
+ "gradient_checkpointing": false,
5
+ "hidden_channels": 128,
6
+ "modes1": 16,
7
+ "modes2": 16,
8
+ "modes3": 16,
9
+ "n_spatial_dims": 2,
10
+ "spatial_resolution": [
11
+ 512,
12
+ 512
13
+ ]
14
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c3b68712579a86e576b41b1d052cd7cd21c32dfe243fabd469cef25de9a6089
3
+ size 76069152