Update README.md (#2)
Browse files- Update README.md (fd014644d94616646ae876582e9ecd969f7db61a)
Co-authored-by: Mark Boss <[email protected]>
README.md
CHANGED
@@ -4,6 +4,8 @@ license_name: stabilityai-ai-community
|
|
4 |
license_link: LICENSE.md
|
5 |
tags:
|
6 |
- image-to-3d
|
|
|
|
|
7 |
inference: false
|
8 |
pipeline_tag: image-to-3d
|
9 |
extra_gated_prompt: >-
|
@@ -24,31 +26,39 @@ extra_gated_fields:
|
|
24 |
---
|
25 |
|
26 |
|
27 |
-
# SPAR3D: Stable Point
|
28 |
![](spar3d.gif)
|
|
|
29 |
|
30 |
-
|
|
|
31 |
|
32 |
|
33 |
### Model Description
|
34 |
|
35 |
* **Developed by**: [Stability AI](https://stability.ai/)
|
36 |
* **Model type**: Transformer image-to-3D model
|
37 |
-
* **Model details**: This model is
|
|
|
38 |
|
39 |
|
40 |
### License
|
41 |
|
42 |
-
- **Community License:** Free for research, non-commercial, and commercial use by organizations and individuals generating annual revenue of US $1,000,000 (or local currency equivalent) or
|
43 |
|
44 |
|
45 |
### Model Sources
|
46 |
|
47 |
-
* **Repository**: https://github.com/Stability-AI/stable-point-aware-3d
|
48 |
-
* **Tech report**:
|
49 |
-
* **Video summary**: https://youtu.be/
|
50 |
-
* **Project page**: https://
|
51 |
-
* **arXiv page**:
|
|
|
|
|
|
|
|
|
|
|
52 |
|
53 |
|
54 |
## Usage
|
@@ -73,7 +83,7 @@ The model was not trained to be factual or true representations of people or eve
|
|
73 |
|
74 |
## Safety
|
75 |
|
76 |
-
As part of our safety-by-design and responsible AI deployment approach, we implement safety measures throughout the development of our models, from the time we begin pre-training a model to the ongoing development, fine-tuning, and deployment of each model. We have implemented a number of safety mitigations that are intended to reduce the risk of severe harms. However,
|
77 |
For more about our approach to Safety, please visit our [Safety page](https://stability.ai/safety).
|
78 |
|
79 |
|
|
|
4 |
license_link: LICENSE.md
|
5 |
tags:
|
6 |
- image-to-3d
|
7 |
+
datasets:
|
8 |
+
- allenai/objaverse
|
9 |
inference: false
|
10 |
pipeline_tag: image-to-3d
|
11 |
extra_gated_prompt: >-
|
|
|
26 |
---
|
27 |
|
28 |
|
29 |
+
# SPAR3D: Stable Point Aware 3D
|
30 |
![](spar3d.gif)
|
31 |
+
**Stable Point Aware 3D (SPAR3D)** is a large reconstruction model based on [SF3D](https://huggingface.co/stabilityai/stable-fast-3d), that introduces the ability to make real-time edits and generate a textured UV-unwrapped 3D mesh asset from a single image in less than a second. By introducing a first-of-its-kind two-stage architecture, SPAR3D combines the benefits of a fast point cloud diffusion model with regressive mesh predictions to enable unparalleled control over 3D object generation.
|
32 |
|
33 |
+
|
34 |
+
Please note: For individuals or organizations generating annual revenue of US $1,000,000 (or local currency equivalent) or more, regardless of the source of that revenue, you must obtain an enterprise commercial license directly from Stability AI before commercially using SPAR3D, any derivative work of SPAR3D (such as a “fine tune” model), or their outputs. You may submit a request for an Enterprise License at https://stability.ai/enterprise. Please refer to Stability AI's Community License, available at https://stability.ai/license, for more information.
|
35 |
|
36 |
|
37 |
### Model Description
|
38 |
|
39 |
* **Developed by**: [Stability AI](https://stability.ai/)
|
40 |
* **Model type**: Transformer image-to-3D model
|
41 |
+
* **Model details**: This model is trained to create a 3D model from a single image in under one second. The asset is UV-unwrapped and textured. We also perform a delighting step, enabling easier asset usage in downstream applications such as game engines or rendering work. The model also predicts per-object material parameters (roughness, metallic), enhancing reflective behaviors during rendering. The model expects an input size of 512x512 pixels. We achieve improved backside modelling using a fast point diffusion model, which acts as a conditioning.
|
42 |
+
Please check our [tech report]() and [video summary](https://youtu.be/mlO3Nc3Nsng) for details.
|
43 |
|
44 |
|
45 |
### License
|
46 |
|
47 |
+
- **Community License:** Free for research, non-commercial, and commercial use by organizations and individuals generating annual revenue of US $1,000,000 (or local currency equivalent) or more, regardless of the source of that revenue. If your annual revenue exceeds US $1M, any commercial use of this model or derivative works thereof requires obtaining an Enterprise License directly from Stability AI. You may submit a request for an Enterprise License at https://stability.ai/enterprise. Please refer to Stability AI's Community License, available at https://stability.ai/license, for more information.
|
48 |
|
49 |
|
50 |
### Model Sources
|
51 |
|
52 |
+
* **Repository**: [https://github.com/Stability-AI/stable-point-aware-3d](https://github.com/Stability-AI/stable-point-aware-3d)
|
53 |
+
* **Tech report**: soon
|
54 |
+
* **Video summary**: [https://youtu.be/mlO3Nc3Nsng](https://youtu.be/mlO3Nc3Nsng)
|
55 |
+
* **Project page**: [https://spar3d.github.io](https://spar3d.github.io)
|
56 |
+
* **arXiv page**: soon
|
57 |
+
|
58 |
+
|
59 |
+
### Training Dataset
|
60 |
+
|
61 |
+
We use renders from the [Objaverse](https://objaverse.allenai.org/) dataset, available under the Open Data Commons Attribution License. We utilize our enhanced rendering method, which more closely replicates the distribution of images found in the real world, significantly improving our model's ability to generalize. We filter objects based on the review of licenses and curate a subset suitable for our training needs.
|
62 |
|
63 |
|
64 |
## Usage
|
|
|
83 |
|
84 |
## Safety
|
85 |
|
86 |
+
As part of our safety-by-design and responsible AI deployment approach, we implement safety measures throughout the development of our models, from the time we begin pre-training a model to the ongoing development, fine-tuning, and deployment of each model. We have implemented a number of safety mitigations that are intended to reduce the risk of severe harms. However, it is the responsibility of developers to conduct their own testing and apply additional mitigations based on their specific use cases.
|
87 |
For more about our approach to Safety, please visit our [Safety page](https://stability.ai/safety).
|
88 |
|
89 |
|