diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..fa450e7a9f1e3a8f7822ca6f110e8e204ef967ed --- /dev/null +++ b/README.md @@ -0,0 +1,66 @@ +--- +base_model: + - black-forest-labs/FLUX.1-dev +base_model_relation: quantized +pipeline_tag: text-to-image +tags: +- dfloat11 +- df11 +- lossless compression +- 70% size, 100% accuracy +--- + +## DFloat11 Compressed Model: `black-forest-labs/FLUX.1-dev` + +This is a **losslessly compressed** version of [`black-forest-labs/FLUX.1-dev`](https://huggingface.co/black-forest-labs/FLUX.1-dev) using our custom **DFloat11** format. The outputs of this compressed model are **bit-for-bit identical** to the original BFloat16 model, while reducing GPU memory consumption by approximately **30%**. + +### ๐Ÿ” How It Works + +DFloat11 compresses model weights using **Huffman coding** of BFloat16 exponent bits, combined with **hardware-aware algorithmic designs** that enable efficient on-the-fly decompression directly on the GPU. During inference, the weights remain compressed in GPU memory and are **decompressed just before matrix multiplications**, then **immediately discarded after use** to minimize memory footprint. + +Key benefits: + +* **No CPU decompression or host-device data transfer** --- all operations are handled entirely on the GPU. +* DFloat11 is **much faster than CPU-offloading approaches**, enabling practical deployment in memory-constrained environments. +* The compression is **fully lossless**, guaranteeing that the modelโ€™s outputs are **bit-for-bit identical** to those of the original model. + +### ๐Ÿ”ง How to Use + +1. Install the DFloat11 pip package *(installs the CUDA kernel automatically; requires a CUDA-compatible GPU and PyTorch installed)*: + + ```bash + pip install dfloat11[cuda12] + # or if you have CUDA version 11: + # pip install dfloat11[cuda11] + ``` + +2. To use the DFloat11 model, run the following example code in Python: + ```python + import torch + from diffusers import FluxPipeline + from dfloat11 import DFloat11Model + + pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16) + pipe.enable_model_cpu_offload() + + DFloat11Model.from_pretrained('DFloat11/FLUX.1-dev-DF11', device='cpu', bfloat16_model=pipe.transformer) + + prompt = "A futuristic cityscape at sunset, with flying cars, neon lights, and reflective water canals" + image = pipe( + prompt, + width=1920, + height=1440, + guidance_scale=3.5, + num_inference_steps=50, + max_sequence_length=512, + generator=torch.Generator(device="cuda").manual_seed(0) + ).images[0] + + image.save("image.png") + ``` + +### ๐Ÿ“„ Learn More + +* **Paper**: [70% Size, 100% Accuracy: Lossless LLM Compression for Efficient GPU Inference via Dynamic-Length Float](https://arxiv.org/abs/2504.11651) +* **GitHub**: [https://github.com/LeanModels/DFloat11](https://github.com/LeanModels/DFloat11) +* **HuggingFace**: [https://huggingface.co/DFloat11](https://huggingface.co/DFloat11) \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000000000000000000000000000000000000..6d42e25282df040793c9b7cfd93dcf79781300ea --- /dev/null +++ b/config.json @@ -0,0 +1,37 @@ +{ + "dfloat11_config": { + "bytes_per_thread": 8, + "pattern_dict": { + "transformer_blocks.\\d+": [ + "norm1.linear", + "norm1_context.linear", + "attn.to_q", + "attn.to_k", + "attn.to_v", + "attn.add_k_proj", + "attn.add_v_proj", + "attn.add_q_proj", + "attn.to_out.0", + "attn.to_add_out", + "ff.net.0.proj", + "ff.net.2", + "ff_context.net.0.proj", + "ff_context.net.2" + ], + "single_transformer_blocks.\\d+": [ + "norm.linear", + "proj_mlp", + "proj_out", + "attn.to_q", + "attn.to_k", + "attn.to_v" + ] + }, + "threads_per_block": [ + 512 + ], + "version": "0.2.0" + }, + "model_type": "llama" + } + \ No newline at end of file diff --git a/diffusion_pytorch_model.safetensors b/diffusion_pytorch_model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1ac11d19959aa2fc4d2b65e6b141f87558f8f4be --- /dev/null +++ b/diffusion_pytorch_model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:377d89f46e79ad75668a94dcf6689897ddf30631a88dd0735fe5a0afa4b3a80e +size 128252176 diff --git a/single_transformer_blocks_0.safetensors b/single_transformer_blocks_0.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c99de68fcded86893120c07b2b2399abade1f6b8 --- /dev/null +++ b/single_transformer_blocks_0.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4211cf5e28046581ec8807137d680d7c45c62bba99fb6aa6eba5b14eb8c6a88 +size 191954551 diff --git a/single_transformer_blocks_1.safetensors b/single_transformer_blocks_1.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..d8c3bad27f650098f805caf55b3cd99051034f59 --- /dev/null +++ b/single_transformer_blocks_1.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c2e0750f62b901215a091a036d24800099df2d2fd8938a05c8588c56fee1bd1 +size 192031127 diff --git a/single_transformer_blocks_10.safetensors b/single_transformer_blocks_10.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b1fc23433b594ab29f616322f234cae0cbdcaa6a --- /dev/null +++ b/single_transformer_blocks_10.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:91f1761a29d5d152d07d9acc728ba1ddc23068e6efc00ea971f91d9de1122ba2 +size 193131890 diff --git a/single_transformer_blocks_11.safetensors b/single_transformer_blocks_11.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8fa49ebf01cd9c88ac7468998e513cfec120958c --- /dev/null +++ b/single_transformer_blocks_11.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f2aac606a63df555da9107805f0ac16a53f01678e4711056dde7471db09e2c85 +size 193361866 diff --git a/single_transformer_blocks_12.safetensors b/single_transformer_blocks_12.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..735d1ba52f1f1d0d3f8e5e572e8d4b63268a1693 --- /dev/null +++ b/single_transformer_blocks_12.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dcc7a2f2a2a5b5878d15406352adbabbc18ab14c1c83a1435d836764b9f4b4d1 +size 193532369 diff --git a/single_transformer_blocks_13.safetensors b/single_transformer_blocks_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..80bef2d9132485e2bac295462436ea8d411b5e80 --- /dev/null +++ b/single_transformer_blocks_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d192f3b8578fd52009936cb4e2545133d8def982869a73f9cf60a6ed3c6f4aaf +size 193559171 diff --git a/single_transformer_blocks_14.safetensors b/single_transformer_blocks_14.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9a6ffa2fc7826b8e1d2a7ce0aa93ff3c745c8620 --- /dev/null +++ b/single_transformer_blocks_14.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ab914fd8d4a4481e278c8d154e71640b9014da7a56816dcf13cabb3015548b3b +size 193554015 diff --git a/single_transformer_blocks_15.safetensors b/single_transformer_blocks_15.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..bcd80c857ada1bfc2cc2458a75c09577c9203a1d --- /dev/null +++ b/single_transformer_blocks_15.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0c0e2d47e56f45364e0c736af1d70cf308c45849e73282587ec3408ef4d55a9d +size 193521141 diff --git a/single_transformer_blocks_16.safetensors b/single_transformer_blocks_16.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5d6da5b47efc9d102078d2dc7ec12ecc55be2cae --- /dev/null +++ b/single_transformer_blocks_16.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e2e285f8c49fe3fec76032abc046f26c2442ddcfdc0356556f682d7c3a8781b +size 193547955 diff --git a/single_transformer_blocks_17.safetensors b/single_transformer_blocks_17.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..e71707e296cfe2d146b85c3b7acc4945fe1a9b42 --- /dev/null +++ b/single_transformer_blocks_17.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e354a425714b8f5e8632d593f169a84fe3b7b9471a9dc30d8f8e7d4f88a22b23 +size 193677798 diff --git a/single_transformer_blocks_18.safetensors b/single_transformer_blocks_18.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..2662c9fc679f6e3cc159f6773244ee5cff8447a9 --- /dev/null +++ b/single_transformer_blocks_18.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1e14f06e0000e2e91730e0727100ae385e75c91306dae7d5a85fb2379185220 +size 193747490 diff --git a/single_transformer_blocks_19.safetensors b/single_transformer_blocks_19.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..392536fe4bb506417790f54369b073bc535c40ed --- /dev/null +++ b/single_transformer_blocks_19.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07cab1ad7c4135534f726fe801dd41f8f9b461ebd6625e096cb44fa86b3bbe36 +size 193753360 diff --git a/single_transformer_blocks_2.safetensors b/single_transformer_blocks_2.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..1be25b493fd997b6fe18a02e2010e372384015db --- /dev/null +++ b/single_transformer_blocks_2.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:334d3256977e0a2d073105130aac323a9348a08f8b14b39a31d2f72980a1fbec +size 192075010 diff --git a/single_transformer_blocks_20.safetensors b/single_transformer_blocks_20.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ae1704895a12509b2e005c49fc92821d73cff505 --- /dev/null +++ b/single_transformer_blocks_20.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ace0adb8a3097031cf3f3d5e6e2df15797523282ad7d5c161b46bea3d8c7e46 +size 193823895 diff --git a/single_transformer_blocks_21.safetensors b/single_transformer_blocks_21.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a5ae344912f253fb3d85b95295a227c22897b958 --- /dev/null +++ b/single_transformer_blocks_21.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:acda6286f934a55cb9335c94439031d818687fd458d602bb67b8f6e4c9fc5c05 +size 194056734 diff --git a/single_transformer_blocks_22.safetensors b/single_transformer_blocks_22.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9b305b1be8a8f4122ab2e5a7bbec6c8abb541dad --- /dev/null +++ b/single_transformer_blocks_22.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2222582007f84efd085b54f5a94ccd5323ab7149ed9c754757d37ffe3d17022d +size 194192022 diff --git a/single_transformer_blocks_23.safetensors b/single_transformer_blocks_23.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c8e20d0789b12c372965f2aa9f906844dde598e0 --- /dev/null +++ b/single_transformer_blocks_23.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a569f253b3aa549e3fc0bd6c6236599c6ee6fba59a24c82bb9b59f555326a299 +size 194424415 diff --git a/single_transformer_blocks_24.safetensors b/single_transformer_blocks_24.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..66d655dfa6cb6d4fe827dddf2d6e68ddc10c40ed --- /dev/null +++ b/single_transformer_blocks_24.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:324ea3f6fa681c4012440091ae174969a392d49d04ac7cd7e79909877bd9d36c +size 194472956 diff --git a/single_transformer_blocks_25.safetensors b/single_transformer_blocks_25.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..fc28602a4e8e2b1d7e176493174d81b4286a0340 --- /dev/null +++ b/single_transformer_blocks_25.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8ff388f14602451a8c178b10c85eb2a78b4257508f42ac83794f7c1925332007 +size 194765359 diff --git a/single_transformer_blocks_26.safetensors b/single_transformer_blocks_26.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9ba05faa8145befb0e1d441dbc17ff185a972120 --- /dev/null +++ b/single_transformer_blocks_26.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1d2ede686ecdd239bfffb615a9913b527b5af7d9e617ae20ced22d7d3f696e43 +size 194846806 diff --git a/single_transformer_blocks_27.safetensors b/single_transformer_blocks_27.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..0cd17297581b5c80dfc270cf5baffc087742cea6 --- /dev/null +++ b/single_transformer_blocks_27.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d456bfc6808ee26e820d26dd36314fdac124905f60e0b49d520b43bcdb4a4996 +size 195184466 diff --git a/single_transformer_blocks_28.safetensors b/single_transformer_blocks_28.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a6fcc9dbafa95326f235307976a45d8a42ee0c57 --- /dev/null +++ b/single_transformer_blocks_28.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:29ebeece5f673318cb58aa510ddaf31f84cbb6b8eefab0111ea37b906cee6d98 +size 195372473 diff --git a/single_transformer_blocks_29.safetensors b/single_transformer_blocks_29.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..65df0a4e4cb3b9ff49eb93b94d0331612b5c0b88 --- /dev/null +++ b/single_transformer_blocks_29.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:98f8efbfb36cc68635bccedb8a44b2064b2f2387ae1178445d32c4d55c440ae1 +size 195196343 diff --git a/single_transformer_blocks_3.safetensors b/single_transformer_blocks_3.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f6d7451f4f43eef400526f0769f425dfd958908b --- /dev/null +++ b/single_transformer_blocks_3.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:776aa35aaf09f725bc1fcd0b8e8b40c3d3b327c5260ef9ee9f179e6026224350 +size 192144267 diff --git a/single_transformer_blocks_30.safetensors b/single_transformer_blocks_30.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b4316e2a298e5153117db1dc2f7ef15c51257c6e --- /dev/null +++ b/single_transformer_blocks_30.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8d17aa12a5524667899187c391d6fbd69a4aa9f6b804595edc6d50214fdf5135 +size 195686128 diff --git a/single_transformer_blocks_31.safetensors b/single_transformer_blocks_31.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..790d23a97c60a85f0324ba31be95c3e90d9980dd --- /dev/null +++ b/single_transformer_blocks_31.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:21c4a84661f1cbe4a6d072191138348e9b6fb3f9e02f462de41331dc10749e38 +size 195846674 diff --git a/single_transformer_blocks_32.safetensors b/single_transformer_blocks_32.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..990b2c6cedce52fec5ea1c78d7525cff821e3e01 --- /dev/null +++ b/single_transformer_blocks_32.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0415b6bda45d0341868833db84562216826d1845877d9d0cbc2d8691046d3962 +size 195802375 diff --git a/single_transformer_blocks_33.safetensors b/single_transformer_blocks_33.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6f052ca8642aac347acccb292f1372876e75d788 --- /dev/null +++ b/single_transformer_blocks_33.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8eb4bd5572e3dff991278a09472023e5b6ba67db10a9c541f8d0355e54518e39 +size 195852599 diff --git a/single_transformer_blocks_34.safetensors b/single_transformer_blocks_34.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..66989be94055f1601b3cb235abab8c5f2ad4cdef --- /dev/null +++ b/single_transformer_blocks_34.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:36555661599e5a73f572910033d00e97cd0f0198f180d621ba8396e54e4feacd +size 196141180 diff --git a/single_transformer_blocks_35.safetensors b/single_transformer_blocks_35.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..98b17ec37f44930f13407529556962853041b610 --- /dev/null +++ b/single_transformer_blocks_35.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0bf7cd21d43bb94e0f01d9e79c95087005551bb2cf3785c00ef3a5de21fa8e06 +size 196399943 diff --git a/single_transformer_blocks_36.safetensors b/single_transformer_blocks_36.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c8956a5478d3ddecdb7cd3a9ab54643d4447ac10 --- /dev/null +++ b/single_transformer_blocks_36.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b7954690700b34b5e0b6dc787d505139bd5c9807b0b1bbd3a1301da948b8871a +size 194730251 diff --git a/single_transformer_blocks_37.safetensors b/single_transformer_blocks_37.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..fbdad4c73dedc952be2093ff9e7df353d09b55ac --- /dev/null +++ b/single_transformer_blocks_37.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2707bed907ccb6fdd138919495fd7bc27d692e1235408dba0324502f0197da0e +size 196580291 diff --git a/single_transformer_blocks_4.safetensors b/single_transformer_blocks_4.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..5b5adbd8874a09f8f9165962ae5f6145581461ba --- /dev/null +++ b/single_transformer_blocks_4.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5fc9b2bc71b95fc000060ce8f46f8c68a8399d418e3e0d065f01ce25269c9e6a +size 192202896 diff --git a/single_transformer_blocks_5.safetensors b/single_transformer_blocks_5.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..74745ec6c7c3f19f17771d68ebcf65f617d553ad --- /dev/null +++ b/single_transformer_blocks_5.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa4f5da1a6f4166a60bc3c4bbde255edd9d5be193062d2f08685416590831f93 +size 192384671 diff --git a/single_transformer_blocks_6.safetensors b/single_transformer_blocks_6.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..eb3e24b0578a994b15b9413fd5614c2095b29ec2 --- /dev/null +++ b/single_transformer_blocks_6.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:16c97740663efc8ce21cad7298f23c0bddf345226ef9645ad5b28a40fc534684 +size 192512824 diff --git a/single_transformer_blocks_7.safetensors b/single_transformer_blocks_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..3e0e23915841609e3f02ee1c10d70671f3f1d838 --- /dev/null +++ b/single_transformer_blocks_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:795195a048e200be26b7cf6fc12e13fa59eb362a8643d9b31b2c459d07f8b0b1 +size 192615572 diff --git a/single_transformer_blocks_8.safetensors b/single_transformer_blocks_8.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..79033acdfa1005c029b5888359da17dddb6f136d --- /dev/null +++ b/single_transformer_blocks_8.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:452107e66a45d7b36a6a66e613a0baf1e022f1d46af6ea804d2d96b7370f5b45 +size 192850028 diff --git a/single_transformer_blocks_9.safetensors b/single_transformer_blocks_9.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..f086be36788bda8c5e34a66fec79f91549ee5548 --- /dev/null +++ b/single_transformer_blocks_9.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:427be4b0f48177122279267ec31d8f39a911eb943b3b9e3e7e0bb43c5ac869a2 +size 192997419 diff --git a/transformer_blocks_0.safetensors b/transformer_blocks_0.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ad0d73d9df6293f83158c9a12ff9b855838f714d --- /dev/null +++ b/transformer_blocks_0.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05ea5daf20aa16d2af261ef3ac03b393265e69aad074a67a850d8a807f5b3de6 +size 471260158 diff --git a/transformer_blocks_1.safetensors b/transformer_blocks_1.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..42aa0fd91adc3f932fc7486ecf98d76bca733f19 --- /dev/null +++ b/transformer_blocks_1.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e96635ed5c9b7c3532ac3e3779b03ff77291bff990d0c9a0f6db5aa7963036e4 +size 471606797 diff --git a/transformer_blocks_10.safetensors b/transformer_blocks_10.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..2097b7475f960d53a333b117ef341383fc6f2dbb --- /dev/null +++ b/transformer_blocks_10.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0df4a60d3adafc84149f2a38b0d79ef580366b40aa996a6c0ab951d1780ae92d +size 463548745 diff --git a/transformer_blocks_11.safetensors b/transformer_blocks_11.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8772b794e32f85bf26668ce307da144669b65d89 --- /dev/null +++ b/transformer_blocks_11.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:38155feefbd2967ddf3130556fa5b2c553c093523932880a5857cd26f21fe3d2 +size 462869820 diff --git a/transformer_blocks_12.safetensors b/transformer_blocks_12.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..39924b5c3cb3f01e755ba5afa859ea73e765cb2b --- /dev/null +++ b/transformer_blocks_12.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a1fad86f3c500292754e8e7e8d7d2c0b3a4751675126ab6dbb0a5f941a914fb2 +size 462838791 diff --git a/transformer_blocks_13.safetensors b/transformer_blocks_13.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..6080c8a74093261410895a1a102ab52f739a1695 --- /dev/null +++ b/transformer_blocks_13.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7126d88b38a8bb18a1f9f2303603fed71519b71ffc7d621283252f4ff8337200 +size 463891204 diff --git a/transformer_blocks_14.safetensors b/transformer_blocks_14.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..a8fca0f558310aa5fe3d378e73329973800ba9f4 --- /dev/null +++ b/transformer_blocks_14.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc4f018794e7b728d816c9a45bcb7d1ceb5eb76c5c0df38bd9f95b0c7cdacb87 +size 462471841 diff --git a/transformer_blocks_15.safetensors b/transformer_blocks_15.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..c2b961740685099bd4d411229faff5445bbb8c20 --- /dev/null +++ b/transformer_blocks_15.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40081bea75a312a8deb18876c1cfa3144cd3915143edc8e1d61a9bf9fd597ccf +size 461519724 diff --git a/transformer_blocks_16.safetensors b/transformer_blocks_16.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b5f1898dcb432f94fa722dc83b173d948c38c6a7 --- /dev/null +++ b/transformer_blocks_16.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:84e7852f8e201cf7585366cd3b160e3fe3169d7d49bf12621dc9aa859e13f094 +size 461572890 diff --git a/transformer_blocks_17.safetensors b/transformer_blocks_17.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..edaf3f08df4ad2a3d504afd0a91cab0bd19b8384 --- /dev/null +++ b/transformer_blocks_17.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6257a3c62878abcb65f8bef15fef4d89981112dc943efba799aa306dd9d1c86 +size 461393733 diff --git a/transformer_blocks_18.safetensors b/transformer_blocks_18.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..532a44cab2893f5a80f2bf08d33476f27d2bb549 --- /dev/null +++ b/transformer_blocks_18.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed359660cd4c526f2d371924ad580cd1ecd4f891781703cccb6f8d008127ccc8 +size 461832516 diff --git a/transformer_blocks_2.safetensors b/transformer_blocks_2.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..028a2b3b54ab18d8e9bcb975e0e9cdbc014c2793 --- /dev/null +++ b/transformer_blocks_2.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d35e6e02e52308cd209fa4f4e98a717cfb301d1c77d033307aa9313bc0cd7484 +size 472178591 diff --git a/transformer_blocks_3.safetensors b/transformer_blocks_3.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..16bd7a45f8b5f2285fbfe657c7c0c9737a3b7bd5 --- /dev/null +++ b/transformer_blocks_3.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:992dc3ccdb0f1565f6f6702a215578401d7239a31f286315c300e3b6c7b9d302 +size 467731468 diff --git a/transformer_blocks_4.safetensors b/transformer_blocks_4.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..0519be5a5b5750cdf36edbacaa910ab824b7aa82 --- /dev/null +++ b/transformer_blocks_4.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71c9e0467f39ece52163de5ac04a519b0a2f6838c48130e84a295c8adb25252f +size 465475628 diff --git a/transformer_blocks_5.safetensors b/transformer_blocks_5.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..79dc5ad9ef4344a57a0ea924f8add5d68e5b9909 --- /dev/null +++ b/transformer_blocks_5.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0f02187f4d55be888089aa54903492179c0e11a0889a1b02b004d1e9097561bb +size 464722097 diff --git a/transformer_blocks_6.safetensors b/transformer_blocks_6.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..9194817df9495d93cc75fc045b793efb349a2335 --- /dev/null +++ b/transformer_blocks_6.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f1964fde9d80b1beed251955490ea7fdd4dd3140d74949903ed66a4f8e617feb +size 464600506 diff --git a/transformer_blocks_7.safetensors b/transformer_blocks_7.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..b9f688c591f23830491599745cd0074fdebba913 --- /dev/null +++ b/transformer_blocks_7.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ecd9ce4146abbcaed9aae0de724b4882fb976c632538e1c2a93c79e861dee7ca +size 464052802 diff --git a/transformer_blocks_8.safetensors b/transformer_blocks_8.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..42d5d78748bd8d264d4781920cdc8c9a830bd87f --- /dev/null +++ b/transformer_blocks_8.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:542829e004230278557ddc78c1a89c2e67667ed8d1e2236721ad7fc7a809042e +size 463369639 diff --git a/transformer_blocks_9.safetensors b/transformer_blocks_9.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..076f60fbd7a030162a4e4d3e5f73c9d273eb6a0a --- /dev/null +++ b/transformer_blocks_9.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e0cb6dc72135c2ed62964033b5bb120e7d3d2afae54990a6bac74e0de8b9883a +size 462415680