Hugging Face's logo

mukowaty
/
ggml-whisper

whisper
ggml
Model card Files Community
mkiol commited on
Commit
410ecfe
•
1 Parent(s): 743aa7d

add openvino models

Browse files

quantized INT4 with audio_ctx=1000

Files changed (31) hide show
  1. README.md +3 -1
  2. en/ggml-base-en-encoder-openvino-int4/audio_ctx.config +1 -0
  3. en/ggml-base-en-encoder-openvino-int4/ggml-base-en-encoder-openvino.bin +3 -0
  4. en/ggml-base-en-encoder-openvino-int4/ggml-base-en-encoder-openvino.xml +0 -0
  5. en/ggml-medium-en-encoder-openvino-int4/audio_ctx.config +1 -0
  6. en/ggml-medium-en-encoder-openvino-int4/ggml-medium-en-encoder-openvino.bin +3 -0
  7. en/ggml-medium-en-encoder-openvino-int4/ggml-medium-en-encoder-openvino.xml +0 -0
  8. en/ggml-small-en-encoder-openvino-int4/audio_ctx.config +1 -0
  9. en/ggml-small-en-encoder-openvino-int4/ggml-small-en-encoder-openvino.bin +3 -0
  10. en/ggml-small-en-encoder-openvino-int4/ggml-small-en-encoder-openvino.xml +0 -0
  11. en/ggml-tiny-en-encoder-openvino-int4/audio_ctx.config +1 -0
  12. en/ggml-tiny-en-encoder-openvino-int4/ggml-tiny-en-encoder-openvino.bin +3 -0
  13. en/ggml-tiny-en-encoder-openvino-int4/ggml-tiny-en-encoder-openvino.xml +0 -0
  14. multilang/ggml-base-encoder-openvino-int4/audio_ctx.config +1 -0
  15. multilang/ggml-base-encoder-openvino-int4/ggml-base-encoder-openvino.bin +3 -0
  16. multilang/ggml-base-encoder-openvino-int4/ggml-base-encoder-openvino.xml +0 -0
  17. multilang/ggml-large-v2-encoder-openvino-int4/audio_ctx.config +1 -0
  18. multilang/ggml-large-v2-encoder-openvino-int4/ggml-large-v2-encoder-openvino.bin +3 -0
  19. multilang/ggml-large-v2-encoder-openvino-int4/ggml-large-v2-encoder-openvino.xml +0 -0
  20. multilang/ggml-large-v3-encoder-openvino-int4/audio_ctx.config +1 -0
  21. multilang/ggml-large-v3-encoder-openvino-int4/ggml-large-v3-encoder-openvino.bin +3 -0
  22. multilang/ggml-large-v3-encoder-openvino-int4/ggml-large-v3-encoder-openvino.xml +0 -0
  23. multilang/ggml-medium-encoder-openvino-int4/audio_ctx.config +1 -0
  24. multilang/ggml-medium-encoder-openvino-int4/ggml-medium-encoder-openvino.bin +3 -0
  25. multilang/ggml-medium-encoder-openvino-int4/ggml-medium-encoder-openvino.xml +0 -0
  26. multilang/ggml-small-encoder-openvino-int4/audio_ctx.config +1 -0
  27. multilang/ggml-small-encoder-openvino-int4/ggml-small-encoder-openvino.bin +3 -0
  28. multilang/ggml-small-encoder-openvino-int4/ggml-small-encoder-openvino.xml +0 -0
  29. multilang/ggml-tiny-encoder-openvino-int4/audio_ctx.config +1 -0
  30. multilang/ggml-tiny-encoder-openvino-int4/ggml-tiny-encoder-openvino.bin +3 -0
  31. multilang/ggml-tiny-encoder-openvino-int4/ggml-tiny-encoder-openvino.xml +0 -0
README.md CHANGED
@@ -15,7 +15,9 @@ tags:
15
  - ggml
16
  ---
17
 
18
- whisper models converted to [ggml](https://github.com/ggerganov/whisper.cpp) format and quantized
 
 
19
 
20
  multilang
21
 
 
15
  - ggml
16
  ---
17
 
18
+ Whisper models converted to [ggml](https://github.com/ggerganov/whisper.cpp) format and quantized q5_0.
19
+ Whisper encoder model converted to [OpenVINO] format and quantized INT4
20
+
21
 
22
  multilang
23
 
en/ggml-base-en-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
en/ggml-base-en-encoder-openvino-int4/ggml-base-en-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f052a504a788d147a7916fae9012ff458b7953c4c8efd00a667fa2223e1b665b
3
+ size 13357789
en/ggml-base-en-encoder-openvino-int4/ggml-base-en-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
en/ggml-medium-en-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
en/ggml-medium-en-encoder-openvino-int4/ggml-medium-en-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5f55e5057e59787e00daa5a363ad2826da775057b829bc8d6429841b1016cc8
3
+ size 166438109
en/ggml-medium-en-encoder-openvino-int4/ggml-medium-en-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
en/ggml-small-en-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
en/ggml-small-en-encoder-openvino-int4/ggml-small-en-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a027bed402440596be5cb62602103a196468becfc9ef2789cd88da52e99259d5
3
+ size 50424797
en/ggml-small-en-encoder-openvino-int4/ggml-small-en-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
en/ggml-tiny-en-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
en/ggml-tiny-en-encoder-openvino-int4/ggml-tiny-en-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd045c138742d976403d10e372d3904e1d99257b193f219c588d78025b641c21
3
+ size 6089309
en/ggml-tiny-en-encoder-openvino-int4/ggml-tiny-en-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
multilang/ggml-base-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
multilang/ggml-base-encoder-openvino-int4/ggml-base-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:940745f0cdf8a6bd0ba0b786b54236eb4dbb77b20bee18b3e14280dd6c388122
3
+ size 13357789
multilang/ggml-base-encoder-openvino-int4/ggml-base-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
multilang/ggml-large-v2-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
multilang/ggml-large-v2-encoder-openvino-int4/ggml-large-v2-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5ca2bf814f243e93fe36a455d5c94ddd99ef24c49b53a5b124f79ae1b40ac73
3
+ size 339918301
multilang/ggml-large-v2-encoder-openvino-int4/ggml-large-v2-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
multilang/ggml-large-v3-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
multilang/ggml-large-v3-encoder-openvino-int4/ggml-large-v3-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db8eee1ae9959f6e6f033dc0fda9a867a6056a16dcb5bda743d2ace01dbb88db
3
+ size 340102621
multilang/ggml-large-v3-encoder-openvino-int4/ggml-large-v3-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
multilang/ggml-medium-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
multilang/ggml-medium-encoder-openvino-int4/ggml-medium-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9aec1285f281b9bd43883956dfe223e650d2d50e7206b248cb10c6dd1d590cfc
3
+ size 166438109
multilang/ggml-medium-encoder-openvino-int4/ggml-medium-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
multilang/ggml-small-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
multilang/ggml-small-encoder-openvino-int4/ggml-small-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4986d258697479672f34dc229cd4574259764594cb26877ee203ebef0c929cd9
3
+ size 50424797
multilang/ggml-small-encoder-openvino-int4/ggml-small-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff
 
multilang/ggml-tiny-encoder-openvino-int4/audio_ctx.config ADDED
@@ -0,0 +1 @@
 
 
1
+ 1000
multilang/ggml-tiny-encoder-openvino-int4/ggml-tiny-encoder-openvino.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48bdde4b4395d9d777e98b8c67285cac22f06006326d873966adbc5f394a768c
3
+ size 6089309
multilang/ggml-tiny-encoder-openvino-int4/ggml-tiny-encoder-openvino.xml ADDED
The diff for this file is too large to render. See raw diff