Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
11
1
19
Debasish Dhal
DebasishDhal99
Follow
0 followers
·
1 following
AI & ML interests
None yet
Recent Activity
updated
a dataset
about 9 hours ago
DebasishDhal99/IAST-corpus
reacted
to
ImranzamanML
's
post
with 👍
9 days ago
Here is how we can calculate the size of any LLM model: Each parameter in LLM models is typically stored as a floating-point number. The size of each parameter in bytes depends on the precision. 32-bit precision: Each parameter takes 4 bytes. 16-bit precision: Each parameter takes 2 bytes To calculate the total memory usage of the model: Memory usage (in bytes) = No. of Parameters × Size of Each Parameter For example: 32-bit Precision (FP32) In 32-bit floating-point precision, each parameter takes 4 bytes. Memory usage in bytes = 1 billion parameters × 4 bytes 1,000,000,000 × 4 = 4,000,000,000 bytes In gigabytes: ≈ 3.73 GB 16-bit Precision (FP16) In 16-bit floating-point precision, each parameter takes 2 bytes. Memory usage in bytes = 1 billion parameters × 2 bytes 1,000,000,000 × 2 = 2,000,000,000 bytes In gigabytes: ≈ 1.86 GB It depends on whether you use 32-bit or 16-bit precision, a model with 1 billion parameters would use approximately 3.73 GB or 1.86 GB of memory, respectively.
upvoted
a
paper
11 days ago
A Survey on Knowledge Distillation of Large Language Models
View all activity
Organizations
DebasishDhal99
's activity
All
Models
Datasets
Spaces
Papers
Collections
Community
Posts
Upvotes
Likes
liked
a model
8 months ago
google/gemma-7b
Text Generation
•
Updated
Jun 27
•
53.9k
•
•
3.08k
liked
a Space
10 months ago
Running
121
📸
OCR Image To Text
liked
a dataset
10 months ago
mozilla-foundation/common_voice_16_1
Viewer
•
Updated
Jan 16
•
8.03M
•
3.1k
•
50
liked
3 datasets
11 months ago
bigscience/xP3all
Viewer
•
Updated
May 30, 2023
•
47.8M
•
4.86k
•
28
uonlp/CulturaX
Viewer
•
Updated
9 days ago
•
7.18B
•
15.9k
•
484
ai4bharat/IndicParaphrase
Viewer
•
Updated
Oct 13, 2022
•
5.56M
•
167
•
4
liked
a model
about 1 year ago
clem/gemini
Updated
Dec 6, 2023
•
90
liked
5 datasets
about 1 year ago
databricks/databricks-dolly-15k
Viewer
•
Updated
Jun 30, 2023
•
15k
•
13.3k
•
774
facebook/mlqa
Updated
Jan 18
•
7.28k
•
41
google/xtreme
Viewer
•
Updated
Feb 22
•
2.77M
•
31.9k
•
94
google/xquad
Viewer
•
Updated
Jan 4
•
14.3k
•
2.15k
•
28
ai4bharat/IndicQA
Updated
Sep 11
•
227
•
7
liked
3 models
about 1 year ago
01-ai/Yi-34B
Text Generation
•
Updated
Nov 11
•
3.98k
•
1.29k
TheBloke/Yi-34B-200K-Llamafied-GGUF
Updated
Nov 11, 2023
•
208
•
13
AP123/dripped-out
Text-to-Image
•
Updated
Oct 19, 2023
•
4
•
•
2
liked
a Space
about 1 year ago
Running
on
Zero
4.83k
👁
IllusionDiffusion
Generate stunning high quality illusion artwork
liked
a dataset
about 1 year ago
Divyanshu/indicxnli
Viewer
•
Updated
Oct 6, 2022
•
4.4M
•
399
•
4
liked
a Space
about 1 year ago
Runtime error
2
🐠
Olive Farm
liked
a Space
over 1 year ago
Running
8
🦀
Camel Data Explorer