12 x H800 machines
#2
by
Armaan11
- opened
What are you referring to here? H800 GPU's or the DGX H800 machine (https://viperatech.com/shop/nvidia-dgx-h800-systems/?srsltid=AfmBOopC5v10W0UDH7GQo-wDkNdU4GCuTPJm2-blFUYWCFwOOq5URDvcXsw&gQT=2)?
How do you get to the 1000 dollar cost? A H100 chip is 3$/h. 6 hours on 12 chips is 216$ for the 32B model. Do you have estimates for the 14B model? Are any merges done for the -DS models to achieve the shown benchmark scores?