12 x H800 machines

#2
by Armaan11 - opened

What are you referring to here? H800 GPU's or the DGX H800 machine (https://viperatech.com/shop/nvidia-dgx-h800-systems/?srsltid=AfmBOopC5v10W0UDH7GQo-wDkNdU4GCuTPJm2-blFUYWCFwOOq5URDvcXsw&gQT=2)?

How do you get to the 1000 dollar cost? A H100 chip is 3$/h. 6 hours on 12 chips is 216$ for the 32B model. Do you have estimates for the 14B model? Are any merges done for the -DS models to achieve the shown benchmark scores?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment