ML Paramter Calculator

Parameter count (Billions)Choose a datatype:Choose an optimizerData size fed to GPU

Data Size Helpers functions

Optional: Max tokens (uses int32)Optional: Token Batch Size

(Paste this in Datasize feeded in GPU) Tokens in GB: 0

VRam Required for inference: 0 GB

Estimated minimum training VRam : 0 GB

*Reccomendations is based on GPT J requirments

Reccomended VRam for Training: 0 GB