VRAM Calculator

Model ParametersModel Parameters could be taken from config.json on HuggingFace or directly from model via model.config

[secondlife]

推論・学習時のVRAMをhuggingface の　model config から見積もる “Estimate GPU VRAM usage of transformer-based models.”