Skip to main content

Compare GPUs

GPU specification comparison
Specp4d.24xlarge (8x A100 40GB)B300
ProviderAWSRunPod
VRAM320 GB288 GB
Architecture——
Compute cap.——
Mem. bandwidth——
GPUs / instance11
vCPU——
System RAM——
Network——
CUDA cores55,296—
Tensor cores3,456—
TDP3200 W—
InterconnectNVLink—
Per hour$19.38/hr$7.39/hr
Per month$14147.40—
AvailableYesYes
Regions2—

Observed · read from provider listings, not ranked