Compare
Compare your next GPU.
Hardware, rental rates and full-instance costs, side by side.
Rates dated Oct 14, 2026–Oct 14, 2026
Publication dates, not live quotes. Confirm the current rate and capacity with the provider.
Catalog generated .
Compare listed rental prices
Listed compute rates. Storage, transfer and other fees are extra.
28 listed offers · On-demand · 1 GPU per instance · ordered by per-GPU hourly price.
Different GPUs are workload alternatives, not performance equivalents. Match VRAM, variant, region and instance size before comparing rates. “Unspecified” means the source name does not identify PCIe or SXM.
| Provider / GPU / variant | VRAM per GPU | Pricing | Per GPU / hr | Full instance / hr | Region | Provider / rate date |
|---|---|---|---|---|---|---|
| DataCrunch A100 80GB · Unspecified Instance: 1A100.22V Link to offer | 80 GB | On-demand | $1.98 | $1.98 1 GPUs | FIN-01 Stock unknown Stock & project cost | Check provider priceRate dated |
| Google Cloud A100 80GB · Unspecified Instance: a2-ultragpu-1g Link to offer | 80 GB | On-demand | $3.22 | $3.22 1 GPUs | us-east5-a Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · PCIe Instance: gpu_1x_h100_pcie Link to offer | 80 GB | On-demand | $3.29 | $3.29 1 GPUs | asia-northeast-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · PCIe Instance: gpu_1x_h100_pcie Link to offer | 80 GB | On-demand | $3.29 | $3.29 1 GPUs | europe-central-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · PCIe Instance: gpu_1x_h100_pcie Link to offer | 80 GB | On-demand | $3.29 | $3.29 1 GPUs | me-west-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · PCIe Instance: gpu_1x_h100_pcie Link to offer | 80 GB | On-demand | $3.29 | $3.29 1 GPUs | us-east-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · PCIe Instance: gpu_1x_h100_pcie Link to offer | 80 GB | On-demand | $3.29 | $3.29 1 GPUs | australia-east-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Azure A100 80GB · Unspecified Instance: Standard_NC24ads_A100_v4 Link to offer | 80 GB | On-demand | $3.67 | $3.67 1 GPUs | eastus Stock unknown Stock & project cost | Check provider priceRate dated |
| Google Cloud A100 80GB · Unspecified Instance: a2-ultragpu-1g Link to offer | 80 GB | On-demand | $3.68 | $3.68 1 GPUs | asia-southeast1-c Stock unknown Stock & project cost | Check provider priceRate dated |
| RunPod H100 80GB · Unspecified Instance: NVIDIA H100 80GB HBM3 Link to offer | 80 GB | On-demand | $3.99 | $3.99 1 GPUs | AP-JP-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| RunPod H100 80GB · Unspecified Instance: NVIDIA H100 80GB HBM3 Link to offer | 80 GB | On-demand | $3.99 | $3.99 1 GPUs | EUR-NO-2 Stock unknown Stock & project cost | Check provider priceRate dated |
| RunPod H100 80GB · Unspecified Instance: NVIDIA H100 80GB HBM3 Link to offer | 80 GB | On-demand | $3.99 | $3.99 1 GPUs | CA-MTL-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| DataCrunch H100 80GB · Unspecified Instance: 1H100.80S.30V Link to offer | 80 GB | On-demand | $4.13 | $4.13 1 GPUs | FIN-01 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · SXM5 Instance: gpu_1x_h100_sxm5 Link to offer | 80 GB | On-demand | $4.29 | $4.29 1 GPUs | asia-northeast-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · SXM5 Instance: gpu_1x_h100_sxm5 Link to offer | 80 GB | On-demand | $4.29 | $4.29 1 GPUs | europe-central-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · SXM5 Instance: gpu_1x_h100_sxm5 Link to offer | 80 GB | On-demand | $4.29 | $4.29 1 GPUs | me-west-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · SXM5 Instance: gpu_1x_h100_sxm5 Link to offer | 80 GB | On-demand | $4.29 | $4.29 1 GPUs | us-east-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Lambda H100 80GB · SXM5 Instance: gpu_1x_h100_sxm5 Link to offer | 80 GB | On-demand | $4.29 | $4.29 1 GPUs | australia-east-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Azure A100 80GB · Unspecified Instance: Standard_NC24ads_A100_v4 Link to offer | 80 GB | On-demand | $4.41 | $4.41 1 GPUs | northeurope Stock unknown Stock & project cost | Check provider priceRate dated |
| Nebius H100 80GB · SXM Instance: gpu-h100-sxm 1gpu-16vcpu-200gb Link to offer | 80 GB | On-demand | $4.50 | $4.50 1 GPUs | eu-north1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Azure A100 80GB · Unspecified Instance: Standard_NC24ads_A100_v4 Link to offer | 80 GB | On-demand | $4.78 | $4.78 1 GPUs | southeastasia Stock unknown Stock & project cost | Check provider priceRate dated |
| Azure A100 80GB · Unspecified Instance: Standard_NC24ads_A100_v4 Link to offer | 80 GB | On-demand | $5.33 | $5.33 1 GPUs | australiaeast Stock unknown Stock & project cost | Check provider priceRate dated |
| Google Cloud A100 80GB · Unspecified Instance: a2-ultragpu-1g Link to offer | 80 GB | On-demand | $5.58 | $5.58 1 GPUs | europe-west4-a Stock unknown Stock & project cost | Check provider priceRate dated |
| AWS H100 80GB · Unspecified Instance: p5.4xlarge Link to offer | 80 GB | On-demand | $6.88 | $6.88 1 GPUs | us-east-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| Azure A100 80GB · Unspecified Instance: Standard_NC24ads_A100_v4 Link to offer | 80 GB | On-demand | $7.35 | $7.35 1 GPUs | brazilsouth Stock unknown Stock & project cost | Check provider priceRate dated |
| AWS H100 80GB · Unspecified Instance: p5.4xlarge Link to offer | 80 GB | On-demand | $7.36 | $7.36 1 GPUs | eu-north-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| AWS H100 80GB · Unspecified Instance: p5.4xlarge Link to offer | 80 GB | On-demand | $8.26 | $8.26 1 GPUs | ap-south-1 Stock unknown Stock & project cost | Check provider priceRate dated |
| AWS H100 80GB · Unspecified Instance: p5.4xlarge Link to offer | 80 GB | On-demand | $11.56 | $11.56 1 GPUs | sa-east-1 Stock unknown Stock & project cost | Check provider priceRate dated |
Manufacturer specifications, with conditions
Reviewed September 26, 2026 against NVIDIA documentation. These are hardware specifications and theoretical peaks, not NVGPU measurements or third-party benchmark results. Sparse Tensor Core peaks require supported structured sparsity; they are not expected dense training throughput.
| Reference variant | Memory | Memory bandwidth | FP16 Tensor Core peak | Conditions and source |
|---|---|---|---|---|
| H200 SXM | 141 GB HBM3e | 4.8 TB/s | Not compared here | HGX reference configuration. Confirm the rental SKU and reported memory; memory capacity alone is not a throughput result. NVIDIA source |
| B200 SXM | 180 GB HBM3e | Up to 8 TB/s | Not compared here | HGX reference configuration; do not apply it to GB200 or other Blackwell products. Verify framework support and the exact rental configuration. NVIDIA source |
| H100 SXM | 80 GB HBM3 | 3.35 TB/s | 1,979 TFLOPS with sparsity | SXM reference; do not apply its bandwidth or peak throughput to an unspecified or PCIe rental. NVIDIA source |
| H100 NVL (per GPU) | 94 GB HBM3 | 3.9 TB/s | 1,671 TFLOPS with sparsity | NVL is distinct from H100 80GB. A two-GPU NVL pair has 188 GB combined memory; that is not per-GPU VRAM. NVIDIA source |
| A100 80GB PCIe / SXM | 80 GB HBM2e | 1,935 / 2,039 GB/s | 312 dense / 624 with sparsity | PCIe and SXM have different bandwidth and host configurations. Both peak figures are manufacturer specifications. NVIDIA source |
| A100 40GB PCIe / SXM | 40 GB HBM2 | 1,555 GB/s | 312 dense / 624 with sparsity | 40GB is a separate capacity; matching arithmetic throughput does not mean a workload will fit. NVIDIA source |
| L40S | 48 GB GDDR6 ECC | 864 GB/s | 733 TFLOPS with sparsity | No NVLink. Check PCIe communication overhead for workloads split across GPUs. NVIDIA source |
| GeForce RTX 4090 | 24 GB GDDR6X | Not compared here | Not compared here | No NVLink. Memory capacity and software support constrain suitable workloads; no training-speed result is implied. NVIDIA source |
NVGPU has not run application benchmarks for these comparisons. To assess a third-party result, require the model and revision, precision, batch size, sequence lengths, GPU count and variant, software versions, interconnect, test date and methodology.
Choosing between GPUs
Start with measured memory use. An RTX 4090 reference card has 24 GB; L40S has 48 GB; A100 comes in 40 GB and 80 GB variants. H100 80GB and H100 NVL 94GB are distinct. We infer that more memory can enable larger models, batches or KV caches, but capacity alone does not predict speed.
For multi-GPU training, check the actual rental topology. NVIDIA lists NVLink for the H100 and A100 reference systems, while L40S and RTX 4090 do not have NVLink. The GPU name does not establish that a cloud instance connects every GPU that way. Ask for topology and benchmark communication overhead.
For inference, measure tokens per second and latency at your intended concurrency and context lengths. For training, compare time and total cost to the same quality target. Compute cost equals the whole-instance hourly rate multiplied by billed hours, including setup and idle time. A lower hourly rate can still produce a higher job cost.
Plan an AI training comparison · Cloud versus local costs · Report a correction