Cloud GPU

Cloud GPU

GPU Rental

• Vast.ai
• Lambda
• CoreWeave
• RunPod
• Jarvislabs.ai
• DataCrunch
• Fluidstack
• Genesis Cloud
• Crusoe Cloud
• Paperspace - Gradient Pricing Monthly

Cloud Comparison

• CloudOptimizer
• Cloud GPUs

GPU Rent Price Comparison per hour

1xA100, 40GB, Vast, $0.828-$1.372
1xA100, 40GB, Jarvis, $1.29 1xA100, 40GB, Runpod,$0.89
1xA100, 40GB, Lambda, $1.1 1xA100, 40GB, Coreweave,$2.06
1xA100, 40GB, CrusoeCloud, $2.35

1xA100, 80GB, Vast, $0.852 1xA100, 80GB, Runpod,$2.04
2xA100, 80GB, Lambda, $2.2 1xA100, 80GB, Coreweave.,$2.21
1xA100, 80GB, Datacrunch, $2.2 1xA100, 80GB, Fluidstack,$1.94
1xA100, 80GB, CrusoeCloud, $2.85

1xA6000, 48GB, Vast, $0.587-$1.001
1xA6000, 48GB, Jarivs, $0.99 1xA6000, 48GB, Runpod,$0.74
1xA6000, 48GB, Lambda, $0.80 1xA6000, 48GB, Coreweave,$1.28
1xA6000, 48GB, Datacrunch, $0.99

1xRTX3090, 24GB, Vast, $0.18-$0.353
1xRTX3090, 24GB, Runpod, $0.39 1xRTX3090, 24GB, Genesis,$1.30

1xV100, 16GB, Vast, $0.372 1xV100, 16GB, Runpod,$0.28
1xV100, 16GB, Coreweave, $0.80 1xV100, 16GB, Google,$0.74
1xV100, 16GB, Amazon, $0.918 1xV100, 16GB, Datacrunch,$0.89
1xV100, 16GB, Fluidstack. $0.8

Storage Price per month

Runpod $0.20/GB Coreweave$0.04/GB

Best Bang to Bucks GPU for ML

GPU Benchmarks for Deep Learning - Lambda
AI-Benchmark
The Best GPUs for Deep Learning in 2023 — An In-depth Analysis
Razer Core X - Thunderbolt™ 3 eGPU External GPU

• 12 GB RTX 3060 (recommended, cheap, low thermal, great memory) start from Rp6.000.000
• 12 GB A2000 (slightly less powerful than 3060 but only 75w power)
• 12 GB RTX 3060 Ti
• 24 GB RTX 3090 (two times performances of 3060) start form Rp12.000.000
• used Tesla V100 32GB

GPU Rank

RTX 3090 > Tesla V100 32GB > (RTX 3080 = RTX 6000)

• 1.6: RTX A100 40GB > RTX 4090 > RTX A6000
• 1: RTX 3090 Ti 24 GB = V100 32 GB
• 0.8: RTX 3090 24GB = RTX 3080 Ti 12GB > RTX 3080
• 0.75-0.8: A6000 48GB = RTX 6000 24 GB = A4000
• 0.7 A40 = RTX 2080 Ti
• 0.6: RTX 3070 Ti
• 0.5: GTX 1080 Ti, RTX 2070, RTX 2080
• Tesla P100 > P6000
• 0.45-0.48: RTX 3070, RTX 3060 Ti
• 0.35: GTX 1080, RTX 3060, RTX 3050
• 0.25: GTX 1070

A100 > V100 > T4

Machine Learning Deployment

• DataCrunch - A100 80GB GPU Servers
• Towhee - Out-of-box Pipelines - Towhee
• Rent GPU Servers for Deep Learning and AI - Vast.ai
• Replicate–Reproducible machine learning
• Gradient - Use machine learning to make anything.
• AutoGluon: AutoML for Text, Image, and Tabular Data—AutoGluon Documentation 0.4.0 documentation
• Parsec–Help Center Home
• codeplea/genann: simple neural network library in ANSI C
• DerekChia/colab-vscode: ✨ 1-Click Free GPU on VS Code with Google Colab
• Code examples
• Theory of Machine Learning
• Home - Deploifai
• ELBO AI - ML training made easy and cost effective