24–32 GB class
L4, A10, RTX 4090 or RTX 5090. Consider for smaller models only after measuring total memory, including runtime and cache.
Data science infrastructure
Data science infrastructure
Data science infrastructure: practical compute, data and recovery choices for a measured deployment plan.
Choose a configuration in Console to review its resources and estimated cost.
What to plan for
Interactive analysis depends on dataset size, working memory and reproducible environments.
Choose RAM for the active dataset, object storage for originals and a separate environment per project. Add GPU only if the analysis library uses it.
Configuration choices
48–80 GB class
L40S, A40, A100 or H100. More memory may accommodate larger working sets; it does not guarantee concurrency or token speed.
141 GB and multi-GPU
H200, B200 or B300 and explicitly sized multi-GPU systems. Confirm exact model, precision, topology and serving framework.
Weight-only memory ≈ parameters × bytes per parameter. Runtime, KV cache, activations and optimizer state are additional. This is a sizing method, not a deployment recommendation.
Smart Infra Finder
Your workload, your requirementsCheck availability: Data science infrastructure
Check the current price and configuration in Console. Your choice is saved through registration. The current lookup uses mock adapters; no real capacity is reserved.
Related products and guides
GPU cloud
Compare GPU memory and architectures, from RTX to data-center accelerators, then check configurations in one console.
Explore →Cloud servers
Cloud servers: configuration choices, sizing requirements and availability checks in GlobalAtlas AI.
Explore →Cloud storage
Compare object, block and file storage, backups and snapshots by access pattern, durability needs and restore workflow.
Explore →Cloud backup
Cloud backup: access model, capacity planning and recovery considerations before choosing a configuration.
Explore →