Architecture decision
Plan RAM for the active working set, not just the input file. Add a GPU only when the analysis library supports acceleration.
GLOBALATLAS AI · Data science infrastructure
Data science infrastructure
Interactive analysis depends on dataset size, working memory and reproducible environments.
An analysis workspace that can be reproduced
- 01
Original data in persistent storage
- 02
Notebook environment with pinned dependencies
- 03
Memory budget for transforms and intermediate tables
Configuration requirements
Choose RAM for the active dataset, object storage for originals and a separate environment per project. Add GPU only if the analysis library uses it.