DataOps & Platform
Engineering practices that keep a data platform reliable and affordable.
Data Engineer track
Junior
Build and fix pipelines from clear specs; write correct SQL.
- Query CostWhy scanning a whole table can cost real money in a cloud warehouse.
Mid-level
Own pipelines and models end to end, including their quality.
- CI/CD for Data PipelinesTesting and deploying pipeline and model changes automatically.
- DataOpsApplying DevOps practices like CI, testing and monitoring to data.
- Development and Production Data EnvironmentsSeparate schemas or warehouses so development never touches production data.
- Warehouse Cost ManagementControlling spend through query patterns, scheduling and sizing.
Senior
Design the platform's storage, processing and modeling choices.
- Data VersioningTracking versions of datasets the way Git tracks code.
Staff
Shape how the whole organization produces and uses data.
- Build vs Buy for Data ToolsChoosing between managed services, open source and building in-house.
- Data Platform TeamA team that builds infrastructure other data teams depend on.
- Self-Serve Data PlatformShared tooling that lets many teams build their own pipelines safely.
Principal
Set data strategy and architecture across the company.
Nothing here yet.