Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Invalid configuration data breaks enforce-nfs-quota container

FieldValue
Impact TimeOct 16 at 21:26 to Oct 16 at 21:51
Duration24m 23s

Overview

An engineer deployed invalid Python config to earthscope prod

What Happened

The enforce-xfs-container failed to properly load and encountered pod restarts

Resolution

Revert invalid config, and then push correct config

Where We Got Lucky

The engineer was watching the deployment for errors

Incident reports
Starting Server of users with 2i2c admin emails from admin panel fails on earthscope
Incident reports
OOM kill of enforce-xfs-quota on neurohackademy