Designing for Observability: From Noise To Insight