AI systems now shape real-world outcomes with unprecedented scale and impact, posing new demands on design philosophy. Most efforts focus on optimizing for reward functions or human preferences—often assuming correct behavior can be pre-specified. In practice, alignment requires constant calibration to observable reality, not just intended objectives.