Deciphering the origin of simplicity in high-dimensional systems