Leaving a belly button infection untreated can lead to more serious complications, including sepsis, a life-threatening blood infection.