Throw in the towel

From the world of boxing, where a fighter's corner would literally throw a towel or sponge into the ring to signal surrender and stop the fight. This practice became standard in the late 19th century and replaced the earlier phrase "throw up the sponge." It now broadly means to give up or concede defeat.