Simply shorting 5V regulator input with output without disconnecting the third terminal from ground => wasting battery power

I have observed that if you do not need the the 78L05 5V regulator, shorting between its input and output without disconnecting its third terminal from ground would waste your battery power even more than if you use the regulator in the usual way.