When replacing parts do you drill out the old rivets from the front or back?

When drilling out the old rivets for a replacement part, it is recommended to drill them out from the front. Though, it does not really matter if you drill them out from the front or back as long as the stem is removed. Once the stem is drilled out and removed nothing holds the old rivet in.