E Bills and similar
I use Bank of America's EBill system. The utility sends an electronic bill to BoA which I can set to pay automatically 1 day before the due date OR to not pay until I sign in and authorize it, giving the best of both worlds. BoA keeps track of the utility's address and guarantees receipt. This and similar systems are recommended.