I owned a machine like that.
It was the motherboard. I changed the PSU because that was cheap but later we changed the motherboard.
Try the cheap parts first such as the PSU and the BIOS battery before you change the motherboard. Also, why not put it on some AC switch power bar to make it easier? Most folk loathe the repair bill for this one.