Ok, I'll go the non power supply way......
You recently replaced the graphics card?
"The last component I was having troubles with was the graphics card so I replaced it with my friend's spare"
If your old card used system ram , perhaps it was warning you of something?
So the lights go on, fans power up, bios starts , and even windows tries?? Yes could be power supply.
But , It could also be a bad piece of ram.
I suspect a system bad ram stick . If your friend with the video card, could burn you a copy of memtest v420 . You could boot to the disk and test your ram.