Connect the sound directly to the stereo,

not to the tv. Sound bar would be the same way (directly). I can't see anything wrong with that. Give it a try. Good luck.