I agree, bad cat or O2 sensor. I would change the O2 sensors first, they are alot cheaper than a cat replacement. And if they have never been replaced, it's probably time anyway.
A performance exhaust (a "cat back") is just that. Cats/downpipe are a separate assembly, unless you whack and hack aftermarkets in the existing downpipe.