don't even think about it - ones a high level signal the other a low level signal
almost definately you'll blow something in the input stage of the 2 channel amp
I think input voltage on RCA is something like <3V - wheras speaker outputs are typically 20V or so (even up to 40V) - and a good few amps too
just don't do it - it won't work anyway