With the PayPal plan I have people don't have to leave my site. The payment mechanism would keep them there. I don't think there's really an issue with PayPal though. I think it's become common enough that most people understand what it is. It's never seemed like a credibility thing to me.
Another option you could try is
Google Checkout.