I've started a Amazon Journey here and the I would like some advice.

Shared Hosting vs VPS/Dedicated

I've setup a dedicated server before, I know it's way more trouble than a shared hosting, however when you're on a shared hosting, you don't know what the hell other customers are doing with their site. I'm worried that it might affect my site, either by speed because they're running so many things and they're taking all the juice or because they spam the shit out of their website and it affects my ranking because we're on the same IP? Am I worrying to much? Also, I know VPS is on a shared server too, but at least you have dedicated resources.

Any thought? Am I just paranoid?

Thanks