Just like audio files you'll get better results by separating the ripping and encoding process.
Consider ripping your DVD or DVDs to a hard disk first, I use RipIt as I find VLC to be flakey for rips. Then, open each DVD rip in Handbrake, choose your encoding method e.g. Apple TV2 and add it to...