The yoke holds everything in place. The pinion may hold itself there only if you're lucky and the outer bearing has a very tight tolerance. Usually any little touch and it'll fall out.
You should have waited till Tuesday for a post such as this BTW... that's the best time for quick replies...