Billionaire David Geffen is going to have to find some other pretty young thing to take to state dinners and on all-boy vacations with Barry Diller and other barely closeted rich people. According to Page Six Geffen just broke up with his boy toy.