"Saturday Night Live" is shaking up its cast ... and, TMZ has learned the name of a potential replacement -- comedian Kam Patterson! Sources with direct knowledge tell TMZ ... 'SNL' is looking at Kam ...