South African actor told he wasn't "black enough"