He’s racist, “African-American” means black, i.e. an ethnicity not a nationality, he doesn’t mind Africans because they’re not near him. A similar thing for a xenophobe would be I have no problem with Mexicans, it’s the Mexican immigrants I hate. Or from an aracnophobe: I understand spiders have their place in nature, I just don’t want them in my house.