"Love it or leave it" is white racism projected onto others

White flight... black people move into neighborhoods, these white Americans (Full disclosure: white person myself) dreaded having black neighbors, the thought of 'their' community now including black people.

They didn't love their communities, their towns; so they left them.

They expect others to have that same deep seated contempt for their community... hence "love it or leave it".