There are "many out there waiting for a negative moment" to target England's black players, says Troy Townsend.