From a genetic standpoint I don't know whether the recessive genes are the issue, it is more whether these genes can be linked to other genes which may result in negative outcomes. The only way the recessive trait itself would be the issue is if there was a direct negative from the trait - such as paler skin = higher susceptibility to skin cancer or whatever. Unless the trait itself is detrimental, there is only a need to worry about detrimental effects from genes linked to this trait. Hope that makes sense