Evidence of people fleeing their homes to avoid taxes was piling up long before California billionaires began their relocations to Nevada and Florida.