The only problem there is that the count also determines how federal money is distributed. Undocumented/illegal immigrants still use interstates and water mains and disaster money and national parks and federal buildings. Unless we want funding cut, we still have to count them.
*Edit: I’m embarrassed that I got all that written before 3/5 hit me. “The only problem” 😬