I agree at some extent. I think it would be nice to at least remove most of the stuff inside a house (dustbin, carpets, wall lamp, beds), but keep the rest. Maybe it would also be nice to change where the doors or ladders are placed, but keeping the rest of the structure.
If everything else is also changed, I think the overall architecture of cities could look aesthetically wrong. This however could be solved by restricting the type of walls or roofs that could be selected in each city. Still, there could be an issue as some players could end up creating things that would not make much structural sense and deteriorate the house value of their neighbors.
It could be about reaching a compromise of what could be changed to keep the visuals balanced.