whatever you build should have/maintain logical consistency. Even fantasy worlds have 'rules' to maintain logical consistency they don't have to match our rules but they should remain consistent in that world.
Are you writing one story or multiples? one story might only need enough worldbuilding for the areas that affect the story, multiple stories in the same universe/world will need more worldbuilding.