pmmg
Myth Weaver
Thing is, worldbuilding is essential to fantasy. It is what makes fantasy into fantasy. Otherwise you can just write a story set into real world.
So I don't think you can say that worldbuilding is "wasted". You can have weak protagonists* and excellent worldbuilding (Tolkien), or well-developed protagonists* and weak worldbuilding (Martin).
*Ironically, George Martin's antagonists are overall much weaker than Tolkien's are. Too many of them are just generically evil, with nothing to really motivate them.
I don't believe I said world building was wasted. And...I will not go with 'its what makes fantasy into fantasy', it just part of the whole. But it can be left out entirely, and a fantasy can still be written. The illiad accomplishes this.
I did say my time was wasted. That was because Tolkien did not have the balance that would make me love his work. Coming in too heavy with world building, is a recipe for being out of balance was more my gist.