Agents and publishers will probably tell you to revise your draft if you do that because they do not associate shifting POVs with a mature form of writing. It's best to keep experimental writing like that confined to blogs and fanfiction because the trad-publishing industry is still quite rigid...