It's hard enough, why make it harder? (Rob Shirley, MasterCraft Boats, 1980).
I think that starting out heavy with a little winter weight is a good thing. It will give you a better work out and make you stronger in the long haul (sorer in the early season). As the winter sweater departs, you will be stronger for having pulled those extra pounds around the bouys. Then it will get easier. 2 bottles of Advil LiquiGels later, voila, summer skiing condition.