I am LFF and the handle Vee rubs against my ski too.
Unlike most almost all LFF skiers, I position the rope on the left side of my ski. You might try moving the rope to the left side of your ski since it seems that is where it wants to go anyway. Rotate the ski to 2:00.
If that doesn't help, go back to the standard rope position.