Use a different slicer. I gave up with slic3r after at least a month of trying, it is brain damaged and does really stupid things for no reason.

Try Cura. You can always go back to slic3r once you prove that is the problem and try to fix it then.