Your method of adding the vertical manually created support is the right direction, I believe. In order to get it to work, you'll want to ensure that the thickness matches your nozzle diameter. The other aspect is to ensure that you have "thin walls" enabled in your slicer. I'm not sure where such a setting is located but a search with "enable thin walls [slicer name]" should give you the answers.