Here is what I came up with for this slotted version of the idler pulley to move thru for more belt tension. I will not be able to try this until Monday, but looks pretty good design wise to me.
X-IdlerPlate_rev10.jpg