I'm going through exactly the same scenario, exactly. I've suffered from rashes, boils, on my face and scalp for the last 3 years. I've been gluten free for two week and they have cleared up 90% without antibiotics exactly like you.
This is my theory, we have had an incredibly low immune system because of celiac but we have carried on having gluten. We have took antibiotics ( which ruin the villi in the stomach with over use ) to deal with the skin problems and they have relieved them short term only for them to come back, because our immune systems are low we have been susceptible to staph and bacterial infections but never dealing with the cause of why we are susceptible.
Well now I have my answer, I'm getting some nasal antibiotics and making sure I haven't got it up my snout, I'm sticking to a incredibly strict gluten free diet ( I don't even want to be in the same room if someone farts and they eat gluten ).. lol And I truthfully believe I will be all right.
I hope it works for you to.