I had this, too.
I cut out ALL fruit and sugar and basicaly lived a miserable existence.
So all I ate was:
Rice cakes (organic)
Day after day.
No dairy, nothing.
THen I learned that rice is not good for yeast either. So I just gave up. I can't stop eating rice!
So now I just eat gluten free.
I eat black berries now and eggs, because I was too hungry totally off fruit and sardines every meal can make you batty. Those are the only things I have added and I feel better.
For the yeast, now I take cranberry (make sure it is is gluten free and organic) and also pro-biotics. They take care of it and I can still eat my berries and eggs. But no to other forms of dairy for me. I don't miss it. Drank goat milk a month ago and could hardly move. No energy. AWFUL. No milk for me.
Life for me with celiac is terrible hard. I was dxed late. So I can't reduce it any more. It is already rather grim diet!