I would strongly recommend you get tested for Lyme Disease with the Western Blot test. The two best labs are Stonybrook and Igenix. Try not to use the 2 most common labs, their tests are not as sensitive.
ALL of your symptoms are indicative of Lyme. I had many of them myself. I was dx'd with Celiac in 2010 and after 3 years on a gluten free diet I continued to suffer with a lot of muscle pain, stiffness in my back, constantly going to physical therapy. I also started getting terrible racing heart, bladder problems and all sorts of weird things.
If you have been tested already and it came back negative, I would retest. sometimes a month's worth of antibiotic therapy will cause the Western Blot test to start showing Lyme bands as you kill off some of the spyrochetes the immune system starts to recognize the lyme and starts making some antibodies that the test will pick up eventually. Many people who are sick like you have an ELISA test or a Western Blot test and it comes back negative and they stop pursuing Lyme. It can be a mistake.
I have been on antibiotics for over a year and with good probiotics I have been able to do this and improve. Also test for the MTHFR genes to see if you have any mutations in your methylation/detox pathways. Believe me, it took years to piece all of these things together in my own journey to get better.