Please Help

I was wanting to know if anyone can give me advice on how to get my medicine back. This is what happened. My family Dr was writing out my blood pressure pills, my pain meds, and my nerve meds. He told me that when I saw one of my specilist which are an orthopedist, a neurologist, and an ENT , that if they changed my pain meds to let him know and he would write them out for me so they wouldn't have too. My family Dr is also a pain specilist and I did have to sign an agreement with him. I showed him what my orthopedist wrote out and he dropped me off of everything. He told me to let the specilist write them out. I have found a pain management Dr but I don't know whether to ask my family dr or my orthopedist to refer me to him. Please help. What do I do now.