Majorly Shifting After Braces

I am 13 years old. I had my spacers put in, in 2nd grade. I'm in 8th grade now. I just got my braces off in late December. Things were going perfectly through January. My teeth weren't moving at all. The retainers were holding them well in place. I lost them about 2 weeks ago. I found them damaged. My lower retainer had chips and was letting my teeth slide out of place. My teeth had shifted between appointments and not wearing them, fearing I would make them shift more. My upper retainer is fine and my upper teeth are still perfect. But my lower teeth are what I'm really worried about. My front two teeth have always been perfect, with braces, even without. Now, the tooth on the left is noticeably sliding forward, making my smile look weird. The tooth to the left of that one is turning forward, and then the tooth left of that one is twisting inward to my tongue. These three teeth have dramatically shifted. I went to see my orthodontist yesterday and he said everything was fine. I had to replace my lower retainer and these are the first two days I've been wearing it since I got it. He said they should've been back to normal by last night. My teeth move fast and shift back fast. But they aren't going back. I think they made my new retainer incorrect and it's fitted to my mold after complaining my teeth were shifting. I'm really worried that he won't put braces back on if they won't go back. We already finished the payments for my braces. My retainer on the top is loose and I can remove it easily. My lower is still a little tight, but I'm not seeing any changes from yesterday. Should I be worried? Thank you.