First, I think it's a wonderful thing that you have signed up to give speeches. Good for you! I don't know if that's not tackling your personal problem head on, what is

Please don't give up and be very patient with yourself. Have realistic goals and realistic expectations. I think you should be happy that you went from having panic attacks to being nervous - that is a huge improvement! If you give yourself a bit more patience and keep trying as hard as you can, I think you will find yourself being a bit less nervous every time you have to give a new speech. Then at some point, you will reach a point where no one will notice that you are nervous... I don't think nervousness ever goes away, but you can minimize the effects of its tell signs with more practice

Please stay focused on your goals. Do not forget that you are there because you are challenging yourself with something that you are having trouble with. Focus on yourself, and do not berate yourself by comparing yourself with others.. they are doing their thing, and you are doing yours. You should always make a mental note of your own progress and be proud and happy for what you have done.