Can’t believe it. Who told you that? A stupid adviser or people that do not know much about a medical career for sure.
By this forum’s standard you are very young. Keep working hard and I am sure you will be a neurosurgeon one day. If this is what you want to do, go for it and don’t let anyone stand in your way.