Nonsense! Yes, don't stress over it but do fix the problem, as your engine will wear prematurely and your gasoline bill will increase. A wrong size belt (too long or too narrow) will cause the problem.
My experience with dealers is that they will tell you whatever it takes to get rid of you and your problem, or to make money from it.