Learning rate changes abnormally

[MoonWolf9067]

Hi! Thank you for sharing your work. When I look at the training effect in the tensorboard, the learning rate shows the following trend. The learning rate change is different from the exponential decay trend set in the code. Can you give me some suggestions?

[xuanyuzhou98]

@MoonWolf9067 I tried in a new environment and the learning rate follows exponential decay correctly. Could you repull the code and provide more information about your changes?

[MoonWolf9067]

Thank you for your reply, I have understood this question. The learning rate indeed follows exponential decay correctly.