Learning rate decay and Weight decay..difference?
Sun Jul 31 2022 23:26:05 GMT+0000 (Coordinated Universal Time)
Saved by @mnis00014
https://discuss.pytorch.org/t/learning-rate-decay-and-weight-decay-difference/74932Sun Jul 31 2022 23:26:05 GMT+0000 (Coordinated Universal Time)
Saved by @mnis00014
https://discuss.pytorch.org/t/learning-rate-decay-and-weight-decay-difference/74932
Comments
@mnis00014 - Sun Jul 31 2022 23:26:34 GMT+0000 (Coordinated Universal Time)L1 = Dropout L2 = Weight Decay