[Python Interview]1. Variables and Copy Variable Types immutable variable immutable variables include : int string tuple When a function is called, the immutable variable parameters are passed by va

AdaDelta and Adam Algorithm AdaDelta AdaDelta is another variant of AdaGrad. Like RMSProp, it solves the problem of relying too much on previous gradients, by leaky average, but in a more complicated

AdaGrad and RMSProp Algorithm AdaGrad Standard gradient descend is too scaled to be applied to modern deep neural network. AdaGrad is a effective method to optimize by adjusting learning rate dynamic

[Dive into Deep Learning] Covariate Shift, Label Shift and Concept Shift When studying distribution shift, these concepts kept confusing me for a long time. After searching they finally become clearer