You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Detect convergence rate so that the controlling program can decide if we are stagnating. I am uncertain if we can be temporarily stuck in a local minima that we would eventually get out of, so this feature may also double as a tool for exploring that idea.
I.e. if the learning rate is less than the "width" of a local minima, would that eliminate any hope of getting out of it? We could possibly test this by forcing ourselves into a known local minima and then adjusting the learning rate to see if we bounce out of it.
The text was updated successfully, but these errors were encountered:
Detect convergence rate so that the controlling program can decide if we are stagnating. I am uncertain if we can be temporarily stuck in a local minima that we would eventually get out of, so this feature may also double as a tool for exploring that idea.
I.e. if the learning rate is less than the "width" of a local minima, would that eliminate any hope of getting out of it? We could possibly test this by forcing ourselves into a known local minima and then adjusting the learning rate to see if we bounce out of it.
The text was updated successfully, but these errors were encountered: