Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detect Convergence Rate #1

Open
chuckwolber opened this issue Dec 20, 2018 · 0 comments
Open

Detect Convergence Rate #1

chuckwolber opened this issue Dec 20, 2018 · 0 comments

Comments

@chuckwolber
Copy link
Owner

chuckwolber commented Dec 20, 2018

Detect convergence rate so that the controlling program can decide if we are stagnating. I am uncertain if we can be temporarily stuck in a local minima that we would eventually get out of, so this feature may also double as a tool for exploring that idea.

I.e. if the learning rate is less than the "width" of a local minima, would that eliminate any hope of getting out of it? We could possibly test this by forcing ourselves into a known local minima and then adjusting the learning rate to see if we bounce out of it.

@chuckwolber chuckwolber changed the title Detect Error Rate Detect Convergence Rate Jun 20, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant