Skip to content

(Change Default Outputs) feature: change default learning rate to 3e-6 * sqrt(batch_size) - #321

Open
YuriCat wants to merge 1 commit into
DeNA:developfrom
YuriCat:feature/change_default_lr
Open

YuriCat wants to merge 1 commit into
DeNA:developfrom
YuriCat:feature/change_default_lr

Conversation

@YuriCat

@YuriCat YuriCat commented Jul 6, 2022

Copy link
Copy Markdown
Contributor

The learning rate proportional to batch size looks strange.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant