WARNING: THIS SITE IS A MIRROR OF GITHUB.COM / IT CANNOT LOGIN OR REGISTER ACCOUNTS / THE CONTENTS ARE PROVIDED AS-IS / THIS SITE ASSUMES NO RESPONSIBILITY FOR ANY DISPLAYED CONTENT OR LINKS / IF YOU FOUND SOMETHING MAY NOT GOOD FOR EVERYONE, CONTACT ADMIN AT ilovescratch@foxmail.com
Skip to content

BatchGradientVerificationCallback mix #1077

New issue
New issue
Open
Open
BatchGradientVerificationCallback mix#1077
Labels
questionFurther information is requested
@dimidagd

Description

@dimidagd
dimidagd
opened on Nov 16, 2023

Concerning BatchGradientVerificationCallback, in case one is using BatchNorm, then the gradients are mixed between samples in the batch, hence it make no sense to use it, nowdays almost everybody is using BatchNorm, what would be a realistic application of the same feature in such models?

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions