My @Quora answer to Are there optimization techniques that do not use gradient and are hence not affected by initia…https://www.quora.com/Are-there-optimization-techniques-that-do-not-use-gradient-and-are-hence-not-affected-by-initialization/answer/Anima-Anandkumar-1?share=60e796e5 …
-
@AnimaAnandkumar Overly poetic (i.e. suggestive, yet vague) to think of this as putting the optimization surface thru a "low-pass filter"?
@BatteryHorse It is exactly that! you compute Gaussian convolutions at different scales, so u are passing through Gaussian filters..