Perhaps a different culture would always present data on a sphere and would use geodesic distance as the default. I don't know! There should no reason whatsoever to expect an arbitrary encoding and an arbitrary distance to result in an interpolative problem space.
-
-
Show this thread
-
The correct encoding and distance to use is of course the ones that are natural to the data -- that is to say, the latent manifold of the data. Which *is* an interpolative space for many problems (hence why deep learning models are able to generalize).
Show this thread -
Saying "I expect the problem to be linearly interpolative in the original encoding space" is equivalent to saying "linear regression with *no* feature engineering is enough to solve any prediction problem." Which we have known to be nonsensical since long before computers existed
Show this thread
End of conversation
New conversation -
-
-
We have started looking at other geometries. Hyperbolic neural networks has been developing as an area over the last few years!
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
Even divergence functions
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
And an infinity of latent manifolds
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
anyone out there have recommendations of good geometries and distance functions for encoding directed acyclic graphs?
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.