Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> approximate any continuous function

It wouldn't surprise me if many interesting functions we'd like to approximate aren't continuous at all.



This is one of the reasons current AI tech is so poor at learning physical world dynamics.

Relationships in the physical world are sparse, metastable graphs with non-linear dynamics at every resolution. And then we measure these dynamics using sparse, irregular sampling with a high noise floor. It is just about the worst possible data model for conventional AI stacks at a theoretical level.


This is what softmax [1] is for.

[1] https://en.wikipedia.org/wiki/Softmax_function




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: