Hacker News new | past | comments | ask | show | jobs | submit login

> I Don't think we should be too hard on Baidu, considering they are attempting to improve their algorithm for the interest of humanity

They are not improving the algorithm for the interest of humanity. They submitted and obtained test results much more frequently than allowed. With that information, they can tune parameters to more closely fit the test data.

Basically it is like scoring higher on an exam where some of the questions have been leaked. It does not suggest you now have a better understanding of the subject.




If they are building an algorithm which overfits to training data, their algorithm will lose performance on in the actual validation test.

It is NOT like looking at leaked answers. It's like re-reading the textbook more than everyone else. Definitely an unfair advantage however.


You misunderstand. They're using repeated attempts on the test set to improve their network. That is equivalent to training on the test set and that is unequivocably cheating.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: