Hacker News new | past | comments | ask | show | jobs | submit login

DataMinr is an event detection service not a 'real time sentiment'

infotrie does sentiment analysis on news stories they also mix this news sentiment with social media sentiment. This is a muddled approach and not pure real time sentiment.

Let's back up a moment. You wouldn't expect Gallup to have accurate surveys of the presidential election by processing news articles and blogs. They poll individuals in brief snapshots of time. Polling for sentiment is the same thing. News articles and blog posts are amplified opinions of a small set of people, they are a poor substitute for direct measurement of many many people.

The Bollen paper is widely discredited in our space. Derwent licensed the technology and subsequently ran into trouble because the tech and data was not sound.. though Bollen's initial theory was correct.

Not peer reviewed but you can see a few papers Deltix published documenting alpha:

http://www.deltixlab.com/research/an-automated-trading-strat...

http://www.deltixlab.com/research/an-automated-trading-strat...




Interesting points...

News articles and blog posts are amplified opinions of a small set of people, they are a poor substitute for direct measurement of many many people.

You might be correct (sounds very reasonable) but I guess the question is why do I necessarily care about directly measuring many many people? What if loud, amplified opinions are actually better indicator of market momentum?. Tetlock's article suggests that those amplified opinions actually do contain useful information. Again, I have yet to find any conclusive evidence that measuring people's chatter actually ... matters.

Derwent licensed the technology and subsequently ran into trouble because the tech and data was not sound.. though Bollen's initial theory was correct.

Right - I think there are more than a couple complaints about his paper. Why do you say his initial theory was correct though? If I recall correctly, his initial theory was that social chatter contained market information that could be extracted using neural networks and used to predict short term market returns (like a few days forward). I haven't really seen anything along the same lines (especially using his approach of neural networks) anywhere - although the articles you link to might be considered similar.

I am just reading through the articles you posted from Deltix now, sound interesting. One problem is that because of the relatively novelty of services like PsychSignal, the data does not go back as far as traditional indicators (this was a problem with Bollen's paper as well). When you say you have impressive alpha, sharpe, or whatever for 6 months.. that does not really prove much, especially in the eyes of academics. I'd love to replicate or work with this data presented in Deltix - but given the data is proprietary, that's difficult to do.

side note: This was just mentioned in the Wall Street Journal yesterday, http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1807265 claims to find signal in blog posts. That's not to say measuring many people's chatter wouldn't work as well or better though. Also just heard of paper today, so no guarantees about quality but maybe someone finds it interesting.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: