Hacker News new | past | comments | ask | show | jobs | submit login

No, you don't have that. You have tens of thousands of uncontrolled estimates, without any comparison points, or systematic or objective data collection.



Sort of implied by me being the only test subject, no? Let me try again without the confusing humor element: HTML email gives a bad impression to me and people who share my prejudices and attitudes.


> Sort of implied by me being the only test subject, no?

Not at all. For example, you could be sent the same email with a difference separated by a period of months, where the 2 versions of the email are directly compared (sort of a within-subjects design). Or the difference could be randomly applied to all incoming emails, and then the overall populations compared (between-subjects).

Just because _n_=1 doesn't mean you can't do experiments on yourself - I do self-experiments all the time: http://www.gwern.net/tags/experiments

> HTML email gives a bad impression to me and people who share my prejudices and attitudes.

You don't track your clicks. For all you know, you still click more and get more out of the HTML emails, despite your negative attitude.


"I do self-experiments all the time"

I just saw your work on LSD microdosing. I really admire your dedication to finding something out through careful experimental design. This is an example of an experiment where self-blinding was possible, but I don't see how it would be possible in testing my own reactions to something that, by definition, I would need to be aware of. So, yes, A/B testing would not be possible here on myself. That's what I had in mind.

"For all you know, you still click more and get more out of the HTML emails"

I never click on them, so there is no question here. Really, I don't need a formal testing regime to know that HTML email sends me a bad signal any more than I do to know how I feel about people wearing obscenity-bearing tshirts.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: