In physical world we differentiate between public and private spaces, with different expectations of privacy in each of them. There's a debate to be had about appropriate demarkations on the Internet.
Where I walk and what I do on the street is private even though it's in a public space (exceptions apply). Similarly what I do and where I go on the internet is private even though it is a public space (exceptions apply).
If someone follows me in the street for hours (days, weeks, life) and note everything that I do, I'd be right to call that a violation of my privacy ?
Is that why everyone agrees that the constitution protects this right in the physical domain?