Hacker News new | past | comments | ask | show | jobs | submit login
Will Apple Mail threaten the newsletter boom? (platformer.news)
198 points by danso on June 10, 2021 | hide | past | favorite | 266 comments



Difficult to feel pity for business models built on abusing HTML capabilities to track email viewing.

I don’t load remote images by default, so this already doesn’t work for me. However, basically every mail platform creates tailored links to track click engagement. So you’re screwed anyway, just maybe a little later.


> However, basically every mail platform creates tailored links to track click engagement.

Yep, even financial institutions do this and half of them don’t even use domains they own for the tracking links.

Years and years of “don’t click on suspicious links” out the window because bank.example.com/creditcard is turned into 4828fjfneo848.totallyfine.adtracker.thirdparty.example.org

I hate all of it but nobody seems to give a shit (nor do they care to implement proper 2FA to effectively guard against phishing) so whatever. If people have their accounts drained because marketers gotta get that sweet engagement metric, what does it matter any more?


My work touts the "look at links before you click!". But they also auto forward all email links to a service that scans the link for malicious stuff. The result is that when I hover over a link, I get a REALLY long url, like: https://urldefense.company.com?link=blablablablablahlablabla......

And I can't actually read it.


My work actually visits the url ahead of time.

This sucks when the link is a one-time-use only code.


This is pretty common and something that bit us last year - enterprise Outlook 365 (or some extension? idk it was def only O365 though) added some security features that would make a HEAD request to any links contained in an email. This messed up our (admittedly antiquated) process for activating users and resetting passwords as it consumed the one-time code our systems generated for them, as you mentioned. Because the app that handled this was old and in the process of replacement we didn't want to invest too much time in rewriting it all, so a quick and easy fix was to have a handler specifically for HEAD requests to those activation and reset resources. The link protection started issuing GET requests a little while after, so we ended up having to add an extra confirmation step so the user had to click something after the link was followed.

To be honest the original process we had maybe wasn't 100% perfect - users can double click links for example, and would see a message that the link had "expired". So from a UX perspective we maybe should've had the extra confirmation step before activation/reset to begin with. But I'm in two minds over email providers following all the links in your emails, it feels a bit creepy


Wow, this behavior seems perfect for sneakily verifying that an email was received. And the user can't do anything against it. It's not a perfect replacement for tracking pixels, though, if you want to figure out whether an email was opened. Creepy.


I don’t think it would be that useful to be honest. I don’t think it happens when the email is opened by the end user, but some point during the delivery process. And even then you’d only find out from some email providers - not everyone does it


> Wow, this behavior seems perfect for sneakily verifying that an email was received.

Isn't that pretty much the definition of "confirming your email address" transactional emails? Wouldn't really call this "sneaky".


I read it as anyone – including spammers – who puts link in will get a head request to it from the email provider, thus providing information – even if just that the address is real.

However, the absence of a bounce probably also does that, albeit less reliably.


Some email providers don't bounce/reject specifically to not leak that information as far as I know.


Sounds like a great target for Server Side Request Forgery, https://owasp.org/www-community/attacks/Server_Side_Request_.... Could be fun to try if that software also visits links for internal-only applications, should such exist in your corp.


Does anyone actually send links like that? Any competent programmer will make the link expire on an interaction, not on load - there are some many things that could cause a link to receive a GET request, but where the use wouldn't actually be able to interact with the page.


Using GET for non-idempotent generally considered bad, but it seems that email is a place that non-idempotent GET is still used. I often see it on unsubscribe link.


> I often see it on unsubscribe link.

Those are meant to load a page with a confirmation form that makes a POST request. The GET link can still expire over time, but must never be expired from a GET request: you never know when a link preview bot is going to follow links.


Yeah, fair enough, I do run into those occasionally too, but most of them these days make sure to require at least a confirmation click.


A pet peeve is unsubscribe links are frequently on an obscure domain that has found it's way onto Adblock lists.

That's got be by design.


If I can't unsubscribe with a single click then it's spam and I report it as spam. They don't give a shit about me, so I don't give a shit about them.


It's easy: I set a rule in Mail that flags every email containing "Unsubscribe" or related terms with a red flag, and I review and mark them as junk when they show up. Every newsletter is spam because I would never ever sign up for one, regardless of whether I do business with the sender. Either they are illegally mailing me spam from some list that they purchased, or they hid their "please don't send me bullshit" opt out when I signed up for their services, because I would never ask to receive marketing or product updates. It's all spam.


If something makes itself difficult to unsubscribe you could always feed it to the spam filter


I mark any newsletter as spam if I didn’t intentionally sign up which is 100% of the time


When I unsubscribe from a mailing list I know I didn't sign up for, I'll also hit the report spam button in the hopes it gives them some negative gmail juju.


This does get reported to the sending platform. Stuff like Mailgun and Mailchimp will show you a rate for it, and they do suspend if it gets too high.


Depending on where you do it, yeah, it works. In the gmail interface for gmail, but also in the unsubscribe reason box for the sending platform. Both work.


Do both, but definitely do the spam report via Gmail or your email provider because that dings the platform they use as well. Without a threat to their mailability, they'd have no incentive to keep their customers (the person spamming you) honest.


I do this if my attempt to unsubscribe fails at all.


And more and more often, unsubscribe links go 403 or even 500 when on Tor or well-known VPNs, while the rest of the site works fine on it. A great way to make me never want to deal with you again is to coerce me to doxx myself to unsubscribe from your newsletter.


I find reporting as spam or setting a filter rule is easier than unsubscribing.


It's not uncommon for the unsubscribe links to live on the same domain as the link tracking and other features of whatever email or marketing automation platform they are on, so if those are blocked to prevent tracking, the unsubscribe links would be as well.


> I hate all of it but nobody seems to give a shit

I hope this will change. More companies need to make some noise about it.


> Years and years of “don’t click on suspicious links” out the window because bank.example.com/creditcard is turned into 4828fjfneo848.totallyfine.adtracker.thirdparty.example.org

I got an email from my bank (Barclays) a couple of months ago that literally took me several minutes to determine whether or not it was a phishing email.

It wasn't, but it used badly compressed jpegs for the Barclays logo and the call-to-action button, the link attached to the button had no verifiable connection to Barclays, and for some reason it used backticks instead of apostrophes in the copy.

When I finally did click the link I was half expecting to be taken to a page saying "you moron, this is obviously a scam" in 96pt font.


I spend about 10 seconds at most thinking about if my bank sent me a spammy looking email and then separately go to the bank site and look for whatever they were supposedly talking about.

Rule of thumb: never click on the link.


I just don’t click on those links, except on accident because some jackass made it impossible to copy/pasta the URL on my mobile device because I couldn’t see what the URL was in a preview window.


Could Apple preload those links too the way they want to preload the tracking pixels? (I don't know much about web tech)


MFA won’t protect against phishing.


The MFA we commonly use right now won't protect against phishing because, as I suspect you mean, the codes are not protected against being entered into the "wrong" site.

Proper MFA, like U2F/FIDO2/whatever-it-is-called-today, will protect against phishing because the visited site won't match the hash needed to complete the second-factor-auth-flow.


Yes it does, maybe not directly. Two examples, both 1Password and my Yubikey only autofill passwords based on the domain. I immediately get a tingle when I go to autocomplete a commonly visited website and it doesn't fill ... time to immediately inspect the URL for phishing etc. Those tools have definitely saved me multiple times.


Delivery rates, AKA staying out of spam and getting into the inbox are correlated to subscriber engagement on your emails.

The more often subscribers open + click a link, the more likely the mail server will let it in the inbox.

If you blast 10,000 emails, and noone clicks or engages with your email - you'll kill your domain's delivery rate.

One of the methods email marketers use to keep their email delivery rates high is by removing subscribers that don't engage with their email.

Preventing email tracking prevents marketers from removing uninterested or unengaged subscribers from their lists.


> One of the methods email marketers use to keep their email delivery rates high is by removing subscribers that don't engage with their email.

Email marketers can still track when a user clicks a link, which is the proper signal for them to be using anyways.


You get what you measure, so relying solely on clicks to measure interest is going to drive email products toward more clickbait designs and content—reversing a nice trend over the last few years to put most/all of the content into the email itself.


Clicking links doesn't sound like the sort of thing that email servers would know about one way or the other. Likewise for engaging (or not) with emails at all. What setup do you have in mind where this is the case?

Given that AFAIK Apple Mail downloads entire messages regardless of whether they're opened, Apple's change here doesn't seem likely to affect delivery rates in this way anyway.


> Likewise for engaging (or not) with emails at all. What setup do you have in mind where this is the case?

If you use IMAP (or basically anything else than POP) then your email client reports the read status back to the server.


Your IMAP server doesn't report read status back to the sender. Unless your e-mail provider is an advertiser *cough* Google *cough* the advertiser doesn't know if you read a message just because the IMAP server marked it as read.

Also an IMAP server's read status doesn't mean someone manually interacted with an e-mail. If you mark messages as read in bulk, even if the provider reported that status to an advertiser, says nothing about engagement.


You can request a read receipt with emails, which will cause the MUA to send an email saying you've read the message (although I suspect most clients default to asking you if you want to send it before doing so).


In the MUAs which have read receipt functionality, all of them let the end user turn it off.

Even MS Outlook.


Which is how it should be - the fact the user can choose to decline is a feature.


Not sure how I forgot un/read status syncs via IMAP. Thanks.


I think that it would be better using NNTP and plain text, and then these problems are avoided anyways. Then the sender need not keep track of these things or to worry about the things that you mentioned, I think. Also can be good to include the text in the message if you can do and not usually needing a link, you can then access it even if you are not connected to the internet, too.

(I use email software that is not even capable of HTML email, and I don't want HTML email.)


Outlook killed NNTP 20 years ago by virtue of not supporting it (every other mail client at the time did).

it also suffered as a discussion medium because of the decentralized unauthenticated measure, for sure - I don’t think the global hierarchy would have done much better than it did.

But two companies I was consulting for around 2000 had very effective NNTP internal servers, and both switched them off around the same time because Outlook didn’t support them (Outlook Express did, but that’s not helpful)

One just went the “reply all” route. One used a mailing list (majordomo, iirc). Neither worked remotely as well as NNTP did.


NNTP does support authentication (with username/password or with SASL), although I don't know which client programs implement it (my own currently doesn't, although this could be fixed in future).

You could use a mailing list and/or web forum with the same messages as the NNTP. I have my own NNTP server software with partial implementation of a web forum but none of a mailing list yet; I would hope to fix this. Other software might already do this, I don't know. (I know there are programs that can duplicate the messages and make them available, but I don't know if there are those that will use the same message database for all three and/or that will use NNTP as the "main format".)

Synchronet might be able to do it; I know it has many functions, including Telnet, NNTP, email, IRC, FidoNet, HTTP(S), SSH, Gopher, PETSCII, etc. There is a web forum too. (As far as I know, it doesn't have Gemini yet.) However, Synchronet is a complicated software, and is designed for a BBS and might not be what you wanted, so having other software can be good if a BBS is not the kind of service you intended to run, I think.


The authentication/federation problem is what killed the public nntp use even among the non-Outlook users; But it was Outlook that had killed it among corporate and professional users. Those are two independent issues.

Gmane[0][1] did bidirectional nntp to mailing-list in 2002; But there's a mismatch, both technical and cultural, with these gateways.

Also, in an internal system, the IT department has to be willing to support them, and they weren't in my cases.

It's now water under the bridge. NNTP is essentially dead except for legally questionable video distribution.

[0] https://news.gmane.io/ [1] https://lars.ingebrigtsen.no/2020/01/06/whatever-happened-to...


Can you elaborate a bit how your mailbox provider knows about click/engangement rate?

E.g. why would Fastmail have any metrics on how their users interact with the mail they receive?

I see everybody calling out that one should keep a clean subscriber list (e.g. only keep engaged users) but I fail to see this is relevant to the actual mail acceptance/inbox delivery.


This could be done without duping the receiver’s email client into revealing that the email has been viewed.


Yeah, this is really annoying because I keep getting silently dropped off of mailing lists because "I don't engage".


Is this annoying? Do you still want it if there's nothing in it you want to engage with?

Or are you saying you want to read it, but take no related actions on it?

I would absolutely love to be automatically unsubscribed from everything I don't engage with.

I get tons of kinda-sorta-legit marketing emails due to a very old generic gmail address, and people being bad (or lazy) at entering addresses everywhere.

(Also tons of actual email meant for other people, but that's another story)


Often I read it but take not actions. Or just look up related things without following links.

Good newsletters often have lots of valuable content in the email. Sometimes there are interesting links, sometimes there aren't. If I don't want it anymore I'll unsubscribe.

It feels a lot like why we can't have nice things. If people just hit "Spam" instead of unsubscribing than this overly-cautious defense of senders becomes necessary. Luckily GMail at least has started pushing the unsubscribe feature somewhat, so maybe that will help out. But for now I am being punished because a lot of people mark things that they asked for as spam.


Why can't apple just allow some kind of pixel that doesn't reveal user identity, or strip user identity from what's already being used.

I don't really mind someone knowing I opened an email, just like I'm fine with a website knowing I visited (say using plausible.io rather than google analytics). I get that that's useful to them for non-nefarious reasons.


"Read receipts" are already part of e-mail and supported by every email client I am aware of. There is already a well-supported way to track whether e-mail has been successfully opened or not without using subversive tracking pixels.

The reason businesses don't rely on them is supposedly because "too many users disabled or rejected them during the past decade".

https://datatracker.ietf.org/doc/html/rfc3798


I feel like there is a body of literature waiting to be written about businesses refusing to take a hint in favor of user-hostile decisions. These things are conscious choices by the senders and they had several meetings about it.


The two best mail clients, mutt and whatever people like that runs as part of emacs now, don't have read receipts at all.

Even MS Outlook lets end users decline to send read receipts. There's probably some awful group policy system to force it, though.


Apple can't strip identity from the existing trackers because there's not a separate and distinct part of the tracker that encodes the user identity. It's integral to the tracker itself, which makes this an all-or-nothing proposition.


I guessed it would just be some url variables on the end of each image, is that not how it works?


A common technique is that somewhere in the email you'll see something like:

<img src="https://example.com/cd726f02-d2f4-4c0e-a717-e69044180c59.gif" height="1" width="1">

The image filename is a UUID. The UUID is of course unique for each email sent, but the Web server is configured to serve the same image for any given UUID (after recording the UUID as an "open" into a database).

There isn't a way for an email client to be certain that the image is or isn't a tracking pixel.


Sure. But if you strip those out, then the pixel itself no longer has any value to anyone.


Or can't you just load it but with a proxy - they get to know it got opened but from a fake IP.


> I don’t load remote images by default, so this already doesn’t work for me. However, basically every mail platform creates tailored links to track click engagement. So you’re screwed anyway, just maybe a little later.

Right, but I don't mind if companies I'm actually doing business with track my engagement. For newsletters I've actually signed up for, clicking the "load remote images" and/or on personalized links helps them with their business model, so why not? If I don't trust them with the data, I probably wouldn't sign up for their list anyway.

I'm more worried about randomly being tracked by who knows what person or organization. With the "don't load remote content by default", I have control over when and how I get measured.


I noticed that WikiPedia does something that would work for you; if you don't login and click the link in the email, they stop delivering wiki page change notifications.


It’s a lot less creepy to track active engagement like opening a link though. And probably more obvious to people that it might happen.


There are browser extensions that clean these links


Mail privacy is the right thing to do and implement it will be a major improvement!

That doesn’t threaten email newsletters that are legitimate and of interest to real subscribers. Communication should never rely on espionage tactics even for the sake of metrics. Forgo monitoring people, customers, or would-be customers, and save a ton of time as a result.

Marketing experts will start talking about how two ways conversation is the ultimate email strategy that works. Send a non-tracked email, let them hit reply. Brands and consumers, united in conversation, finally. That is as horizontal as it gets.


Have you ever managed a newsletter? Mail providers such as gmail use things like open rates to determine if a message should be in important, promotions, or spam.

Also, a sizeable chunk of people refuse to click unsubscribe links and instead hit the spam button. This can be a sensible response, as a lot of spam senders ignore unsubscribe. But it is also hard for legit newsletters.

So what is the best practice? Pruning your list of people who never open it. This improves open rates, makes gmail like you, and unsubscribes people who already would prefer not to read your letter.

Now it will be much harder to know who is inactive so you’ll end up sending more mail to people who don’t want it. And no double opt in doesn’t solve this.

There are other ways around the problem, but you seem to be in complete ignorance of what newsletter senders use tracking for.

Open rates also let you diagnose deliverability issues.


To be honest, these days I'll click the unsubscribe link in newsletters and stuff, but if they expect me to click on another small link on a website or even enter my email again I just go back and report it as spam. Spoken to some friends who do the same, and I feel that this is the only reasonable approach to take with this.


This is why a legit newsletter might have a confirm step:

https://news.ycombinator.com/item?id=27469535

I’ve had to deal with customers angry they did not get emails they wanted, and we tracked it back to a security service at their employer that auto-clicks all email links to check them. We had to add a confirm step to unsubscribe to keep it from happening. We’re B2B and I suspect it’s a much bigger issue than B2C because so many companies run custom email setups.


You know what, that's a pretty good reason. Guess I'll add "click an unsubscribe button on a simple website" to my list of acceptable ways to handle unsubscribing. :)


You might be able to check the user agent to differentiate legitimate users from automated scanners?

There's always the chance that they use a browser's user agent to disguise themselves but that should be easy to check.


I bet most scanners use a "human looking" user agent otherwise it would be trivial to cloak the page when the scanner checks it.


Which isn’t related to what you are replying to. We are talking of legit newsletter that offer 1 click unsubscribe.


Did those people who hit the spam button subscribe to the newsletter or were they subscribed without their consent? Seems odd that people would go to the trouble of subscribing to a newsletter only to send it to the spam folder. On the other hand if they didn't (go through the trouble of subscribing), then it is spam.


Generally yeah some people will just hit spam as unsubscribe even to something they signed up for. A lot of people have email overwhelm. You gotta figure that a fraction of people on any service behave oddly.

I’ve even done it myself on occasion when I’m pretty sure I HAVE unsubscribed but I keep getting mail (from things I likely signed up for)


> Seems odd that people would go to the trouble of subscribing to a newsletter only to send it to the spam folder.

It happens. You have people in this thread explaining they hit the spam button when unsubscribe has a confirm step, even if they know they signed up.

There has also been long-standing advice not to hit unsubscribe on spam because all it does is confirm you’re there. A surprising number of people think that means never hit unsubscribe links at all, even in things you signed up for.


> It happens. You have people in this thread explaining they hit the spam button when unsubscribe has a confirm step, even if they know they signed up.

This is also not a user problem.

I admit I haven't managed a newsletter, but if I would either sign up people that don't want to either through lying or dark patters, or make it hard for them to unsubscribe, meaning any step other than link click (and maybe a yes/no confirmation), then I don't expect not to be treated as spam.


I explain why a legit email program might have an unsubscribe confirm step here:

https://news.ycombinator.com/item?id=27470090

It’s to solve a particular user problem.


I accounted for this in my comment. There's confirm steps and then there's confirm steps. When I want to unsubscribe from your newsletter you already know my address, I shouldn't have to enter it, I shouldn't have to list a reason (though by all means keep it as an optional), I shouldn't have to do more than one extra click.

If you indeed meant a simple "Yes I'm sure" confirmation button, then I agree.


You’re not paying attention to what you’re reading. The parent comment is saying some users will do this on all newsletters, even ones they signed ip for.

We’re talking about newsletters that only add people who sign up after a double opt in. We still have to manage this user behaviour.

Proactive pruning is the best tool that exists now. So we’ll have to figure out something new. One likely result is more paid newsletters and more moves to centralized platforms like substack which can deal with this.


> You’re not paying attention to what you’re reading. The parent comment is saying some users will do this on all newsletters, even ones they signed ip for.

I was paying attention, I was commenting on specifically:

> they hit the spam button when unsubscribe has a confirm step

Even if I've signed up for a newsletter, if I have to jump through (varying degrees) of hoops to unsubscribe, you are spam.


How would he know? How would anyone know??


I've seen people enter their email into those intrusive "sign up for our newsletter" popovers because they think that's the only way to bypass them. Which is probably one reason why sites keep using them. Not everyone is as web savvy as we like to think.


I report every newsletter and similar as spam because I have never knowingly or wittingly signed up for one. If I receive one, I was tricked into signing up for it (or never did), thus: spam.


workflow may be something like 1. Free music 2. required signup for band newsletter 3. Why am I receiving this newsletter? 4. Mark as spam


> 1. Free music 2. required signup for band newsletter

Where "required signup" may simply mean missing the tiny checked-by-default "don't not subscribe me" checkbox.

I have zero sympathy for complaints about marking "legitimate" newsletters as spam, when many of their ideas of "signed up" involve not unchecking a checkbox during a transaction. If you can't get someone to knowingly and enthusiastically agree to receive your newsletter, without any kind of subterfuge or dark pattern, it deserves to get marked as spam and end up in people's spam folders.


It’s not a checkbox, it’s a trade. Sign up for our newsletter and we’ll send you a free song.

That’s the deal you made. Don’t get pissed if they keep their end of the bargain.


I'm not talking about "sign up to get this for free", I'm talking about the very common case of a transaction to purchase or otherwise obtain something (potentially even a paid transaction) where there's a buried fine-print "spam me" checkbox.


This is the comment you were replying to:

> workflow may be something like 1. Free music 2. required signup for band newsletter 3. Why am I receiving this newsletter? 4. Mark as spam

So as I said, the deal is clear: Free music in return for signing up for the band’s email list. Don’t get pissed at the band for holding up their end of the deal and putting you on their email list.


The comment I wrote in response was 'may simply mean missing the tiny checked-by-default "don't not subscribe me" checkbox'. That doesn't describe all cases, just many common cases, hence the "may". If the deal is "free music if you subscribe" or "sign up to our newsletter and get free music", and that's presented in an obvious and non-deceptive way, and people sign up anyway, then sure, that's a legitimate subscription. (And people will still mark it as spam if they don't actually want it, and that's something to take into account when thinking of designing a system like that.)

And if the deal is "free music! Also, check this clearly identified box that's currently not checked if you want to subscribe to our newsletter", that's also a legitimate subscription; some people will still mark that as spam, and that's just something newsletters have to deal with, but I have marginally more sympathy for that case because spammers have somewhat ruined the concept of expecting reasonable unsubscribe links in unexpected mail.

But if the deal is "free music! (well-hidden fine print: leave this box checked to subscribe to our newsletter)", and someone misses unchecking the box, that's spam, and it should get marked as spam, and that newsletter should have serious deliverability problems; that's spam filtering working exactly as it should work.


From my experience, the straightforward trade where a subscription to the band’s newsletter (or reactivation if you’ve previously unsubscribed) is the price for the free song is the scenario. Right or wrong, people mark those newsletters as spam or delete them without opening them to check for an unsubscribe link.

People will mark spam as spam, but they also have no hesitation about marking legitimate bulk e-mail they willingly signed up for but are no longer interested in as spam as well.


To me this sounds like spam. If they want the music, give them the music. Don't make them sign up for your spam to get it.

It is spam unless they signup because they want the actual newsletter.


I don't think these changes at Apple will ruin your use case at all. From what I've read, will load images privately, which means it'll probably hide IP (as they've mentioned) and details about browser etc. It'll still need to load the image. If you were to create a specific image for every sent email, you can still see whether that image was accessed by Apple. Unless they create something like a CDN to cache every image people receive, even if they don't open the email, you'll still be able to see whether an email was opened. You just won't be able to see from where, or from which browser, which seems unnecessary in your use case.

To me this seems like the only actual negative impact could be on LE, who sometimes use this technology to find missing persons.

Edit: I was wrong, upon further reading they do get the images for every email, even ones that weren't opened. Seems wasteful (the majority of my email never gets opened), but it's a great implementation. Guess it's time to give Apple Mail another try.


I do understand it is tough out there for a newsletter.

The problem is, the same tactics that they want to use, that I might put up with for a slightly-trusted sender, are used by spammers for mostly the same reasons.

And I am not willing to put up with the repercussions of that for the benefit of some newsletter operators who are not me.

So there's the problem to be solved.


I’ve seen how fungible email lists can be for marketing departments.

I’ve seen cases of “I very carefully opted out of your dark pattern, and then your automatically opted in my account after the fact”.

Unfortunately a lot of companies that will take your email for verification/password resets don’t keep that list away from their marketing department.


True, but that has nothing to do with the comment you responded to. Regardless of whether tracking pixels are blocked or not, scummy marketers are still going to do that.

The question is, will it hurt the indie newsletter guys and gals, the people sending stuff you actually want? Certainly yes. They won't know if they're still giving their audience something of value.

The bigger problem, in my mind, is the unintended consequences of this. Will blocking tracking pixels actually cause those scummy marketers to send even more emails? My guess is, absolutely yes.

Post-tracking, nobody can prove the marketing department emails are ineffective or hurting deliverability by oversending, so let's blanket inboxes with as many as we can!


This is so true. Bad open rates are the #1 tool I use to convince colleagues to send less email.

The immediate impact of Apple’s new feature is going to be a big increase in open rates. It’s going to be so hard to explain why that is not necessarily good.


The best practice is supposed to be RSS (or something in that paradigm).


The problem with RSS is you can’t force sign up people without them realising.

Almost all newsletters are spam and should be treated as such.


Based on this, I predict that newsletters will start forcing you to click a link to read the entire newsletter.


That is what will happen. Send an excerpt and to view the full post click on the link, which will be tracked along with the website which serves content filled with javascript trackers and cookies :(


This was industry standard for email in publishing a decade ago. Email was just a tool to drive web traffic.

Over the past few years we’ve seen that change, to where entire businesses have been built around putting the content directly into the email (The Skimm, Substack, Axios, etc). It will be interesting to see if it switches back, if clicks are the only thing senders can measure.


What about Fonts and CSS, will that too be proxied and auto downloaded? if not then Substack, etc will start using that to track open-rates.


It’s a good question. I’m definitely interested to do some testing to see exactly how the new Apple feature works.


Simple: send a letter every month with a link that says “Click here if you still want to receive this newsletter”. Then remove everyone from the list who hadn’t clicked it after a week.


Sure, and that’s not spammy at all


I think this could be done without being too obnoxious: 'We try not to send emails to people who're not interested - click here to confirm that you still want to get this newsletter'.

It doesn't have to be every month - each time someone reconfirms their interest, you could wait longer before asking again.


You don't need to send this email to everyone. Only to those users who haven't clicked on a single link of your regular newsletter for the past X months.


And doesn’t have any negative repercussions forcing people to constantly repeat themselves. “Yes, I still want what I said I wanted a month ago.”

“Why did you stop sending it to me?”

“You didn’t say you it.”

Yes I did! 15 times!

Well, not this month.

It’s like consent for sex is supposedly supposed to be like today for some inexplicable reason.


Maybe if it was easier to unsubscribe (i.e. by making the unsubscribe button prominent) than to report as spam, less people would default to reporting it as spam. But in my experience, the unsubscribe button is quite difficult to find.


Using unsubscribe buttons is a waste of time.

Most spammers use that to make sure that an email is still active.


Every privacy-focused push by Apple – or anyone, really – forces publishers to find less invasive methods for engaging with their audience, without having to rely on skewed data and grotesque tracking. How could that be bad for journalism? We got rid of blinking text and popup ads for a reason, and this is just the next step.


because one possible consequence of this is that it forces people to move towards closed platforms like Apple's own if they want to effectively advertise and that includes forking over substantial amount of money to those platforms.

Which is of course the economic incentive that a company like Apple has to introduce these measures, it creates an asymmetry where Apple has all kinds of user information, but competitors don't.

And if you want to see the effect that declining ad revenue has on journalism you can just look at the decline of local journalism across the US as revenue shifted from advertisers to digital platforms.


> Which is of course the economic incentive that a company like Apple has to introduce these measures, it creates an asymmetry where Apple has all kinds of user information, but competitors don't.

It's completely fair to speculate that this is Apple's true goal, but I actually do feel a little bit better about Apple doing this than, say, Facebook, or Google. The reason I feel a little bit better is that Apple at least still has an actual business model where people give them money in exchange for a product. I'm willing to be charitable and speculate that at least some of the reason Apple releases services like this is that it will cause people to continue to buy iPhones (which are wildly profitable).


Apple doesn't offer an alternative even if you want to pay them. It's simply saying "you can no longer do this to our users, it's now illegal".


In this case and things like ATT, Apple is saying "you can no longer do this to our users unless they agree to it first". And they default to asking users. That users are the ones making these choices is an important point.


You know you can opt in and out of these features right? The whole point is to let the users pick themselves...


These features Apple introduce sell well because people (including me) want them.

If that means journalists lose revenue, they should look for other ways. Using intrusive ads as an excuse for “otherwise we don’t have money” is just dumb. They’re free to think of other ways.

The best journalism I’ve read (ftm.nl, dutch) is a subscription service and they don’t rely on ads or tracking. The sites that do this kind of tracking, in my anecdotal experience, produce shitty journalism.

If this is bad for journalism, we’ll end up in that crisis and figure out a way that doesn’t use these methods.


> These features Apple introduce sell well because people (including me) want them.

You want the service, you don't necessarily need it from Apple though. That's the crux of this entire argument: Apple's black-box model is terrible for the industry. Apple is opposed to any roads that don't run through taxable lands, so it should come as no surprise that they want to tear down everything that keeps the web currently working. The less functional the internet becomes, the higher pressure there is to use native apps: that's likely part of why Safari is woefully broken and outdated compared to Chrome and Firefox.

> If this is bad for journalism, we’ll end up in that crisis and figure out a way that doesn’t use these methods.

We are already in that crisis. Whenever a paywalled link crops up on Hacker News, the first comment is always an archived version for the 99% of readers who would otherwise be unable to read that. Compared to the past 15 years of reporting, that's a direct downgrade. Adding synthetic friction to the flow of information never works: games get cracked, movies get shared, shows get ripped and music gets leaked. It's nothing new, and pretending like it's somehow not going to affect the next decade of reporting seems a little disingenuous to me.


> that's likely part of why Safari is woefully broken and outdated compared to Chrome and Firefox.

How?


Where along the way did society come to implicitly accept the (completely false) dichotomy that the only two possible options are "ads" or "shitty journalism"?


Also, don't forget the 30% cut they will take for premium newsletters.


> it creates an asymmetry where Apple has all kinds of user information, but competitors don't

That is true only if Apple competes with them, which is not the case at all.


But they do? Apple is literally in the news business, the services business (many of which rely on ad revenue to compete with Apple's own services), increasingly in the ad business itself (revenue is expected to rise to 11 billion in 2025, growing quickly)[1], and as I just laid out in the post above, has a huge interest in just laying waste to independent revenue streams outside of their own channels, in the exact same way digital platforms overall benefited from laying waste to the small and mid-sized ad-industry.

[1]https://9to5mac.com/2019/11/15/apple-ad-revenue/


> Apple is literally in the news business, the services business (many of which rely on ad revenue to compete with Apple's own services)

They are a news aggregator and distributor, they are a customer of media and news agencies. Or a parasite, depending on point of view. Still not a competitor. They also still don’t compete with ad brokers and don’t do any targeted advertising.

> increasingly in the ad business itself (revenue is expected to rise to 11 billion in 2025, growing quickly)

These ads are in the Stores and keyword-based. Which is distasteful, but not quite the same level. Again, they don’t distribute ads, and are not in the market for targeted advertising. They don’t compete with ad networks, and if they weren’t doing that there would just be no ads on the store. Like it was not that long ago.

> in the exact same way digital platforms overall benefited from laying waste to the small and mid-sized ad-industry.

If the mid-sized ad industry does not rely on tracking, blocking invisible pixels in newsletter won’t affect it. If it does rely on tracking, then it can’t die soon enough.


Apple is very explicitly in the tracking and ad targeting business. See https://support.apple.com/en-us/HT205223 for the information they collect in order to allow ad targeting against you. They unfortunately don't explain just what the data they "make available" to "strategic partners" is though.

Note: I'm not claiming that Apple is somehow a particularly bad actor in that regard. But their ads are not just keyword based. They track you, and sell access to you based on the information they collected, just like other adtech companies. Does that change your conclusions?


from your link, "Apple doesn’t detail its current ad revenue, and analyst Samik Chatterjee seems to imply that the number could only be reached by including some form of advertising within or around Apple TV+" and "Apple’s most recent earnings report revealed that it earned $12.51B from Services in calendar Q3/fiscal Q4, though there is no breakdown on how much of this comes from ad revenue."

so it seems that the current revenue is a guess and the projection is a guess.


This asymmetry is already very real, and a quite dominant pattern of Apple's strategy is now to build mechanisms to protect explicitly their ability to monetize all aspects of their _users_, not so much their devices.

These small steps taken under the banner of "preserving the users' privacy" are also steps to make sure that all those clumsy users don't get offered something without giving Apple the opportunity to profit from it first.

And the only disarming response to this so far is "yeah, but that's fine for me. I WANT Apple to take control, they're the good guys with the cool products!"


It's believed Apple generates ~$2B per year from advertising revenue (through Appstore PPC) and that could increase to over $10B in 2025. [0]

[0] https://9to5mac.com/2019/11/15/apple-ad-revenue/


This is paid keywords in the stores. They don’t do targeted advertising and are not an ad broker, which are the companies whining about being unable to track people.


Fine: call it Dynamic Advertisement if it helps you sleep at night, but Apple is still targeting the user with an ad that is relevant to the content they're searching for. Furthermore, Apple's policy seems to only apply to their own platform: it's estimated that they spend hundreds of millions of dollars on AdSense marketing campaigns, which are highly targeted and among the least respectful ad platforms around. Evidently their motto of "privacy is a human right" only applies if they deem you "human" enough...


I totally agree with your Apple pays for Google Ads which they now are the most invasive.

But, people don't mind targeting when it is context-based, rather than user-based. Tracking is following a user or device. Context is, well, this is a website about camping, I'll pay for ads for my sleeping bags. The user isn't really part of the process, there is no tracking, just targeting which I am sure everybody is fine with if it doesn't cross the "tracking" line.


> “This is another sign that Apple’s war against targeted advertising isn’t just about screwing Facebook,” Joshua Benton wrote in Nieman Lab. “They’re also coming for your Substack.”

I mean good? Like you, I struggle to see the downside of this, really. Probably the only risk in the bigger picture is the degree to which wealthy billionaires fund free lies such as Brietbart or the Murdoch papaers, while actual research and journalism is pay-for. But the wealthy billionaires are doing that anyway, so it's hard to see much change.


> How could that be bad for journalism?

I don't know about journalism per se, but for journalists, they presumably arrived at the status quo as the profit maximizing option, and removing it will, to varying degrees, impoverish them.


That is a sensible first hypothesis, but it rests on many assumptions, in particular that the market doesn't have any prisoner-dilemma/tragedy of the commons aspects to it.

It is quite conceivable, for example, that every single journalist is better off if they make click-bait listicles instead of investigative journalism, but the profession as a whole suffers.


Seems like an argument against making any kind of change to any industry.


You're not wrong; it's not like industry constantly lobbies against regulation because they'd be _more profitable_.

Maybe it's called for and in the consumer's best interest, but let's not pretend Apple is doing this for industry's bottom line.


Exactly the opposite actually.


Please elaborate


It forces publishers into closed gardens. I am willing to bet Apple's work here will have the same effect that advertising did on RSS, which is that newsletters will turn into truncated notifications designed to bring you to a website where they can get the business metrics they "think" they need.

I actually think there is a nice middle ground for something like a basic view counter, and some open rate data to be available in an aggregated, anonymous way.


You know, I had some beef with the word 'engaged' a few years ago, especially because I worked for a startup that cared about happiness instead (an active question rather than passive inference). In that context, we realised it was ridiculous to ask if you were engaged with your job, we wanted to know if you were happy and so we asked the questions instead of trying to secretly gather the data by spying on your activity.

Now I downright hate it. What does 'engaged' even fucking mean? One definition is that you're 'locked', so your attention is locked with them and not someone else. A public toilet cubicle will say 'engaged' when someone is in it.

For an email newsletter, you can see how well it's doing both by the number of subscribers on the list, and also by how many people click through and read the full article on your site. No tracking involved, you just send out an email and look at your logs for an uptick in traffic.


Click through detection requires inclusion of at least a newsletter id in a query parameter, or something along those lines, for the links provided within the newsletter. Without that, there’s not enough specificity to get anything other than a rough idea of how many people might have clicked the link right after you sent the email.


You can make a case for it not being tracking if it's not a link masked behind 2 or 3 redirects through ad or link tracking services.

You can just have a link that you could log and rewrite in nginx/apache/caddy -> https://mysite.com/mailer/thepost --> https://mysite.com/thepost

Or just forget about all of that and just _ask_ people and make your decisions on that instead of extrapolating meaning through espionage.


> For an email newsletter, you can see how well it's doing both by the number of subscribers on the list, and also by how many people click through and read the full article on your site.

How is it any more happiness-centric to force people to “click through” again and again to read the full article? This is borderline reader-hostile in 2021.

The big revolution in email recently has been that the email itself is the product. Put all the content there; deliver 100% of the value with one click (the click that opens the email).

This is way better for the reader than having to click 12 separate times just to read a bit.


Doesn't Gmail and Outlook already anonymize tracking pixels? When I heard that announcement what I heard was, "we implemented a feature that Gmail and Outlook have had for years!". I don't think it will change the landscape all that much.


They don’t anonimize it, they just request it from the backend. They still request the exact same URL, so you can carefully track email opens on a person-by-person basis, you just cannot track IP addresses and/or set tracking cookies or whatnot.


The wording[1] also suggests they request the images even if you haven't opened the email, which obfuscates whether you've opened the email or not. With other services like gmail the images are only requested when you open the email, so it's possible to infer whether you opened the email or not based on whether the image was loaded.

[1] https://twitter.com/rjonesy/status/1401993816001978375/photo...


Gmail and similar providers proxy all image URLs they receive at the time they receive the email, so you can't tell when a user later opens the email. That said there might be bugs to make your images un-cacheable such that Gmail still loads them later, directly or indirectly, when you open an email.

Compare this with Apple Mail which proxies emails from a different, presumably non-Google IP address and which does so only when an email is downloaded in the background. So while you can't track IP address, yes, and you never could set cookies that I'm aware of without clicking a link first, this means you can still track "downloads" of your email to a local client, just not "opens" - and if your Mail app already downloaded images when the email was downloaded, then it's possible it won't even change that - you might not have been tracking opens this whole time... maybe.


>Gmail and similar providers proxy all image URLs they receive at the time they receive the email, so you can't tell when a user later opens the email.

I searched around and found some articles that makes the same claim[1], but in my own testing that doesn't seem to be the case (ie. I had to click on the email before image would start loading).

[1] https://sendloop.com/articles/the-effect-of-gmail-image-prox...


I did the same test (although some years ago) and gmail didn't request the images until the email was opened. Caching the images lazily also means that Google can save a ton in network bandwidth / storage for all those emails that are never opened (which is probably most emails the handle)


This is not correct. They load the URLs at the moment you open the e-mail. You are still trackable. It's just that they open it on backend, so they don't get your IP, but they still know that you opened it.


Gmail’s proxy only requests and caches the image when the user does. It does not hide anything other than the user’s IP address.


The UserAgent header is masked as well: something like

Mozilla/5.0 (Windows NT 5.1; rv:11.0) Gecko Firefox/11.0 (via ggpht.com GoogleImageProxy)


Will Apple do it differently?


Right, exactly the same way Apple Mail will work.


No, you’re missing the difference. Gmail requests the embedded resources when you open the email. So it’s still possible to track open rates through it, even if the proxy obscures your IP address. Apple Mail requests the embedded resources without you opening the email, so you cannot use it for tracking open rates.

A lot of people assumed this is what Gmail did, but it wasn’t actually the case.


This is why I find it hard to trust Apple products - if Apple funnels the request through their servers Apple also now has access to this data. Now, your personal data / metadata is available with more people than before. But you are supposed to believe this is all to protect you. /s

(And no, I don't trust Apple not to associate this data with a user's Apple ID and datamine it in the future - if your country has lax privacy laws Apple will exploit it till the law says otherwise.)

Edit:

Here's another perspective - now, even if I don't use Apple's iCloud backup or email services, Apple has found another clever way to learn about some of the marketing emails I receive. That information is very valuable.


> if your country has lax privacy laws Apple will exploit it till the law says otherwise

Given the wretched state of privacy laws in the U.S. that seems an uncharitable position. Apple has far more business motivation to treat its customers well in that regard than to try to squeeze money out of their data.

Although you’d think they’d have motivation to treat developers better than demanding a 30% cut, so there’s that.


If Apple re-uses iCloud Private Relay for this feature, which they might or might not be doing, then there are actually two entities involved and Apple presumably knows what user made the request but not what URL was requested: https://appleinsider.com/articles/21/06/10/how-apple-icloud-...


Typically they have an off switch for things that are considered sensitive data, and when they don't they seem inclined to course correct. If they don't have an off switch in the WWDC developer betas, that would be a bug for everyone to report via Feedback Assistant.


This is absolutely correct. Because you can connect Apple Mail to non-Apple servers, they are missing out on a lot of telemetry that Gmail gets by default (because it already goes through Gmail's servers.) This gives them an excuse to proxy non-Apple email. (on another note, it sure seems like most of Apple's moves are dual-purpose now, and I don't think that was the case in the days of Jobs.)

However, I'd like to see the Privacy Policy (if it's available and in plain English) for this feature before concluding that they're not immediately discarding this data (or even just where I get my mail from, which is also very useful information to further lock me in.)


Yep.

When Gmail first introduced this image proxy feature in 2013 it started showing images in emails by default, which is great. I researched blog posts from then and apparently a workaround that still worked was to serve a fake HTTP Content-Length header of "0" and Gmail's proxies wouldn't cache the image. It's unclear if this bug has been fixed or not, or if similar bugs affect Outlook's proxies, for example.

The rest of this post is speculation -

I wonder if it won't affect Apple's Mail app because Apple isn't loading images directly from a proxy, instead, the original URL is sent to the Mail app over IMAP or Exchange and then Apple will download the image by asking the Apple proxy for the unmodified URL. This means even if an existing Gmail or Outlook image proxy server can be tricked, it shouldn't affect the Apple Mail app.

That's not to say Apple Mail won't have other issues - for example, it shouldn't stop at images. Apple Mail supports CSS and web fonts, so theoretically all network traffic not destined to hit the IMAP server should go through the proxy if complete privacy is desired. I think the wording of the Mail app suggests it's more than just images.

And the way it's implemented, because it's not server-side, it does indicate that an email address checked using Apple Mail downloaded your email, so you know it's pretty likely there's a human at the other end and they use Apple Mail even if they don't know exactly when you opened the email for the first time, they know when your Mail app downloaded it and possibly when you received a push notification about it. Unless it caches content with every request, which it might, you might also know how many different Apple Mail clients downloaded the message and when which might still indicate patterns of use especially if you can create a network of tracking pixels across different email messages. Finally, nothing about the feature actually anonymizes links or prevents specifically tracking pixels, but that's probably a good thing until we invent local Content Blocker extensions for Mail app, for example.


Just saw this "Build Mail app extensions" https://developer.apple.com/videos/play/wwdc2021/10168/ Does this mean we will get content blocker for email then?


I have never used an email client that doesn't block it by default. I was surprised (and somewhat worried) when I heard it being announced for Mail.


I literally use a tool for hiring that tells me exactly when mail was opened and which links were clicked. So no, That is not anonymization!


I have a tool which opens emails and randomly clicks links.


Anonimization as in the IP address and location of the requester. Just like Apple Mail will do.


I liked this way to contact your subscribers, I received the other day. No tracking necessary and either engagement or pruning:

You signed up for my private email list at https://sive.rs/

... but since you've never replied, I can't tell if you're a real person.

Please reply to this email and say anything, ideally something about yourself like where you are in the world. Or feel free to ask any question.

(I read and reply to all. This part isn't automated. It's just me.)

If you don't reply, I'll assume you're not getting this, and delete this email (redacted) from my system.


When Casey Newton (author of the article) first launched his Substack newsletter, he was alarmed that the full posts were not displayed for gmail users - instead there was a "jump" (that many users probably don't see, because it's formatted as "... [Message clipped] View Entire Message"). The issue is that gmail clips emails at 102k, and the substack emails easily hit that limit when posts contain lots of urls due to 1) inline styling on links, and 2) the ballooning hyperlinks due to the tracking strings.

This person found that substack was ballooning a 59 character url to over 400 characters.

https://tedium.co/2020/12/22/gmail-102kb-email-size-limit-hi... (same author, more detail): https://twitter.com/ShortFormErnie/status/133992146683031961...

I was hoping this incident would cause substack and others to pull back on the reins a little bit. The urls on these emails are redonk, and clearly the authors aren't happy about users missing out on content.


I wrote the story on the size limit issue you linked and have thoughts on the issue listed here. (Long story short: This whole issue is a byproduct of the lack of standardization in the email space, something highlighted by the use of tables in emails, which are another reason why emails are so large. Long story short, email is in need of modernization, which could lead to better options for tracking than tracking pixels, which are not anonymized enough for publisher use cases.)

I agree that the amount of tracking going on in the Substack links is a bit aggressive, but I want to be careful to not put too much of the blame on them for the long links. Part of the problem is the service that Substack is using, Mailgun, is intended for transactional emails, rather than the newsletters that Substack is sending. My feeling is that Substack ramped up using Mailgun but probably needs to start building their own tech for doing this, because it’s clearly not suited for the Substack use case.

Thanks for sending the link—it is super-relevant to this issue.


Indeed, tables and in-line styles are industry standard email coding practices, and the main reasons email character count balloons. Tracking links are a tiny factor, unless maybe the email is stuffed with links. (I doubt Casey’s are.)

Thank you for figuring out that character limit. We redesigned and recoded a template to get under it.

And tables and in-line styling are industry standard for one reason: Microsoft Outlook. It still uses the ancient and horrible HTML rendering engine from MS Word, instead of a modern HTML engine like literally everybody else uses. And a ton of senders care about Outlook because so many high-value subscribers use it (e.g. corporate staff at big companies).

The other factor is that the use of email to send long-form content is pretty recent. For a long time before, emails were either personal, marketing, or publishing with “click to read full article.” All pretty short.


When I started my newsletter, I was seemingly the only person using email for long-form. Now everyone’s doing it.

The situation with Outlook should hopefully improve in the next year, as Microsoft is planning to make different versions of Outlook work basically the same, with the web version as the baseline: https://www.techradar.com/news/microsoft-wants-to-unite-all-...

The downside of this whole saga with Apple is that other than this Apple basically renders emails better than just about every other service—rendering essentially using the Safari engine. Gmail has improved but inlining CSS is still required because of it.

If everyone was working to a unified standard life would be easier for email senders … possibly even recipients.


Casey’s are fairly stuffed with links. The format is generally: main article; multiple sets of links to other articles; funny tweets. He might be more mindful these days of how many links he includes, because at the beginning he seemed quite alarmed that many readers couldn’t see the whole email without a jump.


1. There are (perhaps silly) reasons for newsletters to have tracking which is that if you send them to people who don’t read them then, even though it’s easy to unsubscribe, big mail hosts (eg Google) can down rank your host in their spam filters. Worse still, some users treat the spam button as “please delete this thing I am not interested in” but that is not really how the signal is interpreted by the mail host. The solution is for newsletters to auto-unsubscribe users if they seem to stop interacting with the emails.

2. The actual threat to the newsletter boom is that advertisers realise that, just like every other fad format before, newsletters aren’t a particularly better way to reach audiences, and so they will stop paying so much for the ad space. Or they will move on to some other fad format and demand will fall off a cliff.


>The solution is for newsletters to auto-unsubscribe users if they seem to stop interacting with the emails.

Not possible without tracking.


They aren't stripping query params off urls, so you can just add a recipient ID to any URLs in the email e.g.

    https://newsletter.com/linked-page?uid=7b32e2f7


That is ... not reliable tracking.


Works fine if you want to auto-unsubscribe recipients who don't interact with your emails.


Click tracking


> Given Apple's monopoly advantage with their preinstalled Mail app, we don't need much of an uptake from what they're calling Mail Privacy Protection to break the dam on spy pixels. You can't really say anything authoritatively about open rates if 5-10-30-50% of your recipients are protected against snooping, as you won't know whether that's why your spy pixel isn't tripping, or it's because they're just not opening your email.

This doesn't seem true -- I imagine that most tracking providers will start to simply ignore all link opens from Apple's proxy (I assume they'll be using Apple's IP ranges or otherwise be 'detectable').

DHH doesn't seem to recognize that Apple opens the link irrespective (the spy pixel will /always/ trip, not /never/ trip), so it should even be really easy to figure out which users are using Apple Mail.

That being the case, folks will only lack open data for Apple customers, without polluting the rest of the dataset.


Is it possible that Apple Mail is a huge proportion of opens because they’re one of the last to NOT block it? I thought Gmail and outlook already blocked images by default…

58% of desktop opens just seems extreme given proportion of Mac vs PC use.


Yeah, that stat is totally unbelievable. iPhone being 20x more mobile opens than Android is also pretty sus with about 50/50 US market share and Android dominating globally.


Hacker News: Big tech stiffles competition, the little guy can't compete

Also Hacker News: small independent publishers leveraging email for publishing shouldn't get engagement data on their independent newsletters.

Aggregate open rate data is vital to a newsletter. It makes it easy to spot delivery issues. It's an early indication of content quality, and important feedback loop.

I'm fully for blocking identifiable tracking. But isn't there room for a solution for anonymous engagement metrics?

Email newsletters are a great way for individuals to control their distribution channel built on top of federated, decentralized technology.

Adtech is the enemy.


> Aggregate open rate data is vital to a newsletter.

No, it's not. Mine exists without it, and yours can too.


This doesn't prevent creating unique names for the same image and sending a unique name per email. Apple's new approach hides the IP, but Gmail already does that[1], and they have more email market share, don't they?

[1] https://gmail.googleblog.com/2013/12/images-now-showing.html


Apple will apparently always retrieve the images independently of the user’s actions, so the metrics become worthless.


It's not specifically mentioned in the article I linked, but Gmail does this, and has for years.


Unless I'm misunderstanding how this new feature is implemented, tracking pixels will still work, but the data that can be gleaned from them will be more generic (the IP address will belong to a proxy).

Senders that are using these pixels to measure engagement (as opposed to building user profiles) shouldn't have much to worry about.


"Mail Privacy Protection works by hiding your IP address and loading remote content privately in the background, even when you don't open the message."


Does this give Apple an excuse to send the content of received emails to their servers, for the background proxy loading process? "Even when you don't open the message" is very creepy to me. I'm suspicious of any company that wants to read my emails to 'protect' my privacy.


Not necessarily. Tracking pixels are implemented using images (usually transparent ones), so all Apple Mail needs to do is send the image URLs to the proxies, not the entire contents of the email. What they're actually doing remains to be seen.


The simplest implementation here would probably be something where the server pulls a copy of images and then bundles them into an inline blob in the IMAP email storage.

They're "reading your emails" for functionality like spam filtering anyway. This seems like it would work on basically the same level as that kind of stuff.


> They're "reading your emails" for functionality like spam filtering anyway. This seems like it would work on basically the same level as that kind of stuff.

This is how Gmail started as well, and now Gmail is a big source of profiling info for Google advertising.


For most people using iPhones, Apple is not providing the server. On most iPhones the Mail app is hooked up to Gmail, company email, etc.

So it will be interesting to see how Apple inserts itself into that setup to implement the image proxy.


> They're "reading your emails" for functionality like spam filtering anyway.

Except for iCloud addresses, I'm pretty sure that that's not true for Apple Mail.


This is a great question. A lot of orgs issue iPhones and hook them up to “on-prem” corporate email servers that they own and operate. They would NOT be happy to find out that all their email copies are suddenly being copied to Apple.


Guess since I never click on those annoying “subscribe to our newsletter” pop ups, I missed out on the whole “newsletter boom” - but really if the whole complaint is about how they will no longer be able to track my behaviour so closely, I’m not too concerned about the “boom” becoming a bust.


I never understood the idea of newsletters.

If you have the material for one, why not just put it up as a website? Provide people with RSS feeds? Maybe link the posts to FB/Instagram/TikTok whatever.

Why do I need to get that stuff as an email?


You don't need to, you like to. You being a stand in for the general readership.

People sign up for email newsletters, people dont subscribe to RSS feeds. They do visit websites, which is how I read the couple substack authors that I do; but if you've already got the content why not email as well?


Because my email is for work, maybe some automated notifications I haven't moved to a messaging platform yet.

Email is not a thing I use to read long-form content like newsletters. It just doesn't match my workflow at all.

When I receive an email I expect it to be something actionable, something I need to react to, not "Hey, here's some cool stuff for you to read and a bunch of links". I have Twitter, RSS and other platforms for that.


Some newsletters are purely informational. I like to update my customers on upcoming holidays because it affects how we do business. I also like to update them to remind them of where they can get our W-9 form for tax filing. They're not really the type to use RSS or check the website.


I do get the idea of email updates in traditional businesses, it's mostly marketing.

But why would heavily technical people want to clutter their inbox voluntarily with newsletters? Do some people enjoy reading long-form newsletter content in their email client that much?


That I don't understand. As has been proposed as a solution before, I see a lot more utility in a daily or weekly roundup of all newsletters delivered to my inbox. I do like to read a few specific programming-related newsletters, but don't actually clickthrough that frequently.


Unless Apple’s proxy loads every image in all emails independently of the user opening them, it’s still possible to track when a message is viewed by having images with unique URLs for each recipient.


> Mail Privacy Protection works by hiding your IP address and loading remote content privately in the background, even when you don't open the message.

It does load all the images independently of the user opening it.

My guess is that the server will pull a copy of everything as soon as the email is received and bundle it all into an inline blob that goes to the client.


The picture in the embedded tweet[1] suggests that the images are loaded even if they're not opened.

[1] https://twitter.com/rjonesy/status/1401993816001978375/photo...


I find it pretty ironic that Apple also seems to be one of the largest buyers of targeted ads. When the M1 iMac released, I couldn't visit a single website without their grating "Colors" ad puttering along on the side. If Apple considers privacy a human right, can they at treat me like a human too?


Not popular here, but Apple might only be against targeted Ads if its done without Apple's participation.

The general assumption of many people seems to be that Apple is taking effort to make their user Anonymous. But quite clearly it can not be in their interest to make them Anonymous to Apple.

To be quite blunt: If Apple's strategy serves them right, their future user should be free to choose in all areas of his life from the options Apple curated for him.


My favorite email is the "we're going to stop sending you emails because you aren't ever opening them."

I use mutt. And this is proof that it does the job.


I’m confused. When I open a mail in iOS, I get a banner saying “this message contains unloaded images”

I thought the only ones loaded were ones embedded as an attachment. Is that not the case?


You're not wrong. Not loading images will block tracking pixels completely. Apple is just adding a way to send less PII while still loading images.


I rarely want images on my mails. Won’t this method show that I access my mail on an Apple device - this leaking information that might not be leaked otherwise?


Leaked to who, though? If you use this feature, then sure, Apple will know that you're using an Apple device.

But the purpose of the proxy is to shield the end-user's IP address, and probably their user agent, too. Some email providers already do this. If you load an image from a Yahoo mailbox, for example, the reported user agent is "YahooMailProxy; https://help.yahoo.com/kb/yahoo-mail-proxy-SLN28749.html".


Send a mail to bob@bob.com with an image of eztrack.com/bob123.jpg

If it’s loaded from an Apple ip you know Bob has an Apple device.


I see your point. If you're the kind of user who keeps automatic image download disabled, and rarely downloads them manually, keeping Mail Privacy Protection disabled might actually be more private. Fortunately, it isn't automatic. You'll have to enable it.

But if you do download a tracking pixel, email marketers already know you are using an Apple device. I see the Mail Privacy Protection feature as being primarily for people who want to automatically download images while sending less PII.


Only if you have a foolproof way of knowing Apple IP adresses


If Apple sends AppleMailProxy, they are leaking to newsletters that you use an Apple device.


Your interpretation of the current mail client behavior is accurate.

In the upcoming mail client changes, the mail client will be able to background-load those "unloaded images" through a proxy at Apple.

We don't yet know how that new behavior will intersect with the "don't load images until i permit it" behavior that you have enabled today, but presumably they can coexist peacefully as two options (that I'll be expecting and checking for, later on in the beta cycles):

"Background-load images when new mail arrives" Y/N

"Use Apple's privacy protecting proxy to load images" Y/N


I didn't really notice this resurgence of newsletters to be honest. But because mail is one of the few federalized systems it's pretty cool to see (maybe RSS will come back too? :o )

I also understand that you want to collect some data on how your newsletter is doing, it's just because mail isn't really designed for this that we can't separate between anonymized data collection and user tracking. That's maybe something RSS is better suited for.


I really really really want rss to become mainstream again.

It is the best.


I've had image loading turned off in Thunderbird for a decade or more.


I don’t think I’ve ever had a mail client that loads images by default. Maybe Eudora in the late 90s? I have a feeling html mail was coming in around then, and it was before I moved to pine.


A website that provides no way to control or restrict tracking arguing for people that want to abuse html emails to do the same.


This is like the “VHS will kill broadcast TV” argument all over again.


I doubt it. However, it might help reining in advertisers and close a gaping leak of private information that is quite difficult for a random user to plug. I wish, anyway.

We don’t owe advertisers a viable business. If their business plan depends on them sucking in private information without my consent, well, fuck them.


I think you may be mixing things up between advertising and marketing. Marketing is where things like newsletter click engagement tracking happens.

Usually you are dealing with the actual company sending the newsletter, at that point, and not the advertising industry.

Better to think of marketing engagement tracking through these dark patterns as being a form of forcibly getting you to fill out a comment card at a restaurant than to think of it as having anything to do with advertising.


If marketers really just care about open rates and not who is opening, why not make a standard where you can put a UUID identifying the email blast and then query Apple’s servers and get a number opened?

And Apple can respond “nothing” until it sees the UUID at least X times or something.


They also like to unsubscribe people who don’t open the emails. (This is good for the user and the sender.) An open standard could be designed for that too, though. I’m not sure Apple would implement any standard they make - there are lots of cool standards that never get implemented.


Apple’s in a position (similar to Google with Gmail and Microsoft with Outlook) where they can make a defacto standard just by implementing it.


Side effect: Apple's proxy servers will see every domain that emails you, even if you don't use Apple's email service.

It will hide your IP and open status from the sender, but not the fact that that sender emails you from Apple.


Email tracking pixels and click tracking have been ineffective for a while now anyway, as so many email servers/clients load images and crawl links without before the recipient actually opens the email.


"93.5% of all email opens on phones come in Apple Mail on iPhones or iPads"

How?


It is a measurement problem.

Android users are more likely to use Gmail which proxies the images so you can't tell what device it was opened on.


93.5% of all trackable email opens on phones comes from Apple Mail on iPhones or iPads.

If Google is already doing something similar for gmail then android statistics would be ignored or worthless.


I not only block images from loading, but I go a step further and default all eMails to plain-text display only.

Which is really fun when a sender uses only HTML eMail, and has nothing at all for the plain-text portion. Those tell me that this is a particularly crappy marketer that is really only going for the low-hanging fruit, much like what Nigerian Princes do in their scams.

But then again, I have a very dim view of marketing eMails anyhow. If I have a need, I’ll research it. Wait until I explicitly reach out; don’t call me, I’ll call you.


No, I Don't Want to Subscribe to Your Newsletter

https://news.ycombinator.com/item?id=13948561


I've had images turned off in my email for 20 years and I still get paper mail from banks that say "We're returning to paper statements for you because you don't seem to be reading our emails."

Yes I'm reading your emails. Your email vendor is simply lying to you when they say they know when emails are not being read. Quit believing them.

Maybe this move by Apple will finally get the message across.


Did the newsletter boom depend on tracking their users? I do not believe it. It is all to be demonstrated that tracking actually works.


For a relatively-privacy-focused newsletter service check out Buttondown[0] Not affiliated, just a happy user [1]

[0] https://buttondown.email [1] https://sourcetarget.email


Weird, at first I thought that there must be a (1999) missing in the headline :)

Aren't images in HTML emails initially disabled in most "proper" mail client (like Outlook), exactly to prevent tracking through things like tracking pixels? I thought that's standard practice since at least a decade.


The change is that Apple are going to block the tracking images even when the user displays images, presumably by loading them through a proxy given that Apple says they'll be masking IP addresses. That goes beyond simply not displaying images.


Hmm I see. This of course gives Apple much more information about me than the individual newsletters could extract on their own (because all that information lands at Apple now). Not sure how this is supposed to improve privacy over simply not loading the images at all.


My understanding is that pixels will work but sender will not know device type, IP, etc. Am I correct?

If I’m correct then how this is going to hurt newsletter publishers?


How many people actually subscribe/read newsletters? And if you do, which ones do you follow?

(I'm honestly curious)


I always read the Matt Levine newsletter "money stuff": https://www.bloomberg.com/account/newsletters/money-stuff


TL;DR: No

Needle in the haystack:

> But after conversations with newsletter writers and media executives today, I’m not sure that people doing email-based journalism have all that much to worry about from the shift.


I hate advertisers like the next guy, but what I hate even more is a company acting as a regulator.


How are they acting as a regulator? They are providing features users want. And customers show again and again they are willing to pay more to increase their privacy.


Better a company than no one.


Thunderbird doesn't load images automatically since basically forever...


I thought Gmail routed images through their servers to avoid pixel tracking?


Is that the same as what Fastmail is already doing by not loading images at all and showing this warning message instead, with a link to "Load images"?

> Remote images blocked to protect your privacy.


When will Apple bring back RSS to Mail?


I've been toying with the idea of starting a newsletter. How can I measure the opening rate without tracking pixels?


Maybe you can't? Just a thought.


Betteridge's law of headlines applies to this one. Though this quote from another article was particularly inexplicable to me:

> “This is another sign that Apple’s war against targeted advertising isn’t just about screwing Facebook,” Joshua Benton wrote in Nieman Lab. “They’re also coming for your Substack.”

Substack's whole appeal (at least to me) is that it's not bogged down by the seemingly mandatory ads, popovers, and autoplay videos that plague every other news site.


Why is it that Apple is coming for anyone specific rather than just trying to protect user privacy in general regardless to who it is affecting? Of course, other than not being click-baity enough.


Reading some of the takes on this topic makes me realize that my consent is completely irrelevant to this whole industry at this point: https://mattietk.medium.com/apples-mail-privacy-protection-i...

> Apple’s fight for privacy is really a fight against the web. In signing up for a newsletter, a publisher or marketer already has a more valuable piece of PII: your email address. By focusing on IP addresses, and blocking trackers rather than proxying them on a fuzzy delay (which would provide the same useful publisher data without any PII leak of location or time), Apple are not really fighting for their users so much as they are fighting against email.

No. Embedding invisible elements that report back information I never intended you to have is "fighting against email". Terrestrial mail does not allow you to track where, when, or by whom it's opened. I think that's the expectation of most people for email as well. The fact that marketers have gotten away with something different thus far is a vulnerability in the standard as far as I'm concerned and should be fixed.


Substack's value prop is that subscribers receive richly-formatted emails of the posts; it's essentially a newsletter service with a web publishing feature.


I don't think that the emails being richly-formatted is a major part of the value proposition. People are subscribing for the words.


I think articles like this one are being a little dishonest. They can still put all the ads they want in newsletters. What they can't do (at least not like they used to do) is spy on their readers without consent.


Just to add a alternative voice.

Open rates are an important metric for ESPs to track bad actors on their platforms. If this implementation is a 100% preload those metrics then have no value.

IP anonymized pixel loads are a good compromise.

But, 100% preloads would actually make email list management best practices harder to implement. Specifically unsubing subscribers that do not open over a time period. Which many ESPs do in the backend to maintain list quality and minimize spam complaints. Some level of engagement feedback at the subscriber level does have value in the spam/unwanted email workflow.

Assuming you have a preexisting relationship with a business, it is not crazy on the privacy side of things to have an engagement feedback loop.

Assuming you are dealing with a spammer/list buyer ip anonymization provides an appropriate level of privacy, and any additional protection should be expected by the email provider not delivering the mail.


I am a human and I have agency. Your alternative isn't respecting my choices.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: