Dick Costolo recently spoke about Twitter as a platform on Charlie Rose show - "The future of Twitter is that we'll have a true platform, not just an API that allows developers to create an alternate Twitter experience, but an API that allows third parties to build on top of Twitter in a way that creates accretive value for the user, much how Amazon allowed third-party merchants to build into Amazon."
He made it abundantly clear that Twitter doesn't want its API to be used for alternative twitter clients. IFTTT does not necessarily create alternative twitter consumption client but it can be used to accomplish that.
On a side note (and it may not be popular with HN community); so far we have seen API used (majority of times) for alternative twitter consumption clients. May be with these API changes, we might see more innovation using Twitter as a "platform"? Rather than people trying to create alternative clients.
Well, IFTT's twitter hooks were exactly that kind of innovation, and it was just shot dead. How is anyone going to use it as a platform if you can't even read data from it?
Screen scraping is an interesting topic. From what I understand, a ToS is technically a legally binding contract, but if you send a screen scraper from a server that you are not physically at, then it negates it. Also, as I understand it, there is some discrepancy over whether a ToS is truly legally binding.
Well, actually breaking a site's ToS and benefiting materially from it is now considered a Federal crime. Aaron Swartz is being charged by the Feds for just that. It didn't involve screen scraping but use of a bot to download data, even though he was entitled to download that data normally, just not using a bot.
This is not true. Aaron Swartz is being charged for distributing non-free content that he happened to obtain that way. You make it sound like he's being charged with a felony for scraping free content.
Like last year’s original grand jury indictment on four felony counts, (.pdf) the superseding indictment (.pdf) unveiled Thursday accuses Swartz of evading MIT’s attempts to kick his laptop off the network while downloading millions of documents from JSTOR, a not-for-profit company that provides searchable, digitized copies of academic journals that are normally inaccessible to the public.
In essence, many of the charges stem from Swartz allegedly breaching the terms of service agreement for those using the research service.
The case tests the reach of the Computer Fraud and Abuse Act, which was passed in 1984 to enhance the government’s ability to prosecute hackers who accessed computers to steal information or to disrupt or destroy computer functionality.
The government, however, has interpreted the anti-hacking provisions to include activities such as violating a website’s terms of service or a company’s computer usage policy
Hmm, since the case hasn't been concluded yet, does that mean that that is a valid thing to charge a person with?
Also, the part you quoted ends with:
> "The government, however, has interpreted the anti-hacking provisions to include activities such as violating a website’s terms of service or a company’s computer usage policy, a position a federal appeals court in April said means “millions of unsuspecting individuals would find that they are engaging in criminal conduct.” The 9th U.S. Circuit Court of Appeals, in limiting reach of the CFAA, said that violations of employee contract agreements and websites’ terms of service were better left to civil lawsuits."
Also of interest:
> The rulings by the 9th Circuit cover the West, and not Massachusetts, meaning they are not binding in Swartz’ prosecution. The Obama administration has declined to appeal the ruling to the Supreme Court.
He's exaggerating. Theoretically they could send the feds after you, but in practice it will never be done. Screen scraping and botting websites is widespread in the industry and has even been used by several startups featured on Hacker News.
Actually, I think LinkedIn founder said in the interview that they (LinkedIn) was better off after the feature was turned off. Twitter chose to break the feature, but LinkedIn benefitted. Something about signal vs. noise...
It may have hurt in the case of IFTTT but if we assume the OP is right then this would simply be an edge case. Just because it hurt one 3rd party using the API doesn't mean all third parties will be prevented from innovating. Assuming Twitter is creating API usage rules to steer developers more toward building a platform rather than just replicating Twitter's functionality (which is what most 3rd parties are doing, the OP is right) its just not feasible or a productive use of time to verify that any given app isn't reproducing functinality (hence why they even have rules to begin with).
I totally get their concern about people making their own Twitter clients. But it's difficult to really push hard and tell the world you're trying to become a platform when the single most useful site for letting people connect your platform with other really cool stuff is disconnected because of your new policies.
Twitter seems to just have a leadership team with a complete lack of vision.
Tweetie actually did a great job of delivering relevant ads in a way that wasn't very obnoxious at all. Then Twitter bought the client, stripped out the ads, and started delivering really lame and irrelevant "promoted tweets"
The amount of cognitive dissonance is amazing. They need to ban 3rd party clients to protect monetization, yet they don't monetize their clients in a meaningful way. They want to be a platform, yet they do everything possible to make that effort fail and piss off potential partners.
All I see from them are expensive campaigns linking traditional media to whatever the twitter platform is supposed to be. I can't see how a business model that boils down to giving teenagers a way to communicate with Justin Bieber's assistant creates any value.
What does "a true platform" even mean? Currently my mind blanks when I try to think of any useful applications of Twitter, given that the only way to see tweets is on their web site now (effectively, I know there are some half assed clients still available for the time being).
Also betting on their API seems crazy now. Big companies or startups that spend other people's money might still be able to do it, but for a bootstrapper it seems like a recipe for disaster.
That's entirely the point. A "true platform" is, to Twitter, one where developers come up with new ideas that aren't obvious (hence, your mind being blank trying to come up with one on the spot), then Twitter copies / acquires them and extracts all of the value. It's the exact same thing that Facebook does on its platform (see Dalton Caldwell's experience at Facebook recently), and what OS vendors have done for decades.
I used to have a lot of ideas for Twitter apps, but now I am just confused. Not sure what is allowed and what isn't, and in any case, as you mention, whatever you would build would only have a very limited lifetime anyway. So it is not even fun to think about new ideas for Twitter anymore.
I wonder if that means Twitter want to roll out Facebook style "apps", so it has more control over things. At the moment it's not really a platform if you can't build anything that stores or displays tweets.
Twitter is realtime communication at it finest. They are the breaking news channel. Last year there was earthquake in east bay. First thing I did (even though it was middle of night) was to check my twitter when I sensed the vibrations. And I wasn't disappointed. Within seconds, I knew what was going on and how strong the earthquake was.
The amount of data they generate is humongous and can be very valuable. Data scientists can go through that data can do lot of pattern matching generate interesting insights. From how your product is doing in market or even complex predictions. That sort of stuff twitter wants developer community to build not yet another twitter client.
I think you are confused. What happened (and what this post is about) is they are preventing this kind of application to be built. You can't do pattern matching or whatever without access to the data...
> You can't do pattern matching or whatever without access to the data...
If you want "access to the data", you can get a firehose subscription from gnip.com or datasift.com
I once built an elaborate options pricer, only to find that my "access to the data" - which was basically a scraper from finance.google.com, was cut off. So I switched to finance.yahoo.com and soon enough they cut me off too! So I asked my professor and did what he told me - pay the subscription to IV ( http://www.ivolatility.com/data/historical_data.html ) and voila, the socket was instantly open and I could suck in as much data as I wanted.
It was 10 dollars for a month's access to a few MB of cleaned up csv historical option prices of a specific ticker.
And that's how resellers work - you pay exactly for what you want. Nobody's saying you have to pay 360000, like the other post implies.
Except that for Twitter you do. A few MB = 30 seconds of tweets. I don't know why you think financial feeds are related to twitter, other than both being data feeds.
The $360k price tag is not "implied", it's the actual price for access to 50% of twitter's messages (see the link I posted). 100% access can only be negotiated with Twitter itself. To be fair, from the information I could find, the cheapest plan from gnip is $500/month[1], datasift is $3000/month[2], both quickly go up. That means you can't just whip up a prototype in the weekend for some new idea anymore. This pricing probably filters out 99% of the things that could be built on it, limiting them to projects with investor backing and ready business models (which twitter itself still doesn't have).
I completely agree, there's a huge amount of data there that can be processed in a useful way. The problem is, at what point does something become a Twitter client? IFTTT let people use tweet data in a bunch of interesting ways, not just as another way of displaying things. If anything was using Twitter as a platform, IFTTT was.
I think you're wrong on that. Clients are the most visible use of the API for obvious reasons but I'd have to see data to convince me that it's disproportionate.
I think that is where Twitter's value degenerates. It's basically personalized RSS feeds with a smackload of users.
If you take away third party API capabilities for those RSS feeds in an effort to push people towards making "apps", you're going to lose developers who were in it for the functionality, not the community.
This feels very counter to Twitter's claimed intent in rolling out the new policies.
IFTTT is in no way trying compete as a Twitter client, and, especially in the case where I'm trying to archive my own Tweets, the service only enhances my Twitter experience.
Twitter's throwing a lot away in the name of squeezing more value out of its assets.
Twitter just moved into a new office, has been acquiring companies (remember, they're what drove Instagram's price up), and you really think they're secretly cash-strapped or something?
No definitely not, but the problem is that the clock is ticking and I think the FB IPO showed them what can happen when the right pieces aren't in place at the time of IPO.
No one is going to argue that Twitter has a technological advantage - their service is incredibly simple and could probably be completely replicated by a small team in six months to a year. Moreso than Facebook, they are relying on the network effect but the also monetize less than Facebook, so who really knows if they're ever going to be profitable?
Would I be violating Twitter's policies if automated a process whereby, when I compose a Tweet, the words I write (which are my own) appear simultaneously on something other than Twitter? Is it the round-tripping through their API that has Twitter's undies in a bundle? Because I could just skip that part entirely.
You should just skip it regardless. It's fairly obvious that Twitter has become a bad actor and should be removed from the content and communication pipeline.
AT&T used to dictate which phones you could connect to their network, too, and that was also a terrible idea.
Best way of putting it that I've seen. These recent moves serve to alienate developers (and users by extension) and reek of typical corporate desperation.
I seem to recall they now have a policy specifically forbidding Twitter client applications from simultaneously posting to other services, so you probably would be violating their new rules.
I've been using IFTTT to syndicate my Twitter posts to App.net. Guess now I'll have to default to App.net and syndicate to Twitter instead. Say goodbye to my ad revenue, Twitter.
For those who didn't shell out for App.net, you can also syndicate to Twitter from the completely open rstat.us, which also (for now) allows you to sign in with your Twitter account, so it takes five seconds to set up. https://rstat.us
No personal connection to rstat.us, just think it's a cool remedy for Twitter's new iron-fist policies.
Their investors obviously got tired of waiting for a return. When that happens at any VC-backed company they start ratcheting up the pressure on the CEO and executive team. And if they don't start generating a return quickly enough, they put their own guy in place. So co-founder Evan Williams moved on from his CEO position in late 2010 and the new leadership purged the old guard. Dick Costolo took over.
Either it took 2 years for his profit strategy to come together or the pressure started ratcheting up on him, too. After all, investors have sunk a silly amount of money into Twitter; they expect a return.
Either way, I wouldn't want to work at Twitter right now...
Are you kidding me?! Why would Twitter do this? Picture Twitter as a tree trunk of data. There are branches and leaves that grow off the trunk, branches like IFTTT and other amazing services. But once you cut off the leaves, then the branches, only the trunk is left. A dead, dead trunk. A couple months ago there wasn't an alternative to Twitter. Now there is. I'm switching to App.net tonight.
I started to think of Twitter in between SMS and E-mail as I think a lot of people did. To me Twitter is more of a protocol or even a modality than a platform. That's the brilliance of it: it's a speed and length of communication that feels very natural. I have no objections to these rules in terms of Twitter growing as a company. I think there are a lot of applications that can be built aside from clients and it makes sense for them to steer people in that direction.
As a user, however, I feel attached to the idea that data and application are separate. I would like to think that I own my Tweets, but most of all I just want to _feel_ like I own my tweets — like I can _do_ whatever I want with them and see them however I want. A short, passive message that I put out in to the world is a great thing and it seems unlikely that a single company can own that idea.
IFTTT seems like a perfect case for something that should be an open source project that anyone can install and run on their own servers, not as a centralized service, specifically to prevent things like this. Then anyone could contribute recipes and API clients and there's no central point of failure for them to be all removed in one go.
Yes, and when APIs fail: P2P screenscraping. Regardless of its legality, as some other commenters here have brought up, Twitter can't stop distributed reading and storing without blocking lots of IP addresses.
Well then, it's time for a 3rd-party Twitter search engine, using a P2P-based scraper, with no regard for API rules or ToS. In the long term, what's more important: Twitter's bottom line, or content not being thrown down the memory hole?
Yes, but isn't it worth capturing that content, and in doing so, their users? The search engine I am suggesting could easily transition to being the next Twitter. We grab the content, their users perform searches, and then the users migrate when they see that they can not only search every tweet ever made (since we began indexing) but also add to the database directly (kind of like Google having both a search box and an "add your own URL" box on the main page).
I'd guess that the vast majority of twitter users don't know anything about this API shenanigans, blocking 3rd party clients and all this bullshit. They don't know and they don't care.
As long as Justin Bieber and other celebrities continue to post, users will be there.
Also, the typical tweet doesn't make sense a couple of hours/days after being posted. I'm not sure if there's such interest in searching for old stuff.
People at Twitter must realize that when developers talk about your API's tos rather than the API, you must have broken something. It reminds me Facebook episode of network feed and privacy. At the end of it, Mark understood what the users were talking about and took action to correct it.
The problem seems like an issue of making profit by showing promotional tweets, which will not happen in the clients. It, to me, looks like the problem of management which could not come up with better revenue model.
Ok, I created the product http://2FB.me (ReTweet 2 Facebook) months ago and I read the same policy some weeks ago and didn't read it to mean this at all. 2FB.me makes share links for tweets enhancing & augmenting the experience. It doesn't clone any portion of Twitter. I think the same can be said for IFTTT?
Well, according to Dick Costolo it has nothing to do with the API changes: https://twitter.com/dickc/status/248947914582405120 but I'm struggling to imagine IFTTT killing a really useful feature for no reason.
There's no proof that it's dishonest - it's possible that either legal or twitter themselves tapped them on the shoulder and said they should knock it off.
Add to the list for the need for a decentralized, distributed platform with no one party in control of our information and publishing. I, for one, am really looking forward to what the http://tent.io/ guys come out with.
I used this functionality to track updates on software from companies/groups that don't do RSS. They do/did Twitter. I also got downtime alerts from Pingdom via Twitter.
I'm starting to see this as less and less of a platform I can depend on.
I don't get it. IFTTT complies with the new API policies. Infact, cool stuff like IFTTT is exactly what twitter should be looking for as platform apps which use their API creatively.
It's Twitter's way or the highway. From clients to value-added services, if Twitter doesn't own it, it's dead or soon will be. Fun while it lasted, I guess.
I am disappointed that I cannot post tweets to Facebook with this any more. However, using twitterfeed to post them should be fairly straightforward . . .
What about Zapier? Doesn't it provide the same Twitter connectivity as IFTTT did? I don't use either, but, from casual inspection a while back, my impression was that they are similar enough in that regard.
He made it abundantly clear that Twitter doesn't want its API to be used for alternative twitter clients. IFTTT does not necessarily create alternative twitter consumption client but it can be used to accomplish that.
On a side note (and it may not be popular with HN community); so far we have seen API used (majority of times) for alternative twitter consumption clients. May be with these API changes, we might see more innovation using Twitter as a "platform"? Rather than people trying to create alternative clients.