Archive for Media

Missed opportunities in Publishing

// February 21st, 2010 // 0 Comments // Attention, Media, Technology

MG Siegler over on Techcrunch yesterday wrote a story about how the AP is tweeting links to its stories. Those links, however, are not to its website. Instead those twitter links lead to Facebook copies of their stories!

Here’s a snippet of his post:

The AP is using their Twitter feed to tweet out their stories — nothing new there, obviously — but every single one of them links to the story on their Facebook Notes page. It’s not clear how long they’ve been doing this, but Search Engine Land’s Danny Sullivan noted the oddness of this, and how annoying it is, tonight. The AP obviously has a ton of media partners, and they could easily link to any of those, or even the story hosted on their own site. But no, instead they’re copying all these stories to their Facebook page and linking there for no apparent reason.

As Sullivan notes in a follow-up tweet, “i really miss when people had web sites they owned and pointed at. why lease your soul to facebook. or buzz. or whatever. master your domain.”

What’s really odd about this is the AP’s recent scuffle with Google over the hosting of AP content. The two sides appeared to reach some sort of deal earlier this month (after months of threats and actual pulled content), but now the AP is just hosting all this content on Facebook for the hell of it?

To me this isn’t unusual at all. In fact it’s common practice amongst ’social media experts’. Many of us use/used tools like FriendFeed, Buzz, Facebook etc not just to share links, but to actually host original content. We actively send all our traffic to these sites rather than using them as draws back to our own open blog/publishing platforms.

I completely agree with MG. Sending your audience to a closed destination site which provides you no brand control, monetization or cross-sell capability shows a profound misunderstanding of the economics of publishing.

Some will argue that the content should find the audience, and they should be free to read it wherever they like. Sure, I won’t disagree with that, but actively generating it in a non-monetizable place and actively sending people there seems like a missed opportunity to me. Why not generate it on your blog and then simply share the links in other places. If those users choose to chat over there, that’s fine, but the first, best place to view the content and observe the conversation should always be at the source, at YOUR source. YOUR site.

Some will argue that those platforms generate more engagement than a regular blog/site. They generate engagement because your blog is not looked after. You’re using inferior plugins and have not taken the time to consider how your blog can become a first class social platform. You’re willing to use tools that cannibalize your audience rather than attract them. You’re willing to use your  blog as a traffic funnel back to other destination sites by replacing big chunks of it with FriendFeed streams rather than hosting your own LifeStream like Louis Gray and Leo Laporte have done.

Some will argue (or not, because they don’t realize or don’t want to say it out loud) that they are not journalists, they are personalities, and they go wherever their audience is. They don’t monetize their content, they monetize the fact that they HAVE an audience by getting paying jobs that enable them to evangelize through any channel that they choose. Those people (and there are very few of them) have less incentive to consolidate their content sources (although there are still reasons to do so). Unfortunately, though, media properties sometimes get confused and think they can do the same thing.

The list of reasons why publishing stuff on Buzz or FriendFeed or Facebook as a source rather than an aggregator goes on and on, so I will just stop here.

I’m glad MG has picked up on it and written about it on Techcrunch.

#blogsareback

Update: Steve Rubel is agreeing with the AP’s approach. Using all sorts of fancy words like Attention Spirals, Curating and Relationships Steve is justifying APs ritual suicide of their destination site in favor of adding value, engagement and traffic to Facebook. Sorry Steve, but giving Facebook all your content and your traffic and not getting anything in return is called giving away the house.

Again, I’m not advocating that you lock content away behind paywalls, I’m simply saying that you need to own the source and make your site a first-class citizen on the social web. Not make Facebook the only game in town by handing it your audience.

[Audio] ET Conversation 4: Buzz’s Mixed Focus of Content Creation and Collection

// February 15th, 2010 // 0 Comments // Attention, Dataportability, Media, Technology

Over on EdgeTheory Conversations Louis Gray and I discuss Buzz and Google’s missed opportunity to be a pure aggregator.

Head on over to the site and check it out.

Google Buzz = FriendFeed Reborn

// February 9th, 2010 // 0 Comments // Analysis, Attention, Dataportability, Media, Technology, synapticweb

FriendFeed was dead, now it is re-born as Google Buzz.

I’ve not been able to try the product yet, but philosophically and architecturally it seems superior to FriendFeed.

Here are my observations so far:

Consumption Tools

Buzz is better than FriendFeed because Google is treating it as a consumption tool rather than a destination site (by placing it in Gmail rather than hosting it on a public page). FriendFeed should have always been treated this way. Some people got confused and started hosting public discussions on FriendFeed.

That being said, though, I’ve long said that news and sharing is not the same as an email inbox and those sorts of items should not be ‘marked as read’ but rather stream by in an ambient way.

While Buzz is in fact a stream, it is its own tab that you have to focus on rather than a sidebar you can ignore (at least as far as I can tell right now).

How it affects Publishers (and Echo)

The inevitable question of ‘How does this affect Echo‘ has already come up on Twitter. Like FriendFeed before it, Buzz generates siloed conversations that do not get hosted at the source.

So, the publisher spends the time and money to create the content and Buzz/Google get the engagement/monetization inside Gmail.

For some reason, all these aggregators think that they need to create content to be of value. I disagree. I long for a pure aggregator that does not generate any of its own content such as comments, likes, shares etc.

That being said, however, the more places we have to engage with content the more reasons there are for Echo to exist so that publishers can re-assemble all that conversation and engagement back on their sites.

Synaptic Connections

Note that they don’t have a ‘Follow’ button – it’s using synaptic connections to determine who you care about. Very cool! I worry though that there might not be enough controls for the user to override the assumptions.

Open Standards

Already, Marshall is calling it the savior of open standards. I don’t think Open Standards need to be saved – but they certainly have all the buzz words on their site so that’s promising.

That’s it for now, maybe more later when I’ve had a chance to play with it.

Update: After playing with it this morning, and reading a little more, it’s clear that this is actually Jaiku reborn (not FriendFeed), because the Jaiku team were involved in building it. They deserve a lot of credit for inventing much of this stuff in the first place – long before FriendFeed.

Also, having used it only for an hour, the unread count on the Buzz tab is driving me nuts. It shouldn’t be there. It’s a stream not an inbox. Also it makes no sense why I can’t display buzz in a sidebar on the right side of my primary Gmail inbox view. That would be ideal.

It’s also funny to me that some people have tried to give Chris Messina credit for Buzz even though he’s been at Google for no more than a month. They clearly don’t understand how long and hard it is to build product. Messina is good, but he aint that good :)

Facebook and the future of News

// February 4th, 2010 // 0 Comments // Analysis, Attention, Business, Dataportability, Media, Personal, Technology, synapticweb

Marshall Kirkpatrick has written a thoughtful piece over on Read/Write Web entitled ‘Facebook and the future of Free Thought‘ in which he explains the hard facts about news consumption and the open subscription models that were supposed to create a more open playing field for niche voices.

In it, he states that news consumption has barely changed in the last 10 years. RSS and Feed Readers drive very little traffic and most people still get their news from hand selected mainstream portals and destination sites (like MSN News and Yahoo news etc). In other words, mainstream users do not curate and consume niche subscriptions and are quite content to read what the mainstream sites feed them.

This is troubling news (pun intended) for those of us who believe that the democratization of publishing might open up the world to niche voices and personalized story-telling.

Marshall goes on to argue that Facebook might be our last hope. That since everyone spends all their time in Facebook already, that the service has an opportunity to popularize the notion of subscribing to news sources and thereby bring to life our collective vision of personalized news for the mainstream. Facebook already does a great deal of this with users getting large amounts of news and links from their friends as they share and comment on links.

Through my work with APML I have long dreamed of a world where users are able to view information through a highly personalized lens – a lens that allows them to see personally relevant news instead of just popular news (note that Popularity is a factor of personal relevancy, but it is not the only factor). That doesn’t mean the news would be skewed to one persuasion (liberal or conservative for example) but rather to a specific topic or theme.

Could Facebook popularize personalized news? Should it? Do we really want a closed platform to dictate how the transports, formats and tools of next generation story-telling get built? If so, would we simply be moving the top-down command and control systems of network television and big media to another closed platform with its own limitations and restrictions?

Personalized news on closed platforms are almost as bad as mainstream news on closed platforms. News organizations and small niche publishers both need a way to reach their audience using open technologies or we are doomed to repeat the homogenized news environment of the last 2 decades. The one that failed to protect us from a war in Iraq, failed to innovate when it came to on-demand, and failed to allow each of us to customize and personalize our own news reading tools.

That’s why technologies like RSS/Atom, PubSubHub and others are so important.

What’s missing now is a presentation tool that makes these technologies sing for the mainstream.

So far, as an industry, we’ve failed to deliver on this promise. I don’t have the answers for how we might succeed. But succeed we must.

Perhaps established tier 1 media sites have a role to play. Perhaps market forces that are driving them to cut costs and innovate will drive these properties to turn from purely creating mainstream news editorially toward a model where they curate and surface contributions from their readership and the wider web.

In other words, Tier 1 publishers are being transformed from content creators to content curators – and this could change the game.

In the race to open up and leverage social and real-time technologies, these media organizations are actually making way for the most effective democratization of niche news yet.

Niche, personalized news distributed by open news hubs born from the ‘ashes’ of old media.

Don’t like the tools one hub gives you? Switch to another. the brands we all know and love have an opportunity to become powerful players in the news aggregation and consumption game. Will they respond in time?

Due to my experience working with Tier 1 publishers for Echo, I have high hopes for many of them to learn and adapt. But much more work still remains.

Learn more about how news organizations are practically turning into personalized news curation hubs over on the Echo Blog.

SPOILERS: Understanding the deeper meaning of Avatar

// December 20th, 2009 // 0 Comments // Analysis, Media, Personal, Politics

“…some of the darkest chapters in the history of my world involved the forced relocation of a small group of people to satisfy the demands of a large one…” Jean-Luc Picard, Star Trek Insurrection

All the writeups I’ve seen about Avatar have focused on the timeframe it took to make it (something like 10 years), the cost (most expensive film ever made), the CGI (the most realistic CGI and motion capture ever), the 3D (yes you get to use those cool glasses), the fantastical imagination of James Cameron (the world presented is fully formed and utterly believable) or the theme of mother earth and symbiosis with the life around us.

In my mind, the film is not really about any of those things. It is in fact about what Jean-Luc Picard says in Insurrection and I have quoted at the top of this post.

It is about what all great works of art are about – the fallibility of the human condition.

Avatar is about a race of humanoids that could not be more alien from us and yet, by about half way through the film, it manages to completely convince us of their reality, their plight and their humanity.

The trick is so thoroughly executed that by the time SigourneyWeaver’s character is brought to the tree to be saved (unsuccessfully), she looked thoroughly alien to me. The blue CGI creatures around her seemed more real, more noble and more sympathetic than her tiny pink body. She could have been a little green man.

The point, however, was not to demonstrate the power of CGI or storytelling to convince us of an unreality, but rather to show us something that is all too real in our world; An all too pervasive inability to understand how those we perceive as ‘other’, as ‘aliens’, as inhuman, are just as human as ourselves.

Most of the Human characters in Avatar were perfectly happy (at least for the most part) to force the re-location or destruction of these blue creatures for the acquisition of ‘wealth’ from the ground on which they lived. The way they rationalized this inhuman treatment was to label them ’savages’ and later ‘the enemy’.

The human characters could not understand how smashing their trees and destroying their homes - terrorizing them – could result in acts of rebellion and resistance. Acts of Terror.

Does this sound at all familiar to anyone? Are there any people in our world (who at first glance seem inferior or strange) that have been relocated, interfered with, oppressed, suppressed and generally toyed with for decades for the purposes of ensuring and ’securing’ access to stuff in the ground – to oil?

Have those people become desperate? Have they fought back? Have they perpetrated acts of Terror? Have we perpetrated those acts in return? Has the cycle continued unabated with each side blaming the other?

Of course it’s all too unpopular (or downright unpatriotic) to suggest that the violence taken against ‘us’ in the west is somehow justified. In fact I believe that no violence that is not in immediate self defense or in the defense of others is really justified at all. Not ours, not theirs.

Avatar didn’t just manage to thoroughly convince me of the humanity of these blue CGI creators, it also showed in stark terms our ability to be inhuman to those who appear different from us. To justify killing by minimizing and demonizing the ‘others’ amongst us. To forget the acts of the recent past and justify the acts of the present and the future.

Avatar is a film that should go down in history as a feat of genius on every level of story telling and political commentary. Its deeper and much more profound message, however, like the message of the Matrix and other masterful works that balance popular culture, mass market appeal and important truths, will probably be lost on most movie going audiences.

It wont be lost on those in our world who seem Alien to us though. They probably won’t see the movie, but they are no strangers to throwing stones at tanks, being crushed in the name of valuable resources and being so oppressed and desperate as to resort to extreme interpretations of religion and acts of violence.

I wonder what our excuse is when we use our religious views (both of faith and commerce) to justify killing them.

Let me end on two notes of positivity.

Read my (naive?) post about how Social Media may help

And watch Barack Obama speak about the potential for a pragmatic and persistent peace

A special thanks to Michael Arrington and Techcrunch for kindly hosting us for a screening of the film.

Facebook privacy changes are not evil

// December 10th, 2009 // 0 Comments // Analysis, Attention, Media

I give Facebook a lot of crap. But I don’t think their latest privacy changes are all that nefarious.

It’s pretty obvious what they are doing. They want search inventory to sell to Google and Microsoft. They want to be as cool as Twitter.

I think the more important story is that they are turning their square into a triangle.

A well placed friend of mine (who shall remain nameless) gave me this metaphor (I will try not to butcher it too much).

Twitter is like a triangle. Small group of people (on top) broadcasting to a large group of people down bottom.

Facebook is/was more like a square. Everyone communicating more or less as equal peers (at least on their own personal profile pages).

This is very rare on the internet. It’s rare anywhere really. It’s unusual to have a platform that encourages so much ‘public’ peer-2-peer participation.

It’s clear, however, that Facebook is trying to have its cake and eat it too. They want to be a triangle for those who want one, and a square for those who want one of those.

Will it work? Maybe. They are a ‘Social Utility’ after all. They have never thought of themselves as a vertical social network with a static social contract. As I’ve said before, their ability to change and evolve at scale is beyond impressive. It has never been seen before.

From College kid profile pages, to app platform, to stream platform, to stream platform with deep identity and routing. Their flexibility, rate of change and reinvention is staggering. They put Madonna and Michael Jackson to shame.

Ultimately Facebook wants to be the Microsoft Outlook and Google Adsense of the Social Web all rolled into one. Maybe throw some PayPal in for good measure.

To do this I think you will see them continue to provide square or triangle options for their users (with their own personal bias towards triangles) and deprecate legacy parts of their system like canvas pages and groups.

Ultimately, though, the real opportunity is to look beyond the public vs. private debate and observe the ‘Multiple Publics’ that Danah Boyd and Kevin Marks speak about. But that’s a post for another day.

Is this good or bad for us? I’m not sure it matters. It’s another big bet for the company though, and it was a necessary step to clean up the half steps that resulted in privacy setting hell on the service so far.

Climate Crisis over, nothing to see here

// December 8th, 2009 // 0 Comments // Analysis, Media, Personal, Politics

The climate crisis argument has finally been debunked as fear mongering by tree huggers and polar bear lovers. These exposed email threads show the true nature of the forgery that has been perpetuated by these ’scientists’ on an unsuspecting world. These few scientists discussing this random data set in some random out of context conversation have totally and rightly undermined all the years of debate and research.

Of course, the visible aspects of change in our environment are just part of some cyclic, non-human generated climate change. It’s normal! Pollution in the air, extreme droughts and floods, record breaking hurricanes and the death of entire ecosystems under the ocean is perfectly fine. We don’t need to breathe, grow crops, live on dry land or have a food chain.

Also, the fact that our current energy ’solutions’ are based on a resource that is about to run dry, located in a region of the world that hates us (in most cases for our ‘energy protection’ actions) is ideal also.

As we all now know, Climate Change is fake. Sure the precarious resource and geo-political struggle fossil fuels continues to place us in are clearly real but instead of investing in clean alternatives, we should continue to destroy and re-build nations half way around the world. That’s a much cheaper and more productive alternative than investing in our own infrastructure and innovating our way out of the very real logistical and foreign-policy problems we’ve created for ourselves.

Speaking of cost, we can’t afford to save the planet or invest in our future. That could hurt the economy and we can’t risk that. We can just switch planets or go back in time when the planet dies. At least the economy will be safe though. There’s no possible way that comparing the needs of the economy to the whole planet is a false dichotomy. Sure, the economy depends on the fact that our world remains as it is today – No mass migrations due to new extreme climates. No real shortage of energy. No resulting wars (well, not too many anyway). Land to grow things. The status quo is the most likely future scenario right?

Of course if any of those things happen then our economy, and the world as we know it, will be over. Maybe we can switch to trading Water. At least you can drink water! Have you tried drinking money? Yuk! I’m so glad that climate change is now finally debunked.

In the mean time, we get to keep spending money on killing people. It makes for better TV and it’s easier to understand. You fire the missile, something blows up. Easy.

Causality between dirty, finite energy and climate change, health and war are way more boring to think about. More important, but definitely more boring. I’d much rather watch Fox News than the West Wing after all.

I’m so glad that debate is over – back to more important things like gay marriage and keeping marijuana illegal. Those things really affect my life.

Redefining Open

// December 1st, 2009 // 0 Comments // Analysis, Blog, Media, Technology

In my mind, there are four kinds of open.

  • Torvalds Open.
  • Zuckerberg Open.
  • Not Open but we use the word Open anyway.
  • Saad Open.

This fragmentation has diluted the word open to the point where it almost has no value.

It’s time to re-define the word open. First let me explain each category.

Torvalds Open.

In Linus Torvalds world (the guy who invented Linux) Open means that the software is developed through a community process. The source code is visible and modifiable by anyone and is available for free.

This is called ‘Open Source’.

Companies may package and bundle the software in new and novel ways, and provide support and services on top for a free.

The problem with Open Source on the web is that the software itself has less value than the network effects and up-time provided by a branded, hosted experience. Running Twitter.com on open source software, for example, would have very little value because Twitter’s lock-in is not their software, but rather their name space (@chrissaad) and their developer ecosystem all developing software with dependencies on their proprietary API.

Open Source is useful, interesting and important, but is not what I mean when I talk about the Open Web. I feel like its value is well understood and it is not the first, best way of making our world (and the Internet) a better place – at least not in the same way it once did when client-side software was the primary way we used computers.

Zuckerberg Open.

When Mark Zuckerberg talks about open, he is not talking about Technology. He is talking about human interactions.

Ever since the popularity of Data Portability (via the DataPortability project) Facebook has gone to great lengths to redefine the word Open to mean the way people interact with each other.

In doing so, they have managed to, in large part, co-opt the word and claim their platform makes people ‘more open’.

In many respects, and by their definition, they are right. Facebook has encouraged a mind bending number of people to connect and share with each other in ways that had been previously reserved for bloggers and other social media ‘experts’.

Facebook deserves a lot of credit for introducing social networking to the masses.

Their definition of Open, however important, is not the kind I’m talking about either.

Not Open but we use the word Open anyway.

This is when a platform or product has an API and therefore claim that they have an ‘Open Platform’.

There’s nothing open about having an API. It’s just having an API. The platform could be closed or open depending on how the given application and API is built and what limitations are placed upon it.

In most cases, an ‘Open Platform’ is not actually open, it’s just a platform.

Saad Open

My definition of open is very specific. In fact a better way to describe it would be Interoperable and Distributed.

To explain, let me provide some compare and contrast examples.

Twitter is closed because it owns a proprietary namespace (e.g. @chrissaad). The only way to address people is using their username system. They own those usernames and have final authority over what to do with them.

They are closed because they do not provide free and clear access to their data without rate limiting that access or cutting deals for improved quality of services.

They are also closed because they are not a federated system. You can not start your own Twitter style tool and communicate with users on Twitter or vice versa. The only way to message people on Twitter is to use Twitter’s propietary APIs for submitting and retrieving data.

A proprietary API is an API that is special to a company and/or produces data that is not in an open standard.

Wordpress, on the other hand (and to contrast) is an open system. Let’s compare point for point.

It does not own the namespace on which it is developed. The namespaces are standard URLs. This blog, for example is hosted at blog.areyoupayingattention.com. Wordpress does not own that domain.

Wordpress produces a single type of data – blog posts. Those blog posts are accessible using an open standard – RSS or Atom. There is no rate limit on accessing that data.

Wordpress is a federated system. While they provide a hosted solution at Wordpress.com for convenience, there is nothing stopping me from switching to Blogger or Tumblr. The tools that you would use to consume my blog would remain unchanged and the programmers who make those tools would not need to program defensibly against Wordpress’ API. They simply need to be given the URL of my RSS feed and they are good to go.

This makes Wordpress an open tool in the open blogosphere.

Blogging is open.

Microblogging should be open too.

To summarize. Open, in my definition, does not mean the software is open source or free. It means that the software receives open standards data, provides open standards data, has an interoperable API and can easily be switched out for other software.

Today I was challenged on Twitter that Echo is not ‘Open’ because it is proprietary code and costs money to use.

This person does not understand my definition of Open. Echo is open because it is not a destination site, it sits on any site anywhere. The owner of that site can take it off and replace it with another engagement tool at any time. The data being absorbed by Echo, for the most part, is RSS or Atom, and the data coming out of Echo is RSS.

It does not have any proprietary namespaces (except our useless legacy login system which we are trying to get rid of as quickly as possible) and does not pretend to create some amazing social network of its own. It is just a tool to communicate on the open, social web.

Is Echo perfect? No, of course not, but our intention is to make each and every aspect of the product as interoperable and distributed as possible. We will even use and contribute to open source where appropriate.

How does your product, or the tools you choose, compare? Tell me in the comments.

Next up, we should start to redefine the ‘Open’ community that creates open standards. Much of it is not very open.

Merry Christmas – The power of memes

// November 30th, 2009 // 0 Comments // Analysis, Attention, Media, Personal, Technology

Many, many of the things in our lives could be called ‘Memes’.  Here’s what happens when you type ‘Define:meme’ into Google.

Memes are everywhere. We just experienced a country wide meme here in the US called ‘Thanksgiving’. We are about to hit a similar meme (except this one is global) called ‘Christmas’.

Memes are fascinating things. They are almost as important as Context, Perspective and Metaphors. Together these three things compose the great majority of our thought processes.

What is this like (metaphor), What else is going on (context), What does everyone else think (meme), What does my experience and current state of mind tell me (Perspective).

Some memes emerge organically over time – like folding the end of hotel toilet paper into a little triangle. Others are created through brute force by strategic construction and repetition. No one has mastered this better than the extreme right wing of the US political system. Fox news is a bright shining example of how to craft, seed, propagate and manipulate a meme.

Silicon Valley loves a meme. We live on them. In fact one could argue that the whole ecosystem would shut down without the meme of the day, week and bubble.

.Com, Web 2.0, Data Portability, Real-time web, RSS is dead, Myspace, Facebook, Twitter, Cloud, Semantic Web, Synaptic Web and so on and so forth.

Like in real life, some of these memes emerge organically, some through brute force. Some make more sense than others. Some of these memes get undue attention. Some are created to stir controversy. Others form organically to create a shorthand. Some are genuine cultural shifts that have been observed and documented.

These memes matter. They matter a lot. They dictate a large part of how people act, what they pay attention to and their assumptions about the world in which they live, and the people they encounter. In Silicon Valley they dictate who gets heard and which projects get funded. They form the basis of many of our decisions.

Some services like Techmeme do a very good job at capturing daily memes. I’ve yet to see a service that captures memes that span weeks, months, years or even decades though. I dream of such a service. Particularly one focused on news memes.

Imagine being able to zoom in and out of the news, and drag the timeline back and forth like some kind of Google maps for headlines. Imagine being able to read about an IED explosion in Bagdad and quickly understand its context in the decade long struggle for the entire region through some kind of clustered headline/topic view.

Consider the context, perspective and metaphoric power such a tool would give us. How could it change our world view and help turn the temporary, vacuous nature of a microblog update into something far more substantial and impactful with an in line summary of the rich historic narrative inside which it belongs.

The algorithm to create such correlations and the user interface to present it would challenge even the smartest mathematicians and user interaction designers I imagine. It’s commercial value is vague at best. It probably shouldn’t be attached to a business at all – maybe it should be some kind of wikipedia style gift to the world.

Maybe the news media, Reuters, CNN and Washington Post might take it upon themselves to sponsor such a project in an effort to re-contextualize their news archives in the new AAADD, real-time, now, now now, every one is a journalist media world.

I’ve bought some domains and done some mockups of such a service, but I probably would never have the time or the patience to build it – at least not in the foreseeable future.

Maybe I’m just dreaming. But I think it’s a good dream!

Calling for open

// November 29th, 2009 // 0 Comments // Analysis, Attention, Business, Dataportability, Media, Politics, Work

Steve Gillmor often writes fantastic (and fantastically long) editorials on the landscape of the real-time web, but they are often very dense and sometimes fail to cover some key points. I thought I would take the liberty of translating and correcting his latest post with my own contributions.

Ever since FriendFeed was sold to Facebook, we’ve been told over and over again that the company and its community were toast. And as if to underline the fact, FriendFeed’s access to the Twitter firehose was terminated and vaguely replaced with a slow version that is currently delivering Twitter posts between 20 minutes and two hours after their appearance on Twitter. At the Realtime CrunchUp, Bret Taylor confirmed this was not a technical but rather a legal issue. Put simply, Twitter is choking FriendFeed to death.

Translation: The FriendFeed team were absorbed by way of acquisition. Twitter has terminated their priority access to Twitter data because FriendFeed is now owned by Twitter’s primary competitor.

Correction: Of course Twitter turned them off. Facebook is Twitter’s self-declared number one competitor. When you own the platform and the protocol you have every right to protect your own arse. In fact they have an obligation to their shareholders and investors.

What’s odd about this is that most observers consider FriendFeed a failure, too complicated and user-unfriendly to compete with Twitter or Facebook. If Twitter believed that to be the case, why would they endeavor to kill it? And if it were not a failure? Then Twitter is trying to kill it for a good reason. That reason: FriendFeed exposes the impossible task of owning all access to its user’s data. Does Microsoft or Google or IBM own your email? Does Gmail apply rate limiting to POP3 and IMAP?

Translation: Most commentators think that FriendFeed is dead because the founders have been bought by and buried inside Facebook. If FriendFeed is so dead why is Twitter trying to choke it.

Correction: FriendFeed is clearly dead. If you have ever worked for a startup and tried to ship a running product you know that focus is the only thing that will keep you alive. Facebook is a massive platform serving a scale of social interaction that has only been previously seen by distributed systems like email. The last thing Facebook wants is for its newly aquiried superstar team to waste time working on a platform that no longer matters to their commercial success or the bulk of their users (i.e. Friendfeed).

Twitter is choking FriendFeed for another reason – because it’s systems are now essentially just a proxy to Facebook. As stated above, Twitter can not give it’s number one competitor priority access to one of its major assets (i.e. timley access to the data).

The data that Microsoft and Google does not exercise hoarding tactics over (the examples Steve gave were IMAP and POP3) are open standards using open protocols.

I am never sure about Steve’s position on open standards, he often vacillates from championing the open cause through projects like the Attention Trust only then to claim things like APML and DataPortability are bullshit – maybe he just doesn’t like me (That can’t be right can it Steve?).

The fact is, however, that open standards and protocols are the basis for open systems which is why companies like Microsoft and Google do not control your email. Twitter and Facebook are not open systems.

So the reason Twitter is killing FriendFeed is because they think they can get away with it. And they will, as far as it goes, as long as the third party vendors orbiting Twitter validate the idea that Twitter owns the data. That, of course, means Facebook has to go along with it. Playing ball with Twitter command and control doesn’t make sense unless Facebook likes the idea of doing the same thing with “their” own stream. Well, maybe so. That leaves two obvious alternatives.

The first is Google Wave, which offers much of the realtime conversational technology FriendFeed rebooted around, minus a way of deploying this stream publicly. The Wave team seems to be somewhat adrift in the conversion of private Waves to public streams, running into scaling issues with Wave bots that don’t seem to effectively handle a publishing process (if I understood the recent briefing correctly.) But if Waves can gain traction around events and become integrated with Gmail as Paul Buchheit recently predicted, then an enterprising Wave developer might write a bot that captures Tweets as they are entered or received by Twitter and siphons them into the Wave repository in near realtime.

Translation: Twitter is killing FriendFeed because they think no one will notice or care enough to stop them – Twitter has more than enough momentum and support to continue along it’s current path. Facebook wont cry foul because they are doing the same hoarding technique with their own data.

Maybe Google Wave might save the day, but they seem to have lost their way.

Correction: Actually the only people who can call bullshit on Twitter and Facebook is us, the media. We are all media after all. Steve Gillmor in fact is one of the loudest voices – he should call bullshit on closed systems in general. Instead we all seem to be betting on one closed system to do better than another closed system.

We are like abused wives going back for more, each time pretending that our husbands love us. Guess what, they don’t love us. They love their IPO.

I was the first to support Google Wave very loudly and proudly. I met with the team and was among the first to get in and play with the preview. It is a revolution in collaboration and how to launch a new open system. It is not, however, a Twitter or Facebook competitor. Especially not in its current state. It is not even a replacement to email. It is simply the best damned wiki product ever created.

Waves are the 180′ opposite of FriendFeed and Facebook or even Twitter. They are open, flexible and lacking any structure whatsoever. Their current container, the Google Wave client, however, is totally sub-optimal for a messaging metaphor much less a many-to-many passive social platform. It is a document development platform. Nothing more.

The same could be true of Microsoft’s deal for the firehose, but here, as with Google, Twitter may not want to risk flaunting ownership of a stream that can so easily be cloned for its enterprise value. And as easily as you can say RSS is dead, Salesforce Chatter enters the picture. Here’s one player Twitter can’t just laugh off. First of all, it’s not Twitter but Facebook Benioff is cloning, and a future Facebook at that, one where the Everyone status will be built out as a (pardon the expression) public option. This free cross-Web Chatter stream will challenge Facebook’s transitional issues from private to public, given that Salesforce’s cloud can immediately scale up to the allegedly onerous task of providing personalized Track on demand.

Translation: Maybe the enterprise players – specifically Salesforces’ Chatter – will save the day.

Correction: Doubtful. This is just another closed system for a specific vertical. It’s long overdue. It is awesome. But it is not a Facebook or Twitter competitor much less an open alternative to the proprietary messaging systems we keep flocking to. It is simply a long overdue expansion of the simple changelog tracking feature on ERP assets. It’s a simple feature that was sponsored by a simple question. “Why doesn’t the asset changelog include more data – including social data?”. Duh. I was doing this in my own web based CRM at the start of the decade.

It’s likely this pressure can be turned to good use by Facebook, unencumbered as they are by any licensing deal with Twitter. Instead, a Chatter alliance with the Facebook Everyone cloud puts Salesforce in the interesting position of managing a public stream with Google Apps support, which eventually could mean Wave integration. Where this might break first is in media publishing, as Benioff noted at the CrunchUp. Twitter’s leverage over its third party developers could be diluted significantly once Salesforce offers monetization paths for its Force.com developers. So much so that this may call Twitter’s bluff with FriendFeed.

Translation: No idea

But FriendFeed has always been more of a tactical takedown of Twitter than an actual competitor, a stalking horse for just the kind of attack Twitter seems most afraid of. No wonder the speed with which Twitter is introducing metadata traps to lock down the IP before a significant cloud emerges to challenge its inevitability. Lists, retweets, location — they’re all based on raising the rate limiting hammer to discourage heading for the exits. It’s not that retweets reduce the functionality of the trail of overlapping social circles, it’s that they lock them behind the Wall.

Translation: Twitter is introducing more metadata into tweets to maintain its lock in through API limits etc.

Correction: On this point Steve is partially correct. This isn’t about rate limiting though – it’s about turning Twitter’s proprietary protocol into a real-time transport for all the data the web has to offer. It is not about API limits but rather cramming so much value into the pipe that the pipe becomes like water – you gotta drink from it or you’re going to die.

I don’t expect anyone from Twitter to answer the simple question of when will Twitter give FriendFeed the same access they provide other third party client vendors. For now, it’s frustrating to not see the flow of Twitter messages in realtime, but over time we’ll build tools on top of FriendFeed to take such embargoed messages private. Once inside FriendFeed, the realtime conversations that result are just the kind of high value threads Chatter will support, Wave will accelerate, and Silverlight will transport. Keep up the good work, Twitter.

Translation: I doubt Twitter will play nice with FriendFeed and give them equal access again because once items are inside FriendFeed they turn into rich conversations. Conversations that Chatter will support, Wave will accelerate and silverlight will transport.

Correction: Actually Twitter does not and has never given fair and equal access to its data. FriendFeed had a moment in the sun with first class access the likes of which almost no one else has seen before or since.

I have no idea how Chatter fits into the B2C picture – it is clearly an Enterprise play for Salesforce. Wave indeed will act as a great interface through which to participate in real-time threads. The threads themselves, however, will need to be generated or framed by much more rigid systems designed for public discussion.

Silverlight is great for rich web apps. It is Microsoft’s way of bringing the richness of the client into the browser. Just like .NET is to Java, Silverlight is to Flash. A way for Microsoft to leverage a key technology component without handing the crown to someone/something it doesn’t control. But I’m not sure if fits into this discussion.

In the end, the only real solution for all of this, of course, is a return to the way the web has always worked (well). Open systems. The transport should not be Twitter, Facebook, FriendFeed, Wave or any other nonsense. It should be RSS and Atom (ActivityStrea.ms specifically) transported over PubSubHubBub and read by open standards aggregators. The namespaces should be OpenID based and adoptable by all.

The sooner the early adopter community realizes this, the commentators push for this and the developers code for this, the better off we will all be.

Disclosure: I work for JS-Kit, creators of Echo – one of the largest providers of Real-time streams. I also Tweet – trying to find an alternative though!