A couple of years ago I wrote about our need for an “opposing view reader" that would intentionally show us commentary from people with opinions different from our own. As far as I can tell relatively little progress has been made on this front. Twitter, for instance, will generally recommend to me that I follow people who are like the people I am already following. So I was happy to see that there is at least some academic research on this topic. The Technology Review mentions a paper titled “Data Portraits: Connecting People of Opposing Views” that is available on arxiv. Unfortunately when I actually read the paper I found that n for their study was tiny (37!) and I don’t think supports the conclusions with any significance (their stats notwithstanding).
In my original post I failed to explain fully why this problem has been growing in importance. One of the fundamental forces of the Internet has been the unbundling of content. If you are reading this right now you are getting my opinion from my blog or in your Tumblr dashboard (or via a feed reader). The post stands by itself. Whatever I link to was chosen by me. Put differently, there is no context that could provide for an opposing view, no additional editorial or purposeful pairing by an editor.
When you combine unbundling with a huge increase in available content, you wind up with a situation where someone could spend all their available time just reading content that will confirm their existing views. Existing recommendation and search algorithms are all built to re-enforce this by trying to present you with content (or people) that match your interests. That leads to what Eli Pariser has called the “filter bubble” — his TED talk on the subject is worth watching (or you can read his book).
I also should have given credit to my then fellow PhD student and now BU Professor Marshall van Alstyne who wrote an excellent paper on the subject as far back as 1996, titled “Global Village or Cyber Balkans?” (co-authored with Erik Brynjolffson). Here is a great quote from the introduction:
Information technology can link geographically separated people and help them locate interesting or compatible resources. Although these attributes have the potential to bridge gaps and unite communities, they also have the potential to fragment interaction and divide groups by leading people to spend more time on special interests and by screening out less preferred contact.
The paper itself is quite theoretical but I am pretty sure that today we could easily use Twitter data to examine the hypothesis.
If you know of a recommendation service that does in fact surface opposite views please let me know. I am also interested in additional research on the topic. In the meantime I am thankful for folks like David Pinsen whom I follow on Twitter and who routinely helps challenge my thinking.
I wrote about Russell Brand’s call for an unspecified revolution this past Friday. I liked his eloquent and indignant dismissal of the current political and economic system but he did not provide a vision of what a revolution should aim for. I have been struggling to wrestle down my own ideas on this and while I am still not quite there I feel like an outline is emerging.
Let me start by describing the goal. It is nothing short of humanity coming together on a global scale to eradicate poverty and disease and live in harmony with the environment. There I have said it, much like contestants at a beauty pageant declaring their goal to be “world peace.” I fully realize that this seems like an impossible dream, a forever unrealizable utopia. But I am quite sure that our lives today would seem like a utopia to pretty much anyone living in the Middle Ages (and yes, some parts of the world seem not yet to have escaped that time).
In fact, there are two compelling reasons for embracing such a new vision of utopia now. First, because it is within humanity’s reach. We have the technical resources to make sure everyone has access to food, clothing, shelter. We also have a technology (the Internet) to let us globally collaborate on solving problems. So any argument about “it can’t be done” at this point is a defeatist, negative one (and I plan to take on some of these in subsequent posts, such as the “goes against human nature” objection). Second, we need it more urgently than ever before. Not only are we screwing up the environment potentially beyond recovery but we are also ripping apart the existing social and economic fabric. The last few times we did this we wound up with revolutions and wars. We should all wish to avoid a horrible transition because given our capabilities the downsides could be much worse than even the previous world wars.
What does life in my utopia look like? Everyone has a basic guaranteed income. We are all connected to a global and free Internet (free as in not controlled by any one entity and free at the margin after paying a basic access fee that can easily be afforded with the guaranteed income). We are sharing information freely and collaborating to solve environmental and healthcare problems. We spend our time learning, producing and consuming art and (for some) working in a more traditional sense.
I have no illusion that it will take us a long time to get even close to this vision. Likely several, possibly many generations. But there does seem to be a path towards this world and it revolves around doing away with nation states (and hence also with the UN). Instead we need a global network of cities and regions. We could get there through the leadership of the mayors of the largest cities of the world. Already today the top 50 cities and their immediate surroundings globally have 10% of the global population living in them (and vastly more of its economic activity).
As a starting step, some of the largest cities could become the nodes in a globally free Internet. As a next step they might declare themselves Internet free trade zones with much less restrictive intellectual property regimes. There are likely some additional step to strengthen this alliance of cities including figuring out how to include regions. At some point they would need the guts to break away from their respective federal/state taxation systems. I will write a lot more about what a city and region based governance system might look like but to avoid massive distortions it would need a relatively simple and unified tax system (tax sales, income, treat inheritance as income and allocate on the basis of where sales happen / people spend their time).
And yes, I fully realize that this all sounds grandiose and lacks pretty much all detail. But the same was true at some point for air travel or having a global information network or routinely living to the age of 80 or cities with 20 million people living in them. So unlike Brand I am not calling for a random revolution but for laying the intellectual ground work for a new alliance among the cities and regions of the world, not unlike when the colonies came together to form the United States of America. We need a new set of Federalist Papers — or maybe it should be the Globalist or Humanist Papers. And yes we need to think big because the stuff our present national governments are doing generally amounts to spending a fortune on rearranging the deck chairs on the Titanic.
Russell Brand helped edit the latest issue of New Statesman. He leads off the magazine with an epic rant that is worth reading in its entirety. If you need some motivation, watch this 10 minute clip of him. Essentially, Brand is calling for a revolution.
It would be easy to dismiss Brand as a slightly lunatic comedian who lives a very comfortable life. But I think that would be a mistake. Aside from having a wonderful way with words, I find that Brand gives expression to a sentiment that seems very much pent up among a lot of people: the existing system has failed and is beyond repair. The net result of that is either apathy or violence. Or flipping back and forth between the two.
Brand is not really offering a coherent alternative vision. While that is a big open question, it doesn’t really invalidate his basic point about the pressures that are building up and why that is happening. And I sure wish that more people were speaking as frankly as he is about it as our politicians do seem to be largely in denial.
A big chunk of Brand’s critique is based on the assessment that we do in fact have the capabilities today to take care of our basic needs. This is a point I have made several times on Continuations — just look for my posts on abundance. What that means is that we should be focusing on such pressing matters as income inequality and the environment instead. And we should be tending to our spiritual health. Having watched a few minutes of an episode of the Real Housewives of Beverly Hills this morning while exercising I couldn’t agree more.
Here is a wonderful quote (among many that could be pulled) from Brand’s piece:
Fear and desire are the twin engines of human survival but with most of our basic needs met these instincts are being engaged to imprison us in an obsolete fragment of our consciousness. Our materialistic consumer culture relentlessly stimulates our desire. Our media ceaselessly engages our fear […]
That pretty much nails it. Go read the whole thing. It’s worth it. And I will come back to writing more about abundance and with that Basic Income Guarantee as the basis for a possible alternative structure for society.
My blog post on Monday about privacy and DRM was read by some as suggesting that we abandon any and all notions of privacy over night. That was not the point I was trying to make so let me try again, this time with an analogy. We secure our homes by closing and (generally) locking the front door. That serves as a demarcation and keeps out a completely opportunistic thief. It does not, however, prevent anybody even remotely determined from entering. For that we rely on some combination of social norms and laws together with law enforcement. It hasn’t always been that way. There was a time when people tried to protect their belongings by building castles and fortresses. Obviously this was an expensive strategy and only accessible to those few living behind the walls. It also turned out to be a futile strategy as far back as the city of Troy.
So when it comes to privacy and encryption I feel much the same way. Of course our bank balances or medical records shouldn’t be public web pages by default and we should use authentication and something like SSL when we interact with those pages to prevent the casual sniffer from observing them, but beyond that the benefits from applying more crypto diminish incredibly rapidly. For instance, should the bank encrypt their disks? Maybe, but will that block someone who is carrying out a focused attack from the inside? Unlikely. The same goes for medical records. Search queries. And so on. There will be more leaks of more data in the future because ultimately none of these systems can be secured perfectly (among other things against Trojans).
From an overall perspective then (and using a heuristic for prioritization that I wrote about just last week), we should not be applying our talents to ever more clever encryption schemes where we face dramatically diminishing returns. Instead, we should be working on laws and social norms. First and foremost among those right now should be that the government cannot conduct any secret broad scale surveillance. Second we should expand any non-discrimination provisions that we have to explicitly include known medical conditions. There is a lot more and it will provide great subject matter for many posts to come.
In the future we can’t have privacy for the same reason that the record labels and Hollywood can’t have DRM and that’s ultimately a good thing. DRM has proven a fool’s errand because it is not compatible with general purpose computing. At some point a song or movie has to be decrypted in order to be played back and short of tamper proof and “trusted” hardware at that moment it can be digitally copied (and even if we had all of that it could be re-recorded or re-filmed during playback). That is by now reasonably well understood even by Hollywood and the music industry.
Yet we seem to be making the same mistake when it comes to our personal information. Too many of us, including well meaning “privacy advocates” and governments (especially in the EU), want our personal data to sit encrypted somewhere and want to control who can access it when and keep some unforgeable record of how the data was accessed and changed over time. That is as big a fool’s errand as DRM.
Unfortunately even Larry Lessig, whom I greatly respect, seems to believe in this possibility. In a recent piece he writes:
But trust and verify, with high-quality encryption, could. And there are companies, such as Palantir, developing technologies that could give us, and more importantly, reviewing courts, a very high level of confidence that data collected or surveilled was not collected or used in an improper way. Think of it as a massive audit log, recording how and who used what data for what purpose. We could code the Net in a string of obvious ways to give us even better privacy, while also enabling better security.
This is, I am sorry to say, a fantasy. There are simply too many subsystems and intermediate components involved many of which have the data in the clear out of necessity (including keyboards and screens). Most keyboard and screens are already quite sophisticated. Adding a bit of circuitry to send the information elsewhere over a wireless connection would be easy.
Also, all of encryption relies on keys. And those keys too have to be stored somewhere — in places that cannot ultimately be trusted because you don’t know what’s in the silicone they are running on. Are you really going to store your private keys on a USB stick you keep around your neck? Way too much risk of losing everything and even that key could be designed to leak your keys. Of course most people keep their keys online, encrypted and protected with a password, that wait — you type on a keyboard — that runs on, well you really have no idea what. There is always a hole at the end that you *cannot* close. This is the nature of information and computing.
It is only a question of time before some highly encrypted database of millions of medical records gets leaked or stolen along with its keys to show just how big a charade this all is. We incur all this cost and in the end it will turn out to be for naught. The music and movie industries have been learning this lesson the hard way for decades now and yet as society at large we seem doomed to repeat it.
There is only one way forward. Start constructing a society where it doesn’t matter that your personal medical record was just put online (by you or someone else). Or that your song was copied by a million people. That is the real challenge for this and many generations to come.
On Twitter this morning I received a link to a Guardian piece titled “In the digital economy, we’ll soon all be working for free – and I refuse” by Suzanne Moore. What caught my attention was not so much the piece itself, which has many arguments that I have been making on Continuations for some time about technology being the driving force behind income inequality and the disappearance of work. Instead I was intrigued by the “I refuse” part. There is, unfortunately, not much elaboration on this other than a link to a Facebook post (irony?) exhorting creatives to “stop working for free.”
This is of course wishful thinking. Most people do not have the ability to stop working because they are in need of an income. We are facing a problem of dramatic oversupply of labor that we will ultimately only be able to address with redistribution of wealth most likely in the form of some kind of guaranteed base income and/or negative income tax rates at low income levels. That is not an individual choice but rather something we have to do as a society.
The topic has been on my mind because when I just went to Germany, Der Spiegel had a big feature on the impact of the further legalization of prostitution in Germany. Instead of the intended improvement in the safety of prostitutes the primary result has been a dramatic increase in supply (partially through human trafficking) and an attendant erosion in prices (and safety). Why is this important? Because the combination of technology and a huge imbalance in the labor market acts to drive down incomes very broadly.
For instance, much as I am a fan of the idea of letting people share rides in their cars (because moving only 1 person with a vehicle designed for 4 is incredibly inefficient for the environment) we have to also be cognizant that this has the potential to destroy driving a taxi as a job that someone can earn a living with. That is not to say let’s ban ridesharing. Just like I personally don’t believe in banning prostitution. But naive deregulation of labor markets at a time of huge income inequality can have dramatic negative consequences and we cannot be naive here.
So let me repeat my earlier contention. If we want the benefits of the Internet (which I for one very much do), we need to work on the social systems that will make that new society sustainable. I will write a lot more about what I believe those are.
A court in Germany just ruled that Google must remove autocomplete suggestions is they are defamatory. Now at first blush this seems quite silly and Google has taken the position that they are simply reflecting what people are searching for. I don’t think it is quite that simple though.
This is clearly an example of where information cascades are possible and problematic. I have written about the issue of information cascades before, but this makes another great example. Imagine someone starting a rumor that you had previously worked as an escort (as happened with former German first lady Bettina Wolf). Now lots of people start searching for “Bettina Wolf escort” and soon enough the autocomplete for “Bettina Wolf” becomes “escort” thus cementing the initial rumor.
Information cascades like this are a problem not just because they might come about accidentally but also because they can be exploited explicitly for instance to smear a candidate for office (I am sure one could even use a bot net to get one of these going). A court ordered one-off removal system is unlikely to be the answer. Google and others (eg Twitter, Reddit) who are potential amplifiers of cascades, however, should be putting some of their brightest minds to work on how to detect these and potentially slow them down or remove them altogether instead of just claiming there is not a problem here.
On Tuesday, the US Supreme Court rejected the ACLU’s challenge to warrantless wiretapping. That leaves the EFF’s lawsuit as the last one still standing. The argument made by the majority of justices for dismissing the ACLU challenge was that the defendant had no standing because there was no provable harm. There are many things that are disconcerting about this argument. For starters, it is entirely unclear how someone would know that specific harm has occurred to them and is the result of warrantless surveillance. But more importantly, there is a clear and present social harm that comes from this: a continued erosion of trust between citizens and the government that is leading us further down the path towards a spy-vs-spy society. We have to hold government accountable and insist on due process and maximum transparency if we don’t want to use the Internet to bring us into a more open society rather than a crypto dystopia. If you care about this as well, now is a good time to support the EFF.
We are at a perilous fork in history where many of the choices that we are making now and in the coming years will determine whether we are headed towards an information-based utopia or dystopia. It is not any single choice that matters but rather their cumulative effect and how these choices interact with each other.
Here is how I see the two possible extreme future states of the world:
Utopia. Transparent information sharing. Global collaboration. Renaissance of arts. Reputation more important than money. Sharing of resources. Democratic networks replacing autocratic hierarchies.
Dystopia. Widespread use of encryption. Pervasive secrecy and distrust. Splintered and isolated sub-networks. Information and intellectual property used for control and power. Dictatorships and rule by special interests.
Now you may say that these are caricatures of the future and I would agree that they are extreme depictions. But what I am getting at is that there are strong complementarities between different aspects of an information-based society. For instance, you cannot have widespread use of encryption and simultaneously broad sharing of resources. Why? Because the latter is based on an open flow of information where new systems can easily be built on top of existing ones.
Lots of little choices will matter here not just by politicians but by all of us. As endusers, do we buy general purpose computers or locked down devices? As content producers, do we insist on hardline copyright enforcement or do we work on facilitating legal purchases? As developers, do we work on encrypted and isolated networks or on platforms for transparent collaboration? As investors, do we care only about financial returns or also about growing communities?
Each of us will be presented with many of these seemingly small choices. What we each decide to do will determine the future we all live in. The more we embrace the utopian vision the better our chances of actually getting there!
The debt showdown in Washington is supremely frustrating as it illustrates the complete inability of our current political system to deal with the structural changes that we are facing. At present course and speed things will get a lot worse before we can hope for them to get better. Trying to fix the budget without fixing the underlying problems in the economy and society is the proverbial attempt to prevent the sinking of the Titanic by rearranging the deck chairs.
Here are several areas in which we need profound changes to get back on track:
- We need to stop fighting multiple wars and cut military spending. Instead of weapons systems we need to invest in domestic mass/public transit infrastructure. Instead of fighting a war on drugs and incarcerating a large portion of the population we need to legalize and invest in treatment.
- We have to come to grips with living longer. That means raising pension ages and switching to defined contribution plans for everyone including government employees at all levels. Because people will not be able to rely on pensions we need to fix health insurance (see next point) and provide a last resort social security system.
- At the same time we have to re-learn to accept death (at least for now). Health care spending can only be reined in if we don’t waste ridiculous amounts of money on end-of-life care. Hospice care dramatically cheaper and vastly more dignified. As an aside, I personally believe that we will eventually conquer death, but that time has not yet come.
- We need to stop kidding ourselves about jobs. We will never again have the levels of employment of the past in an industrial setting. Automation and a global job market make that impossible. Instead of high stakes testing and pushing students towards increasingly meaningless college degrees we need to focus on acquiring real skills as are required for making, crafting, small scale farming and yes engineering.
Sadly, none of our politicians on either side speak with clarity of understanding or purpose on these pressing issues. I don’t know whether it is because they don’t actually understand or because they believe that the public doesn’t want to hear things that will hurt. And a lot of this is going to hurt like hell as we fix it. But if we don’t fix it we will be hurting slowly and for a very long time instead.