AGC: Keynote - Vernor Vinge On The 'Inside Out' Cyberworld

Award-winning science fiction author Vernor Vinge, speaking at the Austin Game Conference, gave his vision of a future in which connectivity was literally in the air around us. Most recently author of Rainbow's End, Vinge painted a picture of ubiquitous connectivity similar to the one narrated in that novel. So well connected will we be, according to Vinge, that "post-human" capabilities will arise from groups of people networked together. "Virtually every aspect of purpose, faith and fantasy could have a constituency in such a world," Vinge said. Below, a transcript of his remarks: "It's great to be able to talk to people who are actually doing things and making all of this stuff happen. What I want to talk about today is a scenario that largely seems very likely and has a certain planning utility in addition to making good stories. I want to talk about the hardware that [may bring about] ubiquitous computing. Now, ubiquitous computing is sort of a slippery term. As with treason, it's mainly a matter of dates. In thinking about this, I have several steps or types of technology that lead into it. First of all, starting with the 1980s, we have embedded systems, things like microcontrollers in our typewriters. It's a great economic win, because it allows us to substitute software for moving parts in engineering, and so embedded microprocessors at this point are pretty ubiquitous, to the point that it can be kind of scary. Now we're entering an era of networked embedded systems, of devices able to talk to each other and to us. Toward Ubiquitous Computing? This is a path that we are accelerating down because again it has a great economic win. The stuff that's coming up on the near horizon with this is RFIDs -- not just RFIDs, but smart RFIDs -- which will not only have embedded microprocessors in large discrete devices, but in more or less throwaway devices, and also in standalone situations. That gets us into what I think most of us have heard about, like smart dust and MEMS [Micro-Electro-Mechanical Systems]. You can imagine such ubiquity being then hooked up with sensors and effectors. An added feature to make this really turn into the sort of effectiveness it could be is the notion of localizers. In its simplest conceptual form, these are simply a feature that is on networked embedded processors, whereby the processor knows where it is in 3D space. In principle, that actually is very easy. You don't even need GPS: if you have lots of them, thousands in this room scattered around as an ad hoc network, they can figure out their relative position to the other nodes. And in fact they can know where things are outside of this room if the world as a whole is hooked up this way. Think about what that would mean. It actually eliminates whole industries. It eliminates hundreds of different locational technologies. Almost all the moving parts machinery we have and coordination of moving parts machinery involves either having humans know how to position the parts or a wide variety of technologies working together. Hook that up with the issue of communications, and we actually have very interesting solutions for getting results out to end points. If you know exactly where things are, not only can you make use of the ultra-wideband that we already are moving into, but you could even imagine using very good localizer technology to set up extremely high bit-rate lengths that were highly directional. 'Localizers' As Revolutionaries? What this means is that considering that the overall backbone of communication is still there, we're still making use of very, very large pipes to send information long distances. Localizers allow you on case by case basis to extend the capacity of those pipes down to the finest end point that you could want, and to do it in an ad hoc and real time way. A problem that really hasn't shown up very much in our era, but ultimately could be really interesting, is the problem of node guano. If you have lot of ad hoc nodes, in a situation where nodes don't last forever, ultimately we could be hip deep in dead nodes. In this environment, wearable computers are to the embedded networks what the PCs have been to our Internet. This is something that you could imagine working out very smoothly, almost seamlessly, and that's already accepted by consumers. I am convinced that the day we really get high resolution heads up displays, most people who nowadays are carrying a bluetooth earphone and microphone would have no problem with wearing eyeglasses that gave them a heads up display of something like 4,000 by 4,000 if the infrastructure had moved along in concert. Then high resolution HUDs could be exploited. That's an example of a highly disruptive technology. It essentially destroys all other display technology except as emergency backups. If you were able to get localization that was really good, you could imagine setting this up so that if your wearable knew where you were looking, what the orientation of your head was, and where your eyeballs were tracking, then in addition to being able to produce the world's best display, as good as the worlds' best desktop display, you could actually overlay things in the environment. Augmented Reality Uses The term for that in academic circles is augmented reality. In that situation, having the processing power that's involved with the network infrastructure I just described becomes very very useful, because you could, in an ad hoc way, overlay those portions of reality that you wanted to. In an auditorium like this you could make the walls look like whatever you wanted, you could make the speaker look like a clown, and since everything was networked, you and your friends could get together and agree on what things looked like. The notion of consensual imaging becomes very very important, and again this is actually a very disruptive technology, if it were finally to happen. It blows away all discussion of large three-dimensional display technologies. I want to talk about something that ultimately for the first time really does go a long way to kill off theaters as separate architectural structures. Real World, Cyberspace Leakage If you take together all of the things I have been pushing here, there really is a situation where cyberspace has leaked into the real world, in fact the title of the talk was Inside Out, which was intended to convey the notion of what was inside the box in all eras up to ours, in this sort of era is outside. In other words, reality can be whatever the software people choose to make it, and the people operating in the outside real world choose it to be. So both cinema and games become something that are totally immersive at all times and at all places where the user wishes them to be. It might be even if the user does not wish it to be, if his wearable gets hijacked and he persists in using his wearable, he may be subjected to things that aren't there. Wearables are the interface to it, but the situation with the network as a whole is very interesting. It hasn't gotten rid of big pipes or server farms, however we would be in a situation where reality has become its own database, in the sense that millions of objects in the outside world would know what they are, know where they are, know where their nearest neighbors are, and could talk to their nearest neighbors and, by extension, to anything in the world. So, in a sense, the real world has awakened at that point, not in the sense of humanly intelligent, but in the sense we talk about smart phones and devices -- sort of ubiquitous and ubiquitously networked. This produces the possibility of a form of insight into dealing with the real world once cyberspace has leaked out, once you have this inside out thing. In the 20th century, people used all sorts of analogies from the real world to describe what they were doing inside operating systems. In this century, almost anything you can think of doing inside an operating system have serious implications in the real world. Game-Related Consequences? Going on from that though, let's look at some of the social and game consequences. First of all, I've been very impressed here the last few days, at AGC, both in panels and in product demos, in trying to compare this with how science fiction writers have predicted these things. One thing that really impacted me as an SF writer thinking about these things is I had this sort of linear view, and what I could just see wandering around the technology pavilion was the horizontal spread of all these different niches -- an ecology of development, all the stuff about middleware and the different dimensions of the operation, and all the different sorts of online games that there are. When a person takes all of that and tries to imagine what it would be in this sort of environment -- you guys are the expert at that -- that is a very rich group of things to think about. On the other hand, I went through four or five different sorts of things, some of them are already proceeding forward like gangbusters, some are much harder to do. If a person works out different scenarios for each of them, then you're kind of in a position where as time goes forward and you look at what actually is going to materialize, you have a vision of what things are going to be like one or two steps out. There's a mad rush into embedded processors going forward very rapidly. The localization I'm talking about is much harder. Really good 4k by 4k HUDs, I'm actually somewhat surprised haven't happened already. When those come along, there's suddenly a whole other set of things you can do. Then, if and when we have the ability to actually hang the image that's on the HUD, hang it in such a way that you can skew it as you move your head, that's a whole other dimension of application. At each of these levels, all the analysis of impact, there's a separate analysis that could be done there in terms of what might work and not work. What I want to do here though is just go on and suppose we're at this extreme point where I got to a few minutes ago, and look at just in that situation what would be the consequences for game type situations. On Alternate Realities One question is how many alternate realities could simultaneously exist. If you work out the arithmetic and believe the hardware infrastructure scenario I painted, you're getting 10 to 100 gigabits per second to each person. That means that basically the number of possible alternate realities would be at least as high as the number of people, and could be higher depending on what kind of multitasking people were doing. The amount of storage necessary to hold all those realities, it's quite reasonable it would be large enough to handle that. That means that virtually every aspect of purpose, faith and fantasy could have a constituency in such a world, and that really raises a lot of possibilities for products, and the products actually go beyond games. It's not so much a question of the place of games in the future world, but a question of whether there's anything going on besides games. It depends what you mean by game. There are going to be very serious things going on in this world, but the technology behind them might not be distinguishable from games, or only in that with a game you can often turn a bug into not only a feature but a selling point. On the other hand, if you are writing software to land aircraft, mother nature does not accept bugs that are selling points. For instance, job-related alternate realities. I'm ignoring the fact that some jobs might just go away. But if you're involved with catering or managing a hotel, the utility view would be the augmented realities that show you that part of what's going on in the real world that is related to your job. If you're doing repairs on the building it would be views of those parts of the building that have to do with the water system or electricity or whatever you're dealing with. Then there are microduration labor markets, a casual game that could be the end of occupations. To the extent that you have any spare time at all, if you're in an environment like the one I'm describing here and you're a flexible person with some expertise in something, that means you can actually make money on any job you can undertake and complete in 30 seconds. To the extent you're ever held up in line, any loose spot in your schedule, you are there making money. Another category are joint entities, two people who work together perhaps because one is handicapped and the other is mobile. One might know downtown Austin very well, while the other is from San Diego, so when they're walking around out of doors, they're operating as a joint entity. Pyramids Of Gaming, Working At higher levels of organization, whether you consider this to be games or coordinative enterprises, one could imagine things a little like businesses, or affiliations where in a relatively ad hoc way, like a movie producer, but over 10 hours or 100 hours put together a pyramid of people with expertise in certain things. Belief circles are something that fits very well with a lot of recreational-use computers now. It could be buyers of Terry Pratchett novels, and basically that's the world they want to live in, they've worked out consensual realities, like the Society for Creative Anachronism. The whole world would be the Terry Pratchett sort of world. Actually, a more extreme thing that many of us would be quite uneasy about, but it's one thing I'm intrigued by is the notion of lifestyle cults. It's something akin to a total information awareness system, the idea of somebody snooping on you all the time at a micro level is for most of us very offensive. It certainly frightens me, but you can imagine a voluntary total information awareness consortium as a commercial sort of thing. It might amount to getting together several components, one would be a world class logistical supply chain manager, like Costco, managing enormous product streams and working very hard to get prices down as low as possible. Another component of a total information awareness consortium could be something like a social networking business in our time, which handles actually dealing with and talking to the individual customers through their wearables. Put that together with the levels of surveillance I'm describing, which makes total information awareness as imagined by the US government look trivial, with this sort of thing we can watch things down to lowest possible level. But if you took those three things and also had several million subscribers, then you're in a very interesting situation. For them, good things just tend to happen. Whatever you're doing or thinking about doing, you get the best prices on the sorts of things you're interested in, and if you decide you're not getting the best prices, you get out of this lifestyle cult or go over to some different one. MMOs To... Cults? You could extend this to the point where members of the cults actually are coordinating among themselves to bring good results to each other. I find this whole idea sort of unsettling and scary, but it is an example of the empowerment that can occur to groups below the national level, and really grows out of MMO stuff. The belief circles and the lifestyle cults are examples of something that has some similarities to what's going on now in MMOs but blown up to a level and intensity that might be objectionable to some people. One of biggest problem with this sort of situation is generating content. Nowadays one thing you hear a fair amount about is getting customers to generate content, which has attained almost faddish levels. In an audience like this that's probably not that popular of an idea. On the other hand, when you look at the amount of content that would be necessary to support this, which is essentially all of reality, and you look at the fact that already the largest generators of content are people with home cameras, there is probably something that's going to be going on with that sort of stuff. It seems to me that we are entering an era various companies have figured out, in which there are ways of spending enormous amounts of money on certain hardware platforms, software, social interactions, and coaxing the creative beast to come out of hiding and do things for you. One thing I've been peddling for a long time is the notion of the technological singularity. The idea is not a certainty but in my opinion is a plausibility in the working lifetimes of most people here, that there will be perhaps something superhuman come along. We will either create or become something superhuman, in various ways. The particular scenario I've been running through today here does look a little like one possibility. That is, in talking about these large numbers of creative people working together, we see an emergent ensemble critter or critters that are separately behaving in superhumanly creative ways. It's very cool to me to see that it really could be the way it happens, and if you are in the business of art and art forms, it's especially interesting and exciting. To me the most recent analogy to the technological singularity is the rise of the human race within the animal kingdom. Think back to that time, what would it be like to be the first human to ever tell a joke, or the first storyteller. Anything you did would be new -- and the fact that it was crap wouldn't matter. What we see going on now could be very like that situation. It would be a very glorious thing to be an early post-human artist, which none of us are, but it may just be that we are setting things up for that. [Mark Wallace is the editor of 3pointD.com, a widely read blog covering virtual worlds. His freelance journalism on technology and culture has appeared in Wired, The New York Times, PC Gamer (UK) and many other publications.]