Getting ready for VMworld with AI deep dive with 14-year employee

Business of the future will need to be more predictive.

That’s what VMware’s Justin Murray, a long-time VMware employee told me here as he explained the latest in AI and Machine Learning that he’s seeing evolve.

The folks who run VMware’s huge conference, VMworld (happens September 29-October 1), got interested in me after reading my latest book, “The Infinite Retina,” which is how augmented reality and artificial intelligence, along with a few other technologies that I call Spatial Computing, will radically change seven industries over the next decade.

You see this predictive nature of AI in things like robots, autonomous cars, and, even, other things like Spotify, which uses AI to build playlists. That predicts what kind of music we would like to listen to. Autonomous cars predict the next action of both people and other cars on the streets. The AI inside is always trying to answer questions like: “will a child walking on the side of the road try to cross the street in front of us?” Properly predicting what is about to happen on the road is important and, I ask Murray, if that same predictive technology is what he’s thinking will be used elsewhere in businesses?

Murray says “yes,” but then goes a lot further, and predicts what some of the hot discussions will be at VMworld next week.

For instance:

1. Every major cloud provider, like Amazon’s Web Services, Microsoft’s Azure, or Google’s Cloud Services, is buying tons of NVidia’s powerful GPUs for their datacenters to support these new, predictive, AI services that businesses are starting to build.

2. The AI architecture and tooling stack that runs on these is seeing sizeable changes, and NVidia and VMware will make some announcements there next week.

3. Powerful new AI supercomputers are now being built because NVidia cards are being “connected together” in a powerful new way to make new workloads possible.

Why do I care, especially since usually I’m interested in new startups or consumer electronics gadgets?

Well, let’s walk through my life. Recently I got a June Oven. You put a piece of toast in it, or a piece of salmon, and it uses a small camera and an NVidia card inside, along with machine learning-based software, to automatically recognize what food I am trying to cook or bake. It’s magic. Plus, I never burn my toast anymore the way we used to because I often didn’t get the settings right.

Or, look at the new DJI Osmo 4 I used to do the intro to this video. On there is three little motors, and the instructions for how to move those motors is generated, in part, by machine learning that is constantly evaluating how best to steady my iPhone.

Finally, look at my Tesla. Murray told me that there’s more than a dozen AI-based systems running on that, and it drove most of the way to VMware’s headquarters in Palo Alto, CA, which makes my drives more relaxing (particularly in traffic where my car does all the stop-and-go duties) and safer.

Already AI has radically changed my life and most people in the industry say AI is just getting going. One reason VMware is compensating me to do this series of posts is because about a decade ago I was the first to see Siri, which was the first AI-based consumer application to come to market. My posts back then kicked off the AI age but a decade later AI has started deeply falling in price and is getting simpler to do, so it’s being used in a lot more new workloads.

You might not realize just who VMware is, but you probably use one of its services everyday, or, rather, the companies you deal with everyday use VMware to run their businesses. When I worked at Rackspace, a major cloud computing provider, for instance, we used VMware all over the place in our datacenters. “VM” stands for “Virtual Machine,” and VMware is the one that popularized that term for technology that can split up a physical computer into tons of “virtual” computers (or join them together with millions of other machines to build a supercomputer). Today that technology is used to do a bunch of things, from letting you manage your laptop better and run it more safely, to managing huge businesses, to soon managing new Spatial Computing infrastructure and devices (I wrote about such in my latest book).

All of this will be discussed at VMworld, which is a huge free virtual event, with more than 100,000 attendees and hundreds of sessions, covers not just what is happening here in AI, but across a range of technologies that businesses use everyday, from security-focused ones, to data-center-management focused ones. If you like this conversation, which is just one out of thousands of VMware employees or customers you will meet at VMworld, register for your free attendee badge here.

I don’t even need an AI to predict that you’ll find at least a few of the sessions out of the 900 offered useful for your business, see you on the 29th!

Tech’s new “Digital Gods:” humans will soon be deeply integrated with tech

I used to joke with friends that Silicon Valley was done disrupting taxi companies and that we were going after God next. On my summer mostly away from social media I’m taking a fresh look at predictions I’ve made for the last two decades in four separate books. This is just a taste of what I’m seeing businesses do.

Now that joke isn’t so funny anymore and it has deep implications on how we view privacy, new products soon to come, and, even how we should regulate big tech companies that soon will have deep access to, and control over literally everything about human life. That life is about to become very integrated with technology.

The 2020 Technology Menu

First, let’s look at some of the technologies that are cooking right now that will radically change nearly every part of human life. This is why Irena Cronin and I said seven industries are about to be radically changed in our latest book “The Infinite Retina.” Have you read it yet? Why not? Qualcomm’s head of AR/VR says not just that it’s a great book (so do dozens of other reviewers on Amazon) but that it’s a “must read” to understand the 2030s and what is about to come next.

Robots and autonomous cars that are not just mapping out every crack in every street, but learning from our behavior there too. All while radically decreasing many transportation costs (wholesale cost of an hour-long taxi ride will go from about $20 down to $5. Same style reductions are coming for product and food shipments).

3D sensors that will soon categorize every object, place, and activity in human life. The ones that are in phones today that in 2020 can see 300,000 points of data, will, by 2030, see 10x that many (and I might be way too conservative in that prediction, some insiders tell me. No matter, as millions of people start using these sensors the databases will have increasingly more and more resolution about everything to work with).

AI that is getting cheaper to train — dramatically so — and far more capable every few months. Particularly important in computer vision.

Glasses that will listen to every breath we take, and watch our health. Oh, and look deeply into our eyes and watch how we perceive every part of our life.

Wireless systems that — in perfect conditions — bring more bandwidth than we can conceive of, or use in today’s homes and businesses.

Databases that will be larger, faster, cheaper per entry, and much smarter than ever before.

Voice technology that will get close to convincing most people they are talking to another human being, not a computer.

Cameras are continuing to fall in cost, while increasing in quality. Soon due to computer vision they will also recognize thousands of objects and dozens of behaviors. Imagine a 16 megapixel camera that knows every object in your home that costs only a buck or two? This is why phones are getting more and more cameras.

More and more products will have exponential learning engines built in. June Ovens, iPhones, and Tesla cars have them in 2020. By 2030 hundreds, if not thousands, or products will have them. Consumers will expect all their products to get better after purchase, like a Tesla car or a June Oven does today.

To underscore some of these changes, look at Apple’s patent disclosure of a head-mounted display that includes eye sensors, heart-rate sensors, etc.

As you read this patent you might see that it will soon not just augment literally every product and surface in your life, but will collect contextual data about you which it will further use to assist your life.

A God of 1,000 Conveniences

I used to be highly religious, praying to God every morning. While that old, analog God is still there, so your faith doesn’t need to be disturbed, human beings are clearly creating new digital dieties. Early versions are named Apple Siri, Google Assistant, Amazon Alexa, Facebook Portal.

These new digital “Gods” have these attributes:

  1. They always are on, always listening for your command.
  2. They always respond, something my analog God rarely did. Heh.
  3. They are increasingly knowledgeable, learning from human behaviors.
  4. They increasingly understand us and are getting more capable at holding a conversation with us.
  5. They increasingly are being built into our lives, now showing up in tons of products from watches to cars to TVs to doorbells to ovens.
  6. While pretty stupid today, they don’t understand when you ask even a simple question about items or behaviors. Ask it “how many calories are in that” while motioning toward a plate of food and none can answer you today because they simply don’t know what you mean by “that.” By 2030 these Gods will know a lot about literally everything in your life and will know what you are looking at, so can answer this kind of question.
  7. While these Gods aren’t good at assisting you with products or problems today, that soon won’t be true.
  8. While these Gods don’t really know your health status today, soon that won’t be true. The Apple patent above lays out how future devices will watch a number of our bodies’ biological functions, by looking inside our eyes, inside our ears, listening to our heart and other biological processes, body temperature, behaviors, and evaluating our breathing patterns too (remember cops can tell if you are inebriated simply by looking inside your eyes). Some experts predict that such devices might even be able to predict someone has COVID before the sufferer even feels a fever coming on.
  9. Elon Musk has been warning people that AI will soon be hyper smart, far faster and smarter than any single human being. What he is warning us about is the development of these new “Gods” that will not just watch one person’s behavior, but potentially billions of people’s connected behaviors. In a previous book about social media I told you that companies like LinkedIn know companies are laying people off before they even report that because their behavior on social media changes. Now these Gods will go deeply into every part of human life, seeing patterns that humans simply can’t. Imagine being a God that could watch everyone’s fear levels while looking at a stock website, for instance, and you get a taste of just how much power such a God would have (it could sell stocks before hundreds of millions of people even click on the sell button).
  10. These Gods will know about your context. Are you in a kitchen cooking a meal? At a street corner about to cross? In a grocery store picking out strawberries? In a classroom trying to absorb new information? In a church trying to improve your mind and your relationships with others? They will switch what they do for you as your context switches. Where Microsoft Windows presents the same user interface no matter where you are or what you are doing, these new Gods will present quite different user interfaces and information to you at these different times.

So, why do I call these the “Gods of 1,000 conveniences?” Because that is exactly what this new kind of ambient and augmented computing will do for you. Some things I expect soon from future glasses?

  1. See in the dark. God will help you see EVERYTHING better. Including the bicyclist that is coming up fast at night and might not see you. It will predict how likely it is that he will hit you, and will tell you the best path to avoid an accident. The LIDAR on your face can see him even in total darkness.
  2. Find objects like keys. The God in the sky will know every item in your house. I recently needed to buy Olive Oil but I didn’t know my wife’s favorite kind. Hey God, what kind of Olive Oil do I have at home?
  3. Behavior modification (stop smoking, eat fewer donuts, drink less alcohol, et al) by making it more convenient to do less of some things and more of others.
  4. Media everywhere (you can “grab” a video of a baseball game off of a screen at a friend’s house, take it with you while you walk to your car. “Place” it on the dash. Then “grab” it again when you walk in and “place” it on your own TV in your living room). Not to mention, the God in the sky could let you know your favorite team is about to play, or, that another team just had a spectacular play that you should see.
  5. Reading assistance. Ever been reading something on a physical book and you got interested in the topic so you started doing Google searches or looking up words in a dictionary? I still remember my mom yelling at me to “look it up” when asking her about a new word I’d come across. Imagine you saw a new term, like “Spatial Computing,” and an interface to tons of new information would pop off of that word in your glasses. “Hey Google, what is Spatial Computing?”
  6. Reading assistance #2. Ever start reading a book while it is light out, and get so into the topic that you read until it was dark? Imagine if your glasses just let you keep reading. Or, made small text bigger? Or, let you switch from reading a physical book to having an author read it to you? The God in the sky will always be there, watching how tired your eyes are getting and the lighting condition. It could change every font on every page to be more readable.
  7. Work assistance. Ever try to do something and wished you could phone a friend who knows how to do that better? Soon that friend might be an AI teaching you a bunch of things visually in glasses. The God in the sky could be there whether you are trying to do a new kind of weld on a metal piece or design a new kind of building in Autodesk’s software.
  8. Driving assistance. One team told me they could make night into day, or lines on road much clearer, or a variety of other tasks. I answer “my Tesla already drives so I don’t care” and then they switched to “yeah, but we could make it so that you could see out your window and see what daytime looked like, if you wanted.” Yeah, I’ve wanted that from time to time. Look at Apple’s maps. It has great photos of my street and probably yours. The God in the sky could go a lot further and warn you about a bucket in lane number one ahead.
  9. Shopping assistance. Ever wished that a God in the sky could tell you whenever you look at a product whether it is available cheaper on Amazon? Or, whether it has the best reviews? “Hey God, which coffee maker here is best?”
  10. Learning assistance. When I was learning chemistry or calculus, or helping my kids learn Spanish, repetition helps new information stick in your brain. God in the sky could continually play games with you “what is the mass of 2 moles of H2so4?” Google knows already.
  11. Health assistance. I’m riding my mountain bike. It knows a big hill is up ahead on my favorite trail. It could push me to do it faster so that my heart rate will increase to 150 heart beats per minute. When I am pulling into Dunkin Donuts it could say “this will cost you 15 health points.” When I put on my glasses it could note that I have a fever and warns me not to go around other people today since it appears I have the flu (it can tell the difference between that and COVID based on looking at other factors). The God in the sky could even suggest contacting my boss and say “your employee has a fever today so will not be available for meetings or working in your retail store.”
  12. Mental assistance. “Here’s a funny cat photo,” my God might tell me, after it noticed that I’ve been particularly depressed based on my voice and behavior data. The God then could suggest a walk, or phoning a friend. Our Apple Watch already asks us to do breathing exercises, walks, and other things to keep our health good.
  13. Automatic shopping lists. “You are almost out of milk, we’ll add that to your shopping list,” my new digital God will someday tell me.
  14. Stain advice. “We noticed that your shirt has oil on it, and it is recommended that sprinkling baking soda on the fabric and let it sit 24 hours. I can navigate you to your box of baking soda.”
  15. Cooking advice. “Hey God, what could I make for dinner tonight?” Remember, it will know every object in your house, including every spice or pasta or soup can. So, it will know what you could possibly make given the ingredients you have on hand. You could always tell your digital God “I’d rather make lasagna, can you arrange that?” God could answer “yes, your necessary ingredients will arrive in 49 minutes and it will take another two hours to make, so your dinner will be done at 7:30 p.m.”
  16. Navigation in stores. “Follow this pattern to get out of the grocery store with your items faster.” Remember, the digital God in the sky already knows where every item is in the store, and which items are on your shopping list, and can plot the fastest path through the store.
  17. New kinds of things for friends to do. Our digital Gods could notice that four of my friends are bored and available for something fun. It might ask us “hey, Andy, Cassie, and John are available for a blackjack game. You want to join or suggest something else?”
  18. When friends are together it could recommend things: “did you know that it’s Cassie’s birthday next Sunday?” or “your friends look bored, why don’t you suggest watching Top Gun? or one of these other shows?”

Notice I haven’t mentioned VR or AR yet, although a lot of these will use pieces of AR or VR, or the technology that runs such.

What impact will this have on business? Can businesses start planning for this world today? Yes. Already the world’s top consumer products companies are looking to build brands that get better after you buy them, just like a Tesla does today.

They also are doing models of how trends will change due to these new technologies. If you are getting navigated through grocery stores, for instance, where they put the milk and cookies may dramatically change. One such company told me they are already planning on autonomous vehicles changing where and how you buy their products.

Robots will decrease the time and cost of deliveries, making new kinds of experiences possible. New businesses, like car washes and fast food that are designed to cater only to robots and autonomous vehicles, will pop up.

For those who have Amazon Alexa or other voice-first devices in your home (I have several) already note that they already are making homework, shopping, chores, learning, staying up to date, and getting entertainment much easier. These conveniences will continue increasing in both quantity and quality, which will lead to new expectations in consumers.

Remember the time you saw a kid try to touch a TV like an iPhone? Those kids are now in their 20s. Imagine what happens when today’s 10-year-old who is used to having Amazon Alexa, Google, Siri, and Facebook Portal at beck and call joins the workforce in a decade. They will expect everything to be augmented, and computing to be ambient and spatial.

Digital Gods are about to become very powerful forces in human life. For more about how, read our latest book.

Our latest tech book gets five-star Amazon ranking

“The Infinite Retina,” is my fourth book that predicts decade-long trends. This one, written with Irena Cronin, represents a decade of work and is getting the best Amazon reviews of all of them. Qualcomm’s head of AR/VR, Hugo Swart, wrote “it is a must read.”

It is about how seven industries are already seeing radical changes due to Spatial Computing with much more on the way. Buy it on Amazon here.