process everywhere

Below we find another video, this time from IBM, that paints a vision of the data enriched world in our not too distant future.  Most of the things we use and interact with as we go through our day will all be connected and talk to each other on the same network.  The items will work together to make our lives more simple and efficient.  For instance, our alarm clock may check our calendar for the day’s first meeting time and location.  It will then work backwards using public transport networks (traffic patterns and ferry schedules) to calculate when we should be woken up.

The video is very nicely done, but it does raise some questions about the effects that this kind of artificial intelligence or automated decision making will play in this new world.  Are we really building the smarter planet that IBM intends?

The video talks about the DIKW triangle.  At the bottom level is Data–expanding and hard to make sense of.  As you go up the triangle Information gets extracted from the data.  The information is then used to create Knowledge.  Finally, the acquisition of enough knowledge leads to Wisdom.  My concern is that as we make the systems around us smarter and allow them to obtain the ability to make decisions for our life or perform certain actions, are we doing it at the expense of our own abilities to navigate through life?

I guess this is by no means a new conflict.  After all, I haven’t remembered a phone number of a friend or contact since my 7th grade girlfriend.

The Economist recently published an excellent article painting a picture of the the emerging data explosion and of the challenges and opportunities that this explosion will present.  Apparently some are even calling it an “industrial revolution of data”!  The article explains the role that I aim to play in the revolution with the following paragraph:

Chief information officers (CIOs) have become somewhat more prominent in the executive suite, and a new kind of professional has emerged, the data scientist, who combines the skills of software programmer, statistician and storyteller/artist to extract the nuggets of gold hidden under mountains of data. Hal Varian, Google’s chief economist, predicts that the job of statistician will become the “sexiest” around. Data, he explains, are widely available; what is scarce is the ability to extract wisdom from them.

Data, Data Everywhere, The Economist

You can’t fault Mr. Varian for adding some wishful thinking to his prediction.  I can say with 95% confidence that statisticians will not suddenly become sexy anytime soon.  Other than that, his assertions are true.