Do we need a new tech literacy? (Behind the “big data” services like Twitter, Facebook use)

The technology that lies underneath the services we use every day is complex and changing quickly. Technologies like Hadoop, MapReduce, are changing how developers and architects build these services. As I was talking with Mike Olson, CEO of Cloudera (a company that builds technology to help developers deal with these larger-than terabyte databases) I realized that by learning about the technology underneath these services I was better able to understand why these services can’t give me some of the features I want.

Anyway, he talks me through some of the changes in the database world and explains the technology and terms that lay underneath. Good primer for people who want to have a better tech literacy of the terms and technology underneath big data services like Twitter and Facebook.

Do you agree with me that we need a new tech literacy? That we should be teaching this stuff in high school so kids can get at least some understanding of where technology is and where it is going? Tons of startups hiring thousands of people have already started up in San Francisco area using these technologies and they will only get more important and people who understand how to develop on them will only become more in demand. But how many people outside of the development world know what Hadoop is? Not enough.

33 thoughts on “Do we need a new tech literacy? (Behind the “big data” services like Twitter, Facebook use)

  1. This post reminded me of a great piece by Henry Jenkins for the MacArthur Foundation — “Confronting the Challenges of Participatory Culture: Media Education for the 21st Century.” While he isn't talking about literacy in terms of hardcore coding, I think a lot of his points still apply to the importance of tech literacy for upcoming generations.http://digitallearning.macfound.org/site/c.enJL

    Like

  2. WHAT IS SCOBLEIZER I JUST WANT TO LOG INTO FACEBOOK HELPPPPP!!!!In other words, yes, we need to teach tech literacy, but we should probably master the basics before worrying about behind the scenes technology.

    Like

  3. The advantages of Hadoop are not that hard to replicate in a relational database engine. And with Greenplum and Aster Data going SQL + MR, and Hive, CloudBase and Pig going SQL-like on top of Hadoop. At end of day, all will circle back. Nothing 'new' aside from a programming construct, eventually it will all converge.

    Like

  4. I would inject that by the time a Daniel B or Patrick learn what Cassandra, BigTable is and how to drive it… It will be substantially different by the time they're on the other side of their college experiences. Of course, those were two examples of uber-geek teens who will “get it” no matter what. But, you get the point. Teach it in highschool and the tech will have advanced so much in four – eight years the literacy learned “back then” might now apply in the here-and-now. Not a good reason to abandon trying. Tech evolves faster than our teaching institutions and legal infrastructure can keep pace.

    Like

  5. How often would you like to change the cirriculum, Robert? Schools (whether grade or uni) ought to teach the ability to learn these technologies, in lieu of $HOT_TECH_OF_THE_DAY. I went to grade school not so long ago, in a world without Facebook, Twitter, Google, etc. I sat for my A-levels without the aid of wikipedia. So did you, and we both understand enough about HADOOP, etc. to use the services.

    Like

  6. Even if we're not teaching the children, I want to know about this stuff. Also, I'd like to be able to read code like Neo does.

    Like

  7. Most definitely. You know, up until now, geeks have sort of like tech being shrouded in mystery. It's kind of like “revenge of the nerds” and I must say that when I tinker around with code and figure something out, there's a self important pleasure I get out of it, like when I can fix something for someone and such, makes me feel important. But I think, the more transparent you are with people, especially your customers and potential customers, the more they'll respect you. It's like you educate them, and they get value from that. I know that “jargon” has its value in economizing communication, but I don't like when its used to impress or kind of exclude folks from a certain club. But I admit I do it too. We all do. But the move towards transparency, education, I think is more productive and helps the economy and society as a whole. Like Richard Feynman said, “The Pleasure of Figuring things Out.”

    Like

  8. People don't even understand the “Real Time” web yet http://goo.gl/AzyS (be sure to check that amazing document out too) so hadoop and map reduce are far far off the radar for most..Outside the valley most people are jokers when it comes to tech (even in the U.S.), so I agree that we still certainly need to educate the broader audience. So lets not call our hypothetical class: “The Bleeding Edge of Tech 101.” Thanks for the video it was great. What'd i like to know is how many people watched the 30+ minutes of it?

    Like

  9. Count me among those who watched the whole thing; I thought Mike was engaging, passionate articulate; in fact, I'm in the process of downloading the VM that Mike mentioned, and I'm planning to watch through the videos on Cloudera's site!

    Like

  10. Robert – constructing an educational syllabus around, say, Hadoop, and getting it into the school system would take so long that a few years down the line you'll find yourself interviewing another startup and wondering why schools are still teaching Hadoop!Maybe it's time to ditch the current methods of teaching technology in schools (ie, following a syllabus based on out-of-date trends) and instead, have schools engage with IT training partner organisations for that part of the curriculum, in the knowledge that they're able to offer teaching on what's current?

    Like

  11. Might be to a kid's advantage to nurture a healthy curiosity of things. Most of the innovative people I know took stuff apart just because they were curious AND had a very patient friend or relative who encouraged the behavior. From there they'll maintain their own interests – whether that's marine biology, computer science or what have you.

    Like

  12. I absolutely agree. As a consultant I get to see the architectures behind large scale systems and I'm always amazed at the complexity and the cornucopia of HW and SW that exist in one IT department.There is a chasm between these large systems and books on the market that describe these large scale systems. Yes, Fowler does try to address the issues with his books – but we need more.

    Like

  13. Right. Well Hadoop right is an Apache right implementation right of Map reduce right? right.

    Like

  14. >> Why don't they teach this stuff in High School…Exactly right. I failed miserably in Internet marketing. It was not until I took 3 years off to become a programmer and understand how the web worked that I began to use my brain in ways no one else in IM does.Until you understand the nuts and bolts of how things work you can't envision what others are doing and go on to build the better mouse trap.

    Like

  15. Even though this post raises a good point, I don't technology should be necessarily taught in high school. Even though the social media face of the Internet is rapidly growing in volume and importance, let us remember that it's not crucial for all areas of business. It might be important for marketing, consumer trends and others, but not necessarily for other areas of business.Therefore, in my opinion it would be valuable as support lessons in high school maybe, but never as a core discipline to be taught. That would partially reduce kids' choices. Some want to be athletes, some musicians, and we don't need to push technology on them. They should learn it at their free will.Therefore, I defend it could be taught, but as support, never core lessons.

    Like

  16. It's needed. Indeed. At least the very basic literacy that can allow you to protect your privacy (well, what's left of it), how to use online and offline tools… But I don't think it's going to happen anytime soon. For the same reason governments are getting scared of the intertubes and jump into the filter trap. People who make the programs/laws are clueless.Ignorance -> Fear -> Hate.

    Like

  17. The top [url=http://www.ghdhairirons.com/]ghd[/url] are collected here, you will find [url=http://www.ghdhairirons.com/]ghd straighteners[/url] and [url=http://www.ghdhairirons.com/chi-flat-iron-c-7.html]chi flat iron[/url] at our web.

    Like

  18. Fascinating video, or rather the articulation of the technology within. I was completely engrossed.

    Like

  19. I agree that we should be teaching tech literacy early, but who is going to do the teaching? Are our current K-12 teachers equipped to do this, or should technology companies step in and help mentor?

    Like

  20. Hate to do a personal plug but in all honestly, a tech literacy is definitely in order and this SXSWi is going to have more than enough opportunities to push that particular envelope. One in particular [disclosure: I'm helping organize as well] is the Data Cluster Meetup sponsored by Rackspace as well as Infochimps, Factual, and Wolfram Alpha.http://datacluster.infochimps.org/It's March 14th from 6-9pm at Opal Divine's in Austin. If you're at SXSW and want to discuss the state of these larger data functions (big data, open data, non-relational Dbs, data visualization, etc) then come out. We'd love to have you – Scoble, you're definitely invited as well ;)Stu Hood will be leading a group discussion – “non-relational database smackdown” – he's representing for the Cassandra Project.Also, Philip Kromer (Infochimps) and Gil Elbaz (Factual) will be discussing the open data commons. Everyone welcome, but please do RSVP.

    Like

  21. Robert, many entrepreneurs do things nobody else has ever done. As soon as they are “taught” a method then it’s already 5 to 10 years old. Education isn’t “real time” … one reason why startups are often started by dropouts and fiddlers like Steve Jobs, Gates and Zuckerberg

    Like

  22. Robert, many entrepreneurs do things nobody else has ever done. As soon as they are “taught” a method then it’s already 5 to 10 years old. Education isn’t “real time” … one reason why startups are often started by dropouts and fiddlers like Steve Jobs, Gates and Zuckerberg

    Like

  23. I agree! Now-a-days people rarely ask for educational qualifications in INFT field. The field question is: Which software are you comfortable with?

    Like

  24. I agree. This is totally a very important thing nowadays. Since everything is found in the internet and almost every field depends on the internet. Many opportunities are also opening up to people in the internet. I really think that tech literacy is important in this advancing times.

    Like

  25. As lindavandevrede mentioned;”I agree that we should be teaching tech literacy early, —-, or should technology companies step in and help mentor?”Google should see another opportunity, helping our country with the next generation.

    Like

  26. ladies and gentlemen, in order to thanks for our company ( http://www.plzzshop.com/ )new and order costomers,my boss make a determind that you can get a best discount and a free gift if you shall buy something from our company this month. i hope you may buy something early from our company. so stay tuned!!! im looking forward to your early place an order. (http://www.plzzshop.com/ ) Following are some of the famous brands that we can supply: 1. Footwear: all brand name sport shoes, children shoes, EVA clogs, beach slipper, climbing shoes, canvas shoes, Kid shoes, etc. 2. Apparel: all brands Tag T-shirts, shirts, coat, jacket, hoody, Jeans, shorts, Children Clothing, Baby Clothing, underwear, etc. 3. Accessories: All brands Handbags, Wallets, Purse, Sunglasses, Watches, Caps, BIKINI, Hair straightener, etc. We sincerely find serious partners and establish a long-term business relationship. Please email us freely at any time and we are on the service for you, if you are interested in our products, please contact us ! http://www.plzzshop.com/ finally,i wish you happy every day and lucky forever.

    Like

Comments are closed.