You may have heard: big data is big. Target uses it to push baby gear onto expectant moms. For Facebook and Google, it's the coin of the realm. And a wide-range of companies--from Ancestry.com to United HealthCare-- are looking to expand their ability to make profitable connections within massive data streams. The only problem is, there aren't enough trained big data analysts to do all this work.
In December, InformationWeek ran a short article sizing up the current state of the big data labor market. The trend is clear: Lots of companies want to hire big data analysts, but there aren't nearly enough to go around. This leaves companies in the zero-sum situation of poaching each other's talent, or hiring outside contractors, retraining their own staff, or waiting for universities to mint more big data analysts.
On this last front, HR managers shouldn't hold their breath. The InformationWeek article quotes Jim Spohrer, IBM's director of global university programs, who says that typically it takes 10 years for degree-granting programs to catch up to changing technologies. By this reckoning, a big data degree is going to be a hot commodity at least through the end of this decade.
So, what does it take to participate in the gold rush? A masters degree in analytics will do. The article cites the program at North Carolina State University, which began in 2007, as one of the best in the country and you can see an outline of the curriculum here. It's vocationally focused, statistics intensive, and includes instruction in programming, text mining, and fraud detection. The InformationWeek article ads that a business background is useful for knowing how to apply your big data toolkit.
Although the U.S. economy is technically recovering, most of the labor market news is still dour. In that light, it's exciting to read about a non-service-based, non-freelance, intellectually interesting field that's actually growing.
Image: Visualization of big data from Wikimedia Commons.
The author is solely responsible for the content.
Leon Neyfakh is the staff writer for Ideas. Amanda Katz is the deputy Ideas editor. Stephen Heuser is the Ideas editor.
Guest blogger Simon Waxman is Managing Editor of Boston Review and has written for WBUR, Alternet, McSweeney's, Jacobin, and others.
Guest blogger Elizabeth Manus is a writer living in New York City. She has been a book review editor at the Boston Phoenix, and a columnist for The New York Observer and Metro.
Guest blogger Sarah Laskow is a freelance writer and editor in New York City. She edits Smithsonian's SmartNews blog and has contributed to Salon, Good, The American Prospect, Bloomberg News, and other publications.
Guest blogger Joshua Glenn is a Boston-based writer, publisher, and freelance semiotician. He was the original Brainiac blogger, and is currently editor of the blog HiLobrow, publisher of a series of Radium Age science fiction novels, and co-author/co-editor of several books, including the story collection "Significant Objects" and the kids' field guide to life "Unbored."
Guest blogger Ruth Graham is a freelance journalist in New Hampshire, and a frequent Ideas contributor. She is a former features editor for the New York Sun, and has written for publications including Slate and the Wall Street Journal.
Joshua Rothman is a graduate student and Teaching Fellow in the Harvard English department, and an Instructor in Public Policy at the Harvard Kennedy School of Government. He teaches novels and political writing.