IBM Ends Hadoop Distribution, Hortonworks Expands Hybrid Open Source

IBM has followed Intel and EMC/Pivotal in abandoning efforts to make a business of Hadoop distributions, and followed Microsoft in making Hortonworks its supplying partner. At the former Hadoop Summit, now called Dataworks (itself a sign of the shift from Hadoop-centric positioning), IBM announced it will discontinue its IBM Open Platform/BigInsights offering, and will insteadContinue reading “IBM Ends Hadoop Distribution, Hortonworks Expands Hybrid Open Source”

Hadoop Commercial Support Component Tracker – March 2017

Stack expansion has ground to a halt. The last time an Apache project was added to the list of those most supported by leading Hadoop distribution vendors was July 2016, when Kafka joined the other 14 then commonly included. Since then, no broad support for new projects has emerged. The only project that does seem successfulContinue reading “Hadoop Commercial Support Component Tracker – March 2017”

Hadoop Project Commercial Support Tracker July 2016

There are now 15 projects supported by all 5 distributors I track, and several have had new releases since April. Kafka is the newest addition, and I believe the remaining 4-supporter offerings, Mahout and Hue, will remain unsupported by IBM, who has its own alternatives. –More–

Hadoop Apache Project Commercial Support Tracker April 2016

There are now 19 commonly supported projects: Avro, Flume and Solr join the group supported by all 5 distributors and other changes appear as well. For this version of the tracker (last updated in December), I’ve made one sizable change: Pivotal has been dropped as a “leading distributor,” dropping the number to five. Pivotal relies on Hortonworks’ distro (asContinue reading “Hadoop Apache Project Commercial Support Tracker April 2016”

Strata Standards Stories: Different Stores For Different Chores

Has HDFS joined MapReduce in the emerging “legacy Hadoop project” category, continuing the swap-out of components that formerly answered the question “what is Hadoop?” Stores for data were certainly a focus at Strata/Hadoop World in NY, O’Reilly’s well-run, well-attended, and always impactful fall event. The limitations of HDFS, including its append-only nature, have become inconvenient enough toContinue reading “Strata Standards Stories: Different Stores For Different Chores”

Handicapping Hadoop Helpers – Unsupported Projects

The Apache Software Foundation has over 350 projects underway, and others are being developed in the open source community for use with (and without)  the Hadoop stack. In recent posts Now, What is Hadoop? And What’s Supported? and Hadoop Projects Supported by Only One Distribution, I mapped those supported by commercial distributors. But there’s anotherContinue reading “Handicapping Hadoop Helpers – Unsupported Projects”

Hadoop Projects Supported By Only One Distribution

The Apache Software Foundation has succeeded admirably in becoming a place where new software ideas are developed: today over 350 projects are underway. The challenges for the Hadoop user are twofold: trying to decide which projects might be useful in big data-related cases, and determining which are supported by commercial distributors. In Now, What is Hadoop? And What’s Supported? I list 10 supportedContinue reading “Hadoop Projects Supported By Only One Distribution”

Now, What is Hadoop?

This perennial question resurfaced recently in a thoughtful blog post by Andreas Neumann, Chief Architect of Cask, called What is Hadoop, anyway?. Ultimately, after a careful deconstruction of the terms in the question, Andreas concludes with “Does it really matter to agree on the answer to that question? In the end, everybody who builds an application or solutionContinue reading “Now, What is Hadoop?”

Perspectives on Hadoop Part Two: Pausing Plans

By Merv Adrian and Nick Heudecker  In the first post in this series , I looked at the size of revenue streams for RDBMS software and maintenance/support and noted that they amount to $33B, pointing out that pure play Hadoop vendors had a high hill to climb. (I didn’t say so specifically, but in 2014, Gartner estimates thatContinue reading “Perspectives on Hadoop Part Two: Pausing Plans”

Perspectives on Hadoop: Procurement, Plans, and Positioning

I have the privilege of working for the world’s leading information technology research and advisory company, covering information management with a strong focus for the past few years on an emerging software stack called Hadoop. In the early part of 2015, that particular technology is moving from early adopter status to early majority in its marketplaceContinue reading “Perspectives on Hadoop: Procurement, Plans, and Positioning”