IBM Ends Hadoop Distribution, Hortonworks Expands Hybrid Open Source

IBM has followed Intel and EMC/Pivotal in abandoning efforts to make a business of Hadoop distributions, and followed Microsoft in making Hortonworks its supplying partner. At the former Hadoop Summit, now called Dataworks (itself a sign of the shift from Hadoop-centric positioning), IBM announced it will discontinue its IBM Open Platform/BigInsights offering, and will instead OEM Hortonworks’ HDP.

more

Hadoop FAQs – April Webinar Q&A

Nick Heudecker and I received numerous questions during our April Hadoop webinar with several hundred attendees, and we have summarized and answered them.

–more–

Symposium Notes – Day Four Returns to Data Security, and to Hadoop

Thursday, the final day, reinforced a theme for the week: data security is heating up, and organizations are not ready. It came up in half of today’s final 10 meetings.

“Is my data more secure, or less, in the cloud?”

“Does using open source software for data management compromise how well I can protect it?”

“I’m a public utility – can I put meter data in the cloud safely? What about if it is used to drive actions at the edge?”

“I’m using drones for mapping and the data is in the cloud – am I exposed?”

–more–

Symposium Notes – Day Three Features Data Assembly

With 24 meetings under my belt from the first two days at Orlando Symposium, Wednesday’s 13 (and a presentation) didn’t look quite as daunting. It began well, with enough time for a muffin and some tea at 730 AM in the analyst workroom near to the cubicle I’d spend the day in. Then I launched right in to a couple of predictive analytics discussions.

–more–

Symposium Notes – Day Two Jumps in the (Data) Lake

My second day of Symposium 1:1 meetings continued the “security of big data” theme (4 of the day’s 15 conversations – usually, but not always, about HDFS-based data), with a data lake flavor. The concerns were retroactive – often driven by an internal audit. “We built it, now how do we secure it?” is a common question. And “it’s almost all structured data so far,” confirming what Gartner found in the 2016 big data survey. Vendor conversations (4 of the day’s 1:1s) also included a look at security – “how much is this going to matter to my customers? Who can I partner with?” has been a typical thread, and I met with a security consultancy whose practice seems to be ramping rapidly.

–more–

Symposium Notes – Day One Features Hadoop

Gartner Symposium is always exciting, challenging and stimulating for analysts; we get to interact with many organizations in a brief time during 1on1 meetings scheduled based on our coverage. It offers an fascinating snapshot of what is on people’s minds – enough so that they have traveled to a conference in part to have that discussion.

Today, October 17, 2016, was the first full day of the 2016 Orlando Symposium and over half of my meetings were about Hadoop.

—more—

Hadoop Project Commercial Support Tracker July 2016

There are now 15 projects supported by all 5 distributors I track, and several have had new releases since April. Kafka is the newest addition, and I believe the remaining 4-supporter offerings, Mahout and Hue, will remain unsupported by IBM, who has its own alternatives.

–More–

Handicapping Hadoop Helpers – Unsupported Projects

The Apache Software Foundation has over 350 projects underway, and others are being developed in the open source community for use with (and without)  the Hadoop stack. In recent posts Now, What is Hadoop? And What’s Supported? and Hadoop Projects Supported by Only One Distribution, I mapped those supported by commercial distributors. But there’s another group – a dozen (so far) not supported by any of them.

–more–

Hadoop Projects Supported By Only One Distribution

The Apache Software Foundation has succeeded admirably in becoming a place where new software ideas are developed: today over 350 projects are underway. The challenges for the Hadoop user are twofold: trying to decide which projects might be useful in big data-related cases, and determining which are supported by commercial distributors. In Now, What is Hadoop? And What’s Supported? I list 10 supported by only one: Atlas, Calcite, Crunch, Drill, Falcon, Kite, LLAMA, Lucene, Phoenix and Presto. Let’s look at them a little more.

–more–

Microsoft in MQs – June Is Bustin’ Out

Following December 2014’s Microsoft’s Product Positions – Positive Progress, and March’s Microsoft in MQs – March On,  this post updates my quarterly map of the several dozen Gartner Magic Quadrants that feature Microsoft offerings. As Microsoft nears the end of its fiscal year (and undergoes management shifts I’ll discuss in a future post) their MQ progress continues through Q2.

–More in Gartner blog–