Symposium Notes – Day Four Returns to Data Security, and to Hadoop

Thursday, the final day, reinforced a theme for the week: data security is heating up, and organizations are not ready. It came up in half of today’s final 10 meetings.

“Is my data more secure, or less, in the cloud?”

“Does using open source software for data management compromise how well I can protect it?”

“I’m a public utility – can I put meter data in the cloud safely? What about if it is used to drive actions at the edge?”

“I’m using drones for mapping and the data is in the cloud – am I exposed?”

–more–

Symposium Notes – Day Three Features Data Assembly

With 24 meetings under my belt from the first two days at Orlando Symposium, Wednesday’s 13 (and a presentation) didn’t look quite as daunting. It began well, with enough time for a muffin and some tea at 730 AM in the analyst workroom near to the cubicle I’d spend the day in. Then I launched right in to a couple of predictive analytics discussions.

–more–

Symposium Notes – Day Two Jumps in the (Data) Lake

My second day of Symposium 1:1 meetings continued the “security of big data” theme (4 of the day’s 15 conversations – usually, but not always, about HDFS-based data), with a data lake flavor. The concerns were retroactive – often driven by an internal audit. “We built it, now how do we secure it?” is a common question. And “it’s almost all structured data so far,” confirming what Gartner found in the 2016 big data survey. Vendor conversations (4 of the day’s 1:1s) also included a look at security – “how much is this going to matter to my customers? Who can I partner with?” has been a typical thread, and I met with a security consultancy whose practice seems to be ramping rapidly.

–more–

Symposium Notes – Day One Features Hadoop

Gartner Symposium is always exciting, challenging and stimulating for analysts; we get to interact with many organizations in a brief time during 1on1 meetings scheduled based on our coverage. It offers an fascinating snapshot of what is on people’s minds – enough so that they have traveled to a conference in part to have that discussion.

Today, October 17, 2016, was the first full day of the 2016 Orlando Symposium and over half of my meetings were about Hadoop.

—more—

Hadoop Project Commercial Support Tracker July 2016

There are now 15 projects supported by all 5 distributors I track, and several have had new releases since April. Kafka is the newest addition, and I believe the remaining 4-supporter offerings, Mahout and Hue, will remain unsupported by IBM, who has its own alternatives.

–More–

Handicapping Hadoop Helpers – Unsupported Projects

The Apache Software Foundation has over 350 projects underway, and others are being developed in the open source community for use with (and without)  the Hadoop stack. In recent posts Now, What is Hadoop? And What’s Supported? and Hadoop Projects Supported by Only One Distribution, I mapped those supported by commercial distributors. But there’s another group – a dozen (so far) not supported by any of them.

–more–

Hadoop Projects Supported By Only One Distribution

The Apache Software Foundation has succeeded admirably in becoming a place where new software ideas are developed: today over 350 projects are underway. The challenges for the Hadoop user are twofold: trying to decide which projects might be useful in big data-related cases, and determining which are supported by commercial distributors. In Now, What is Hadoop? And What’s Supported? I list 10 supported by only one: Atlas, Calcite, Crunch, Drill, Falcon, Kite, LLAMA, Lucene, Phoenix and Presto. Let’s look at them a little more.

–more–

Microsoft in MQs – June Is Bustin’ Out

Following December 2014’s Microsoft’s Product Positions – Positive Progress, and March’s Microsoft in MQs – March On,  this post updates my quarterly map of the several dozen Gartner Magic Quadrants that feature Microsoft offerings. As Microsoft nears the end of its fiscal year (and undergoes management shifts I’ll discuss in a future post) their MQ progress continues through Q2.

–More in Gartner blog–

Perspectives on Hadoop Part Two: Pausing Plans

By Merv Adrian and Nick Heudecker 

In the first post in this series , I looked at the size of revenue streams for RDBMS software and maintenance/support and noted that they amount to $33B, pointing out that pure play Hadoop vendors had a high hill to climb. (I didn’t say so specifically, but in 2014, Gartner estimates that the three leading vendors generated less than $150M.)

In this post, Nick and I turn from Procurement to Plans and examine the buying intentions uncovered in Gartner surveys.

 

–more in Gartner blog–

Perspectives on Hadoop: Procurement, Plans, and Positioning

I have the privilege of working for the world’s leading information technology research and advisory company, covering information management with a strong focus for the past few years on an emerging software stack called Hadoop. In the early part of 2015, that particular technology is moving from early adopter status to early majority in its marketplace adoption. The discussions and published work around it have been exciting and controversial, so in this post (and a couple to follow) I describe three interlocking research perspectives on Hadoop: procurement (counting real money actually spent); plans (surveys of intentions to invest) and positioning (subjective interpretations of what the first two mean.)

Procurement Perspective: Hadoop is a (Very) Small Market Today

–more on Gartner blog–