Hadoop news

Hadoop


Top Stories

What do you get when you combine Big Data technologies….like Pig and Hive? A flying pig? No, you get a “Logical Data Warehouse”. My general prediction is that Cloudera and Hortonworks are both aggressively moving to fulfilling a vision which looks a lot like Gartner’s “Logical Data Warehouse”….namely, “the next-generation data warehouse that improves agility, enables innovation and responds more efficiently to changing business requirements.” In 2012, Infochimps (now CSC) leveraged its early use of stream processing, NoSQLs, and Hadoop to create a design pattern which combined real-time, ad-hoc, and batch analytics. This concept of combining the best-in-breed Big Data technologies will continue to advance across the industry until the entire legacy (and proprietary) data infrastructure stack will be replaced with a new (and open) one. As this is happening, I predi... (more)

Big Data Predictions for 2013

My prediction for 2013 is that competitive advantage will translate into enterprises using sophisticated Big Data analytics to create a new breed of applications - Intelligent Applications. "It's more than just insights from MapReduce", a CIO from a fortune 100 told me, "It's about using data to make our customer touch points more engaging, more interactive, more intelligent." So when you hear about "Big Data solutions," you need to translate that into a new category of "Intelligent Applications." At the end of the day, it's not about people pouring through petabytes of data. It's actually about how one turns the data into revenue (or profits). This means that you MUST: Start with the business problem first (preferably one with revenue upside versus cost savings) Determine which data elements you can leverage AFTER #1 Define an analytical three-tier architecture (a... (more)

Infochimps Shares the Secrets of Big Data Success

AUSTIN, Texas, May 22, 2013 /PRNewswire/ -- Big Data cloud service provider Infochimps (Infochimps.com) announced today the release of "How to Do a Big Data Project," a step by step guide for large enterprises implementing Big Data projects. Recent research by Infochimps has shown that nearly half of all Big Data projects fail. With this new guide, now available for download, the company hopes to improve this success rate. Infochimps is offering insight into some of its own best practices for deriving business value from Big Data with an open-standards architecture and strategy, which it has honed working with some of the world's top companies. Big Data: Boon and Bane of Enterprise IT As Big Data sweeps the business world, there's broad consensus on its value, but no standard approach for following a project through from inception to completion. Research has shown th... (more)

Big Data – Big Help or Big Risk?

By Andy Thurai (Twitter: @AndyThurai) (Original version of this blog appeared on ProgrammableWeb) As promised in my last blog “Big Data, API, and IoT …..Newer technologies protected by older security” here is a deep dive on Big Data security and how to effortlessly secure Big Data effectively. Like many other open source models, Hadoop has followed a path that hasn’t focused much on security.  In order to effectively use Big Data, it needs to be secured properly. However if you try to force fit into an older security model, you might end up compromising more than you think. But if you make it highly secure, it might interfere with performance. In order to effectively secure Big Data, you must mitigate the following security risks that aren’t addressed by prior security models. Issue #1:  Are the keys to the kingdom with you? In a hosted environment, the provider holds ... (more)

1010data Publishes 2013 Big Data in Business Study

1010data, Inc., on Thursday announced the results of its 2013 Big Data in Business Study, which aims to put in context the strides Big Data has made in 2013. 1010data commissioned the survey of 158 U.S. business executives across industry sectors to highlight which industries will see the most success with Big Data. "This research shows that the business community has high expectations for Big Data, with most believing that it will reach its potential in the next five years," said Sandy Steier, co-founder and CEO of 1010data. The study discovered that the majority of executives (79%) believe Big Data will reach its potential in the next one to five years. Finance, retail, consumer packaged goods, and manufacturing are considered the industries that saw the most success with Big Data in 2013. While businesses are optimistic about the prospect of leveraging Big Data, ... (more)

Using Big Data for Competitive Advantage

Big data capabilities and advanced business analytics have now become essential to nearly any business development activity. The benefits that enterprises can get if they can get their hands around big data analytics and apply it to business challenges are quickly being documented -- and they come as big new profits and major market advantages. Industries around the world are rapidly seeking transformational projects using big data to gain competitive advantage. As part of the next edition of the HP Big Data Podcast Series, BriefingsDirect sat down with two HP executives to learn how these advanced analytics seekers can best accomplish their goals. The insights gleaned include how companies worldwide are best capturing myriad knowledge, gaining ever deeper analysis, and rapidly and securely making those insights available to more people on their own terms. So join ... (more)

Beyond Big Data and @Benioff’s “AI Spring” to the Dawn of Dataware By @MattMcIlwain | @CloudExpo [#BigData]

This article was authored by Matt McIlwain and was originally published on Medium. For more of Matt's writing, you can follow him here! Guest Post: Beyond Big Data and Benioff’s “AI Spring” to the Dawn of Dataware Big Data, AI, Machine Learning, Hadoop, Predictive Analytics — we hear these terms every day from companies such as Cloudera, Trifacta and Dato (formerly GraphLab) that are securing many millions in financing. I believe that 2015 will be the year when the conversation moves from Big Data to the Dataware stack. Over the past twelve months we have seen a lot of companies across the big data spectrum emerge and while the language can be the same, there are clear product categories that have emerged which describe the market opportunity and future growth. This is the Dataware stack. Dataware is the combination of infrastructure, data intelligence systems tha... (more)

Big Data and Visualization Give Enterprises New Views By @Dana_Gardner | @BigDataExpo #BigData

Big Data and Visualization Give Enterprises New Views into Their Business The next BriefingsDirect big data innovation discussion highlights how Tableau Software and big data analytics platforms come together to provide visualization benefits for those seeking more than just crunched numbers. They're looking for ways to improve their businesses effectively and productively, and to share the analysis quickly and broadly. To learn more, BriefingsDirect sat down with Paul Lilford, Global Director of Technology Partners for Tableau Software, based in Seattle, and Steve Murfitt, Director of Technical Alliances at HP Vertica. The discussion is moderated by me, Dana Gardner, Principal Analyst at Interarbor Solutions. Here are some excerpts: Gardner: Why is the tag-team between Tableau and big data so popular. Every time I speak with some one using Vertica, they inevitably me... (more)

The Increasing Value of Big Data Analytics By @Dana_Gardner | @BigDataExpo #BigData

The next BriefingsDirect big data innovation case study interview highlights how Rolta AdvizeX in Independence, Ohio creates analytics-driven solutions in the healthcare and retail industries. We'll also delve into how the right balance between open-source and commercial IT products helps in creating a big-data capability, and we'll further explore how converged infrastructure solutions are hastening the path to big-data business value and cloud deployment options. To learn more about how big data can be harnessed for analysis benefits in healthcare and retail, please join me in welcoming our guests, Dennis Faucher, Enterprise Architect at Rolta AdvizeX, and Raajan Narayanan, Data Scientist at Rolta AdvizeX. The discussion is moderated by me, Dana Gardner, Principal Analyst at Interarbor Solutions. Here are some excerpts: Gardner: Dennis, what makes big data so bene... (more)

Accel Partners Launches $100m Big Data Fund to Spur Innovation in Data-Driven Technology

NEW YORK, Nov. 8, 2011 /PRNewswire/ -- Accel Partners, the global venture capital firm, has announced the launch of its Big Data Fund, a new $100m investment initiative created to identify innovative entrepreneurs seeking to build category-defining companies at every layer of the Big Data stack. Accel's Big Data Fund aims to fund transformative companies throughout the Big Data ecosystem, from next generation storage and data management platforms to a wide range of revolutionary software applications and services, including data analytics, vertical applications, mobile, and many more. Accel Partners will manage its Big Data Fund across global offices in U.S., London, China and India. "Big Data consistently drives innovation across our existing portfolio companies today and with the Big Data Fund we are empowering a new set of entrepreneurs to be able to catch t... (more)

Concurrent, Inc. to Present at Upcoming Leading Big Data and Hadoop Industry Events

SAN FRANCISCO, CA -- (Marketwired) -- 05/28/14 -- Concurrent, Inc., the enterprise data application platform company, today announced that Alexis Roos, senior solutions architect, will present at two upcoming industry events: Hadoop Summit North America 2014, taking place June 3-5 in San Jose, Calif. and Big Data Expo 2014, taking place June 10-12 in New York City. At Hadoop Summit North America, Alexis will deliver a talk on Cascading Pattern, a standards-based scoring engine that leverages the power of Cascading and enables analysts and data scientists to quickly deploy machine-scoring applications on Hadoop. Additionally, a week later at Big Data Expo, Alexis will provide an introduction to Cascading, the most widely used and deployed application development framework for building data-oriented applications that enables organizations to operationalize their data... (more)