Hadoop news

Hadoop


Latest Blogs from Hadoop
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrast...
The following are a few Big Data companies that I was keeping an eye on starting back in January of 2015 (yeah, this is NOT a statistically significant sample)….some for “old times sake” because I knew the founding team and was curious how things were progressing, some because I trust...
As every year begins, several experts and analyst firms like to make predictions. Let us try to make some observations in an area much talked about lately – Big Data. So here goes: Big Data quandary will continue as companies try to understand its value to business. Just dumping all k...
INOVVO delivers impactful network analytical services for mobile operators to help them engender improved end-user loyalty. The next BriefingsDirect big-data case study discussion examines how INOVVO delivers impactful network analytical services for mobile operators to help them enge...
Big Data is a growing trend, making it possible for businesses of every kind to gather, store, and use the unlimited personal and private data found on the internet. This massive collection allows them to predict trends, determine consumer tastes, and hone marketing plans for the great...
Spirent Communications advances the use of big data to provide improved user experiences for telecommunications operators. Our next big-data case study discussion explores the ways that Spirent Communications advances the use of big data to provide improved user experiences for telec...
Converged infrastructure solutions are hastening the path to big-data business value and cloud deployment options. We'll also delve into how the right balance between open-source and commercial IT products helps in creating a big-data capability, and we'll further explore how converge...
Snagajob – one of the largest hourly employment networks for job seekers and employers – uses big data to finally understand their systems' performance in action. The next BriefingsDirect analytics innovation case study interview explores how Snagajob in Richmond, Virginia – one of t...
Tableau Software and big data analytics platforms come together to provide visualization benefits for those seeking more than just crunched numbers. The next BriefingsDirect big data innovation discussion highlights how Tableau Software and big data analytics platforms come together t...
GoodData created a business intelligence-as-a-service capability across multiple industries that enables users to take advantage of both big-data performance as well as cloud delivery efficiencies. This BriefingsDirect big data innovation discussion examines how GoodData created a bu...
Big Data, AI, Machine Learning, Hadoop, Predictive Analytics — we hear these terms every day from companies such as Cloudera, Trifacta and Dato (formerly GraphLab) that are securing many millions in financing. I believe that 2015 will be the year when the conversation moves from Big Da...
What do you get when you combine Big Data technologies….like Pig and Hive? A flying pig? No, you get a “Logical Data Warehouse”. My general prediction is that Cloudera and Hortonworks are both aggressively moving to fulfilling a vision which looks a lot like Gartner’s “Logical Da...
Back when we were doing DB2 at IBM, there was an important older product called IMS which brought significant revenue. With another database product coming (based on relational technology), IBM did not want any cannibalization of the existing revenue stream. Hence we coined the phrase ...
The term "Big Data" is quite possibly one of the most difficult IT-related terms to pin down ever. There are so many potential types of, and applications for Big Data that it can be a bit daunting to consider all of the possibilities. Thankfully, for IT operations staff, Big Data is mo...
The hype around Big Data has died down... a lot. Svetlana Sicular of Gartner famously (or infamously) noted early last year, big data is descending into the "Trough of Disillusionment." While that sounds awful on the surface, it's actually a sign of a maturing market. It means all the ...
Organizations that rely on the big data processing power of Hadoop can come across problems when the raw data of Business Intelligence (BI) workflow creates a bottleneck. The analysts who need the data to make decisions do not typically have the advanced programming skills required to ...
To say you have cloud enabled your big data usage is to say that you’ve taken the first step of many to get what you need out of that data mass. However, big data is a very particular to the organization that’s using it – it’s not the same everywhere you go. The virtues of big data su...
As promised in my last blog “Big Data, API, and IoT …..Newer technologies protected by older security” here is a deep dive on Big Data security and how to effortlessly secure Big Data effectively. Like many other open source models, Hadoop has followed a path that hasn’t focused much ...
My working title was Big Data, Storage Dilemma. They say dilemma. I say dilemna. I’m serious. I spell it dilemna. Big Data presents something of a storage dilemma. There is no one data store to rule them all. Should different data structures be persisted to different storage mediums...
As enterprises and analytics vendors adopt Big Data as part of the mainstream , this adoption will be more meaningful to enable the technology to support new business use cases. Financial Analytics is one such important area , and with the support of frameworks l...
My copy of the new book The Human Face of Big Data created by Rick Smolan and Jennifer Erwitt arrived yesterday compliments of EMC (the lead sponsor). In addition to EMC, the other sponsors of the book are Cisco, VMware, FedEx, Originate and Tableau software. To say this is a big book...
My prediction for 2013 is that competitive advantage will translate into enterprises using sophisticated Big Data analytics to create a new breed of applications - Intelligent Applications. "It's more than just insights from MapReduce", a CIO from a fortune 100 told me, "It's about us...
Inventory levels. Sales results. Negative comments on Facebook. Positive comments on Twitter. Shopping on Amazon. Listening to Pandora. Online search habits. No matter what you call it or what the information describes, it’s all data being collected about you. Thanks to new technologi...
This is an industry trends and perspective piece about big data and little data, industry adoption and customer deployment. If you are in any way associated with information technology (IT), business, scientific, media and entertainment computing or related areas, you may have heard b...
CTOlabs.com, a subsidiary of the technology research, consulting and services firm Crucial Point LLC and a peer site of CTOvision.com, has just published a white paper providing context and use cases on Hadoop For Law Enforcement, an important mission-focused domain ripe for the applic...
Datameer provides a big data solution that focuses on perhaps the most important niche in this growing domain, the end-user. Here is an introduction from their website: Datameer leverages the scalability, flexibility and cost-effectiveness of Apache Hadoop to deliver an end-user focuse...
A cute idea that popped into my head that effectively describes the main dynamic of the change occuring within the IT world, is the “small Big Data centre”, ie. The data centre is increasingly becoming Big Data oriented, not just in terms of reading data from apps like Hado...
Is Big Data destined for only the top 3,000 companies worldwide? What about medium or small companies who are equally as data-driven? Is there a place for Big Data in SMB markets? When I talk to SMB companies about their use of public cloud services, it’s a no-brainer. Pay as you go, ...
To date, Big Storage has been locked out of Big Data. It’s been all about direct attached storage for several reasons. First, Advanced SQL players have typically optimized architectures from data structure (using columnar), unique compression algorithms, and liberal usage of caching to...
In this  article  I would  like to look at a few tools which are overlooked when it comes to Big Data analytics. Organizations that  have  already  heavy investment  on Mainframe  and  would like to continue  with the utilization of Mainframe can consider these  tools for further  ex...
We see Big Data solutions daily through tools such as Twitter and LinkedIn, which analyze massive amounts of information from user accounts and actions to perform searches and generate content in real time. Twitter, for example, looks at millions of tweets fast enough to determine what...
The phrase “Big Data” is thrown around a lot these days. What exactly is referred to by this phrase? When I was part of IBM’s DB2 development team, the largest size limit of a DB2 Table was 64 Gigabytes (GB) … Continue reading →