This blog is the first in a series of posts explaining the overarching goal and purpose of the Apache Beam project. In the future blogs, we will explain how to use Apache Beam to implement data processing jobs.  When you have an existing big data platform, the continuous evolution of that platform is important. If you’re currently using Apache Hadoop MapReduce jobs to process your data, you may want to migrate to Apache Spark in ord...

Our Puzzled Customers In this era of Big Data, many of the IT people I talk with have a number of questions about the technology and trends associated with this new paradigm. For example, many of them are feeling somewhat overwhelmed with the amount of data they now have to deal with – data that seems to be growing exponentially. Many of the comments I hear go something lik...

- Blog by Chris Lewis at Lewis Insights The big data opportunity for telcos is not a new phenomenon.  Vast amounts of data have been generated both internally and externally over generations of fixed and mobile services for consumer, business and partners alike. Over The Top (OTT) pl...

Bessere Entscheidungen treffen Wir alle treffen täglich tausende Entscheidungen, viele unbewusst oder auf der Grundlage weniger Informationen. Oft blitzschnell. Auch in der Arbeitswelt. Wir verlassen uns also häufig auf unsere Intuition und das Bauchgefühl. Zwar ist unsere Intuition häufig besser als ihr Ruf. Aber gerade im beruflichen Umfeld sind ständig wichtige...

Was Echtzeit-Big Data-Architekturen angeht, haben Sie inzwischen mehrere Optionen. Heute steht Ihnen mehr als nur Lambda zur Auswahl. In dieser Blog-Serie beschäftige ich mich mit ein paar dieser Optionen und vergleiche sie mit relevanten Anwendungsfällen. Wie also können wir die richtige Architektur für Ihr Echtzeit-Projekt ausfindig machen? Legen wir los. Echtzeit-Anforderungen Bevor wir uns intensiver mit der Architektur auseinandersetzen, sollten wir uns mit einige...

Bereits heute verbindet das Internet der Dinge die digitale mit der physischen Sphäre und schließt die Lücke zwischen Informationssystemen und der Außenwelt. Noch vor kurzem gab es eine Kluft zwischen diesen beiden Bereichen, da Daten aus der physischen Welt sich nicht mit IT-Systemen integrieren ließen. In der Regel wurden extern erfasste Werte erst im Nachhinein eingebunden – etwa im Rahmen einer Stapelverarbeitung oder durch manuelle Eingabe. Dieser Umstand...

Blog authored by Nitin Kudikala, Customer Success Architect at Talend As companies try to become data driven enterprises, new distributed data architectures such as Hadoop create new opportunities to derive more information and intelligence from their Data assets. As these technologies evolve, securing the data stored in these data stores has become critical. There is a clear need for comprehensive security as Hadoop holds sensitive inf...

Enterprise Hadoop may be less than a decade old, but analysts at Forrester recently estimated that 100% of all large enterprises will adopt it and related technologies such as Spark for big data analytics within the next two years. It’s clear that we are getting beyond the need for businesses to be educated about Hadoop. Time and again, Hadoop has gained significant interest across various industries globally, and is considered to be one of the core...

Guest Blog by Bernard Marr, Founder and CEO of The Advanced Performance Institute A quiet revolution has been taking place in the technology world in recent years. The popularity of open source software has soared as more and more businesses have realized the value of moving away from walled-in, proprietary technologies of old. And it’s no coincidence that this transformation has taken place in parallel with the explosion of i...

“Hey ‘Big Data’ is just a big fuzzy word for me” quoted a Vice President of an Innovation Center at a big logistic company back in early 2015. Just one year later, he not only has to admit that ‘Big Data’ is the next big revolution, but has already applied big data technology to dramatic effect significantly growing the business and reducing costs. In fact, he’s been so successful that he’s been given the funding for a new...