Data warehousing applications have been around since the late 1980’s, and their main purpose was simply to take raw data and turn it into a sensible format for businesses to identify trends, patterns historically. Over the years, the demands on data warehouses have changed dramatically due to fast evolving business needs such as real-time data…

Quite often I hear questions from customers like “What are the right design patterns for a server-less ETL workflow?”. AWS offers a wide range of server-less and managed services to complement various ETL requirements. In this post, I would like to put together some of my views on designing an event-driven or real-time ETL workflow…

The advancements in the Artificial Intelligence has gained full momentum in the past few years and is continuing at full pace. All of us are familiar with the messaging apps flooded in the market. As a result, billions of users are using these apps. With the increasing popularity of these apps, virtual bots are in…

The feedback we received from attendees of our webinar with Alteryx on November 30, 2017 was tremendous. We consider it a huge success! In case you missed it, the webinar focused on not only the challenges most companies face when implementing self-service data analytics, but how to overcome them. Here are the top four takeaways from…

Big data and analytics are changing the way businesses are run. But there is a lot of noise surrounding both as to where to start and what the end goal should be. I see a lot of opportunity for big data analytics to flourish in the utility industry, while helping to make the systems more…

AWS offers the broadest set of production-hardened services for almost any analytic use-case. They enable customers to easily run analytical workloads (Batch, Real-time, Machine Learning) in a scalable fashion minimizing maintenance and administrative overhead while assuring security and low costs. AWS services cover all elements of a typical analytic workflow from data ingestion, storage, ETL, data warehousing,…

Ooh oohhh! Please hold on. Don’t jump to conclusions yet, I will justify the title. I’m currently thinking about building a rocket next year. The interesting aspect is, I absolutely have no idea or background in rocket science. But who cares? This may sound outlandish, but let me demystify. We have a wealth of bright…

Artificial Intelligence (AI) is changing our lives, and candidly I never felt AI more omnipresent than now.  From SIRI to autonomous cars, AI is progressing at a rapid pace. Watching science fiction movies, we often thought AI was all about robots with human like intelligence. But, today, AI applies everywhere starting with our favorite Google’s…

The whole world nowadays seems to be on the verge of a radical shift. Be it politics, economics, social systems, or technology; everywhere we are surrounded by clouds of uncertainty, promise, and renewal. Whether this shift is for the better or worse, remains to be seen but the cry of change in itself must not…

Two scientists are lost at the top of a mountain. Scientist #1: Pulls out a map and looks at it for a while. Then he turns to Scientist #2 and says: “Hey, I’ve figured it out. I know where we are.” Scientist #2: Where are we then? Scientist #1: Do you see this mountain on…

Have you ever heard or seen a phrase or title like this in your entire career? We almost assume the answer is a big ‘NO’. We were at one of the major big data events in California a month ago and I personally was not super happy for many reasons. But one thing quickly grabbed…

                                                                                                             …

These days, Big Data technologies seem to be developing so unbelievably fast that it’s causing downstream affects that we may have not seen coming. It almost seems like somebody passionate about Big Data found Aladdin’s Wonderful Lamp, rubbed it, then asked the Genie for “Multiple Stacks of Technologies” because new products seem to be released…

If you’ve been around the technology block for a while, chances are, the term ‘Big Data’ is not unfamiliar to you. It has been thrown around so much that even making fun of its over usage is clichéd. I remember a conversation with a client who expressed a whole lot of interest to move their…

During a recent press conference, a teared eye CEO of a major multinational communications and information technology company stated “we didn’t do anything wrong, but somehow, we lost”, as a result of a 150 year old company being acquired for not keeping up proactively with the world’s ever changing landscape of market’s demands. This case…

In this information age, the pace and constant changes in operating a business has never been greater. The most effective way to manage these situations is to gain “timely” insights from data that are immediately “actionable” to businesses, and where it is making a competitive difference. Great message isn’t it? But what are “actionable” insights?…

  “In God we trust.   All others must bring data.”Dr. W. Edwards Deming Early in my career, I attended a Deming Seminar and had the privilege of participating in one that was led by Dr. W. Edwards Deming himself. I was honored to actually meet him during lunch one of the days. Widely recognized…

The relational database model began to emerge in the 1970’s and quickly gained traction because of its capabilities to store and manipulate data during that time. RDBMS is still the predominant technology for storing structured data in web or any other business applications. Everything is going great and now all of sudden we have need…

Business Analytics?   Business is the operative word… Why is it that many executives, and perhaps you, have not yet embraced big data analytics? As a company that’s knee-deep in discussions everyday about how companies are managing the 3 Vs in data and especially how they can leverage it, this question puzzled my colleagues and me….

  Unfortunately, we hear the above statement too often. The hype around Big Data has created a misconception that advanced analytics is not possible with Small Data, which everyone has been collecting for years. Big is a relative term. With more and more focus on the size of data, many people are headed in the…

How Do Executives Know When to Invest in Analytics? Executives are being faced with a difficult question: when is the right time to begin investing in Big Data Analytics?  Unfortunately, there’s no easy answer, but let’s examine how he or she will know when they are ready. The answer may surprise you. The fact is…

Wherever you look in the industry, you can see one and one thing only that is constantly changing the dimension of the industry- big data. But, data cannot do anything by itself. Rather, the user of the data can lead to the directions hitherto unknown. Big data is the crude oil that needs refinement to…

Everyone in the IT business attempts to make the most of the dollar they have. The whole IT business is thriving to make dollar the most expensive currency there is. It is no surprise that things will tend to be more and more towards this direction as the key to this would be doing more…