In the early days of modern computing, reporting was primarily an IT function. Information was trapped within centralized operational systems which were largely inaccessible to anyone outside of a small, trusted group of IT resources. Consequently, all reporting needs were satisfied by “qualified” IT professionals who created batch reports that were scheduled to run nightly so as to not interfere with daily operational processing tasks.While these nightly batch reports provided some visibility into operational data, they were limited in scope and primarily output in a tabular format. Further compounding the issue, information silos crept into existence as organizations adopted heterogeneous IT environments consisting of multiple operational systems to support key functions including sales, marketing, logistics, financials and others. Businesses lacked the ability to gain cross functional insights that would allow for data driven, strategic decision making.
This limited access to information gave birth to the data warehouse. With the invention of the data warehouse came the promise of bridging the information silos and creating a unified environment where all information could be accessed for business intelligence. While the first generation data warehouses enabled new insights by bringing disparate data sources together into a single environment, these were typically IT led initiatives that lacked sufficient business user involvement to ensure that the DW solutions delivered the right business value.
Some of the key challenges with the first generation data warehouses include:
Lacked data governance and conformity in terminology and metric definitions
Modeled by IT without collaboration of business users resulting in data models that did not accurately reflect the business
Delivered using a classic waterfall development approach leading to lengthy development cycles and a long time to value
As a result, these IT led data warehouses failed to deliver on the promise of actionable insights and made the term “data warehouse” a bad word in many companies.
Experience taught everyone that Business Intelligence has to start with the…BUSINESS! The failings of the first generation data warehouses can largely be attributed to the lack of business user involvement. A key lesson learned was that the business must lead data warehouse initiatives and it must start at the top with C-level sponsorship. Business users must be active participants in driving requirements, contributing to data modeling and validating the solution early through prototyping and other means. Another key lesson was the need for a strong Data Governance foundation to guide the data warehouse efforts. The Data Governance function ensures that the business is actively engaged in defining the data, ensuring consistent terminology, standardizing metrics and driving data quality improvements into the source systems - all problems that plagued the first generation data warehouses.
The second generation data warehouses, underpinned by strong data governance and business user engagement, have produced significantly improved outcomes. In particular, DW 2.0 has empowered many businesses to adopt enterprise business intelligence as a core competency, improve the quality of data and transition decision making from uninformed to insight driven. Despite the improvements, there are still challenges to be addressed including:
The DW environment is still primarily controlled by IT with restrictions on access
It takes too long to deliver new data sources or augment existing data sources
IT resistance to bringing in new data from external sources
IT is overwhelmed and unable to keep pace with the needs of the business
New data sources take too long to integrate or are never integrated
Since the start of DW 2.0, there has been an explosion in the growth of new data. The rise of new data sources from cloud, social, sensors, third parties and others have challenged the traditional data warehouse architecture. Business users need to be able to access these new data sources and do so quickly.No longer does the single DW platform satisfy the information appetite of data savvy business stakeholders. As a result, the industry has responded by creating new technologies that empower the business to leverage both the governed assets in the corporate DW as well as take advantage of the new data sources that exist outside of the data warehouse.
These new technologies enable what Gartner terms “bi-modal”. Bi-modal is the idea of empowering line of business analysts with tools and data to innovate while also continuing to expand and evolve the traditional governed data in the data warehouse.We no longer speak of a single, monolithic Data Warehouse for insights.The Data Warehouse is undergoing evolution in what TDWI calls the “Modern Date Warehouse” and Gartner calls the “Logical Data Warehouse”.Traditional, governed data warehouses and BI are combined with new breed technologies such as:
Big Data (Hadoop, Spark)
Virtualization (governed, real time access to disparate data sources through a single interface)
Data Discovery and data blending to perform analysis of DW data and ungoverned data in a single environment
Heterogeneous access to data… using the right visualization platform for the right purpose and audience
As the famous quote says, “The only thing that is constant, is change”. We live in a rapidly evolving world with BI, Analytics and Data Management technologies responding quickly to the ever changing needs of business.Businesses that are quick to embrace these changes are able to see farther, go faster and operate more profitably than their competitors. At CCG, we have the opportunity to help our clients navigate the myriad challenges in evolving their BI and DW architectures and realizing the benefits of the bi-modal movement.
For more business intelligence insights, contact a data and analytics professional contact email@example.com or call 813.265.3239.
CCG understood our project needs very well, they are very responsive and we could not ask for anything more. The solution they provided fit perfectly with our expectations and business goals.GOP Data TrustChief Data Officer
I cannot overstate the delight we experienced from the outcome of our project. I would not only recommend CCG to any company, but question why they would engage with anyone but CCG.PgiDirector of Customer Success
Working with CCG is like working with extended team members. Consultants become an integral part of the work bringing expertise for cutting edge design and development.Hillsborough County Public SchoolsChief Information and Technology Officer
CCG's team is positive and eager. They are a great big bunch of wonderful people trying to make a difference.Hillsborough County Public SchoolsDepartment Manager
I knew CCG's technical expertise and dedication to quality results would be invaluable to our project success based on our past partnerships. We could not have implemented in the short timeframe like we did without their assistance. CCG is #1 on my speed dial for successful project implementation.InCommDirector, Financial Information Systems
It was evident from the onset of negotiations through the implementation that CCG took their role in the partnership to heart and we believe it has been instrumental in our success.Interval InternationalDirector of Marketing
CCG works very hard to understand and align with our needs. It truly feels as though we are on the same team!Fortune 500 HomebuilderBI Manager
CCG came to our company in a time of much change. Their team partnered with ours, continually delivering with professionalism and efficiency. We would not be where we are today without the expertise CCG brought to the project.PSCU Financial ServicesSenior Program Manager
CCG has a good industry knowledge, we are very happy that we chose to work with CCG. They have been a great help strategically and are helping us make important decisions.Minneapolis Public SchoolsHuman Capital Coordinator
Other Vendors use the word Partnership, but CCG actually means what they say. I can’t thank them enough for their professionalism and willingness to work with us as a true Partner, not just another vendor.PODSCIO
Our CCG Consultants are total rock stars: very thorough with a solid knowledge of the financial services industry. As a bonus, they are very easy to get along with – a great fit for our team.Raymond James Financial ServicesSenior Manager of Enterprise Data
CCG's team are all amazing. Thank you, CCG, for all that you do to make us great and keep our credit unions moving forward!PSCU Financial ServicesVP Enterprise Analytics & BI
Other Vendors use the word Partnership, but CCG actually means what they say. I can’t thank them enough for their professionalism and willingness to work with us as a true Partner, not just another vendor.PODSChief Information Officer
CCG's Team is very professional and responsive. They are making our job very easy.Rollins, Inc.Senior BI Analyst
CCG did an excellent job! Their team was very flexible. They gave us everything we asked for and then some.Rooms To GoSenior BI Architect
I'm amazed at the talent at CCG, not just the skillset - they're really good people. We've already referred them once and will do so again!Ruth's Chris Hospitality GroupCIO
CCG did a great job! We're extremely impressed with what was built in a short time. CCG has delivered ahead of time and with best practices, it's been a pleasure to work with them.VologyVP of Analytics
2502 N. Rocky Point Drive, #650, Tampa, FL 33607
Phone: 813.968.3238 | Fax: 813.200.1357
8000 Avalon Blvd. Suite #100, Alpharetta, GA
Phone: 404.328.7298 | Fax: 813.200.1357