My Take on Data Governance
Data Governance is an essential topic for enterprises. Although leadership talks about and wants to implement it, attempts to do so have often failed. In this post, I will discuss why this is and what needs to change to make Data Governance work.
Data collection in any enterprise typically begins with the Financial System (ERP), where all transactions are recorded. As the company grows, new systems are required, and complexity increases. The IT department is usually responsible for the application maintenance, and the company starts doing some sort of operational reporting and BI using various tools. It is at this point that the company thinks about starting a Business Intelligence/Data Team and implementing a Data Governance program.
Data Governance aims to manage data quality, access, security, privacy, discovery, and regulatory compliance. It provides a framework that offers clarity on the data the company has, which system the data is in, how master files are managed, how common data flows are integrated between systems, and who owns each piece of data. It also specifies who has access, what is personal and confidential, and which systems hold them. The aim is to ensure that data is safe, of good quality, and in compliance with regulations.
There are two aspects to implementing a Data Governance program: cultural/process and systems. While systems can help, the cultural aspect is more critical. People need to run, update, manage, iterate, clean, and follow through on processes. A good framework defines roles for Data Owners, SMEs/Data Stewards, Data Engineers, and Data Analysts, and specifies what each role does. When a data problem arises, decisions must be made on how to fix it, whether it is an upstream problem, a process problem, or a system problem that the vendor or programmers need to fix.
The process of implementing Data Governance requires extra work and effort from people, which is why it often fails. To make it work, people need to be willing to put in the effort to achieve the desired future state. From the IT/Data Team, it is essential to have a good understanding of the company’s business, processes, and systems to better support managing data quality together with the business. Data quality issues are often source problems that need to be solved in the source system, requiring SMEs/Data Stewards to be in the loop and work together with the IT/Data Team.
In summary, Data Governance is a critical aspect of any enterprise, but it requires both cultural and system changes to be successful. Companies must be willing to put in the extra effort required to achieve the desired future state. The IT/Data Team must have a good understanding of the company’s business, processes, and systems to manage data quality effectively. Finally, SMEs/Data Stewards must work together with the IT/Data Team to ensure that data quality issues are addressed in the source system.
2023-03-15 17:47 +1030