Dataversity

MARCH 2, 2022

With the accelerating adoption of Snowflake as the cloud data warehouse of choice, the need for autonomously validating data has become critical. While existing Data Quality solutions provide the ability to validate Snowflake data, these solutions rely on a rule-based approach that is […].

Data Quality 130

Data Quality Data Warehouse Data Governance Data Architecture 130

Dataversity

AUGUST 15, 2022

If data is the new oil, then high-quality data is the new black gold. Just like with oil, if you don’t have good data quality, you will not get very far. So, what can you do to ensure your data is up to par and […]. You might not even make it out of the starting gate.

Data Quality 130

Data Quality Data Warehouse Data Governance Data Architecture 130

The Data Administration Newsletter

DECEMBER 4, 2024

We have lots of data conferences here. I’ve taken to asking a question at these conferences: What does data quality mean for unstructured data? Over the years, I’ve seen a trend — more and more emphasis on AI. This is my version of […]

Data Quality 52

Data Quality Artificial Intelligence Data Architecture Data Management 52

Dataversity

MAY 16, 2022

In the context of a large system integration project, we are talking about awareness of: 1) Data Quality expectations and metrics, 2) Enterprise Data Management plan, 3) Data Governance best practices, 4) data risk factors, 5) Data Governance framework, 6) data owners/data consumers, 7) Data Architecture principles, 8) […].

Data Governance 130

Data Governance Government Data Architecture Data Quality 130

Dataversity

MAY 9, 2022

Data fabric is redefining enterprise data management by connecting distributed data sources, offering speedy data access, and strengthening data quality and governance. This article gives an expert outlook on the key ingredients that go into building […].

Data Quality 130

Data Quality Government Data Management Master Data Management 130

Dataversity

MARCH 21, 2022

If you’re trying to determine whether you need a data lake, a data warehouse, or possibly even both, you’ll want to understand the functionality of each tool and their differences. This article will highlight the differences between each and how […].

Data Warehouse 246

Data Warehouse Data Management Data Discovery Data Governance 246

Dataversity

SEPTEMBER 12, 2022

The ways in which we store and manage data have grown exponentially over recent years – and continue to evolve into new paradigms. For much of IT history, though, enterprise data architecture has existed as monolithic, centralized “data lakes.” The post Data Mesh or Data Mess?

Data Architecture 130

Data Architecture Data Quality Data Governance Government 130

Dataversity

DECEMBER 14, 2023

In the fast-evolving data landscape, understanding emerging trends and embracing technological advancements are key to staying ahead. As we approach 2024, this article explores the data trends that will define the strategic landscape for the coming year.

Data Quality 173

Data Quality Data Governance Data Architecture Government 173

Dataversity

MAY 26, 2023

Suppose you’re in charge of maintaining a large set of data pipelines from cloud storage or streaming data into a data warehouse. How can you ensure that your data meets expectations after every transformation? That’s where data quality testing comes in.

Monitoring 130

Monitoring Data Warehouse Data Quality Data Governance 130

Dataversity

MAY 26, 2022

A data lake becomes a data swamp in the absence of comprehensive data quality validation and does not offer a clear link to value creation. Organizations are rapidly adopting the cloud data lake as the data lake of choice, and the need for validating data in real time has become critical.

Data Quality 130

Data Quality Data Governance Data Architecture Government 130

Dataversity

NOVEMBER 20, 2024

Today’s data pipelines use transformations to convert raw data into meaningful insights. Yet, ensuring the accuracy and reliability of these transformations is no small feat – tools and methods to test the variety of data and transformation can be daunting.

Data Quality 147

Data Quality Data Governance Data Architecture Government 147

Dataversity

DECEMBER 17, 2024

Ransomware in particular continues to vex enterprises, and unstructured data is a vast, largely unprotected asset. In 2025, preventing risks from both cyber criminals and AI use will be top mandates for most CIOs.

Data Governance 162

Data Governance Government Data Quality Data Architecture 162

Dataversity

MARCH 13, 2025

Unexpected (and unwanted) data transformation problems can result from 50 (or more) issues that can be seen in the table thats referenced in this blog post (see below). This post is an introduction to many causes of data transformation defects and how to avoid them.

Data Quality 130

Data Quality Data Governance Data Architecture Government 130

Sisense

AUGUST 28, 2020

However, as a data team member, you know how important data integrity (and a whole host of other aspects of data management) is. In this article, we’ll dig into the core aspects of data integrity, what processes ensure it, and how to deal with data that doesn’t meet your standards.

Data Quality 101

Data Quality Data Security Data Architecture Agile 101

Tableau

SEPTEMBER 23, 2021

Editor’s note: This article originally appeared on CIO.com. If we asked you, “What does your organization need to help more employees be data-driven?” where would “better data governance” land on your list? Data quality: Gone are the days of “data is data, and we just need more.” Data modeling.

Data Governance 102

Data Governance Government Data Quality Change Management 102

Dataversity

JUNE 19, 2023

In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline.

Monitoring 130

Monitoring Data Modelling Data Quality Data Governance 130

Dataversity

MARCH 29, 2024

Instead of starting data protection strategies by planning backups, organizations should flip their mindset and start by planning recovery: What data needs to be recovered first? What systems […] The post World Backup Day Is So 2023 – How About World Data Resilience Day?

Planning 299

Planning Data Governance Data Quality Data Architecture 299

Dataversity

SEPTEMBER 11, 2024

My company’s 2024 Data Protection Trends report revealed that 75% of organizations experience […] The post Understanding the Importance of Data Resilience appeared first on DATAVERSITY. In recent years, the frequency and sophistication of cyberattacks have surged, presenting a formidable challenge to organizations worldwide.

Data Governance 298

Data Governance Data Quality Data Architecture Government 298

Tableau

SEPTEMBER 23, 2021

Editor’s note: This article originally appeared on CIO.com. If we asked you, “What does your organization need to help more employees be data-driven?” where would “better data governance” land on your list? Data quality: Gone are the days of “data is data, and we just need more.” Data modeling.

Data Governance 97

Data Governance Government Data Quality Change Management 97

Dataversity

DECEMBER 16, 2024

In todays digital age, managing and minimizing data collection is essential for maintaining business security. Prioritizing data privacy helps organizations ensure they only gather necessary information, reducing the risk of data breaches and misuse.

Digital 130

Digital Data Governance Data Quality Data Architecture 130

Dataversity

DECEMBER 6, 2024

In todays rapidly evolving global landscape, data sovereignty has emerged as a critical challenge for enterprises. Businesses must adapt to an increasingly complex web of requirements as countries around the world tighten data regulations in an effort to ensure compliance and protect against cyberattacks.

Data Governance 130

Data Governance Data Quality Data Architecture Government 130

Dataversity

AUGUST 30, 2024

Master data lays the foundation for your supplier and customer relationships. However, teams often fail to reap the full benefits […] The post How to Win the War Against Bad Master Data appeared first on DATAVERSITY.

Master Data Management 264

Master Data Management Data Quality Data Governance Data Architecture 264

Dataversity

DECEMBER 11, 2023

Organizations learned a valuable lesson in 2023: It isn’t sufficient to rely on securing data once it has landed in a cloud data warehouse or analytical store. As a result, data owners are highly motivated to explore technologies in 2024 that can protect data from the moment it begins its journey in the source systems.

Data Governance 278

Data Governance Government Data Warehouse Data Quality 278

Dataversity

FEBRUARY 28, 2024

In our increasingly digital world, organizations recognize the importance of securing their data. As cloud-based technologies proliferate, the need for a robust identity and access management (IAM) strategy is more critical than ever.

Digital 276

Digital Data Governance Data Quality Data Architecture 276

Dataversity

JANUARY 8, 2024

This is my monthly check-in to share with you the people and ideas I encounter as a data evangelist with DATAVERSITY. This month, we’re talking about data mesh. Data mesh represents a federated model of running your data program. I’m Mark Horseman, and welcome to The Cool Kids Corner.

Data Governance 264

Data Governance Data Architecture Data Quality Government 264

Dataversity

JULY 9, 2024

OpenAI launched generative AI (GenAI) into the mainstream last year, and we haven’t stopped talking about it since – and for good reason. When done right, its benefits are indisputable, saving businesses time, money, and resources. Industries from customer service to technology are experiencing the shift.

Data Governance 242

Data Governance Data Quality Data Architecture Government 242

Dataversity

MARCH 13, 2023

Companies are spending a lot of money on data and analytics capabilities, creating more and more data products for people inside and outside the company. These products rely on a tangle of data pipelines, each a choreography of software executions transporting data from one place to another.

Monitoring 246

Monitoring Data Quality Data Governance Data Architecture 246

The Data Administration Newsletter

SEPTEMBER 4, 2024

There are many perennial issues with data: data quality, data access, data provenance, and data meaning. I will contend in this article that the central issue around which these others revolve is data complexity. It’s the complexity of data that creates and perpetuates these other problems.

Data Quality 52

Data Quality Data Governance Big Data Data Architecture 52

Dataversity

JANUARY 12, 2022

Technology generates more and more data, regulators need to exercise more and more control, digital transformation is advancing, and traditional firms are changing and need to respond quickly to the new demands of regulators – not only to avoid sanctions but also to guard their processes and avoid security breaches and inconsistencies in their information (..)

Digital Transformation 246

Digital Transformation Digital Data Governance Data Architecture 246

Dataversity

AUGUST 4, 2023

Generating actionable insights across growing data volumes and disconnected data silos is becoming increasingly challenging for organizations. Working across data islands leads to siloed thinking and the inability to implement critical business initiatives such as Customer, Product, or Asset 360.

Data Governance 246

Data Governance Data Architecture Data Quality Government 246

Domo

APRIL 28, 2022

Maintaining high-quality, error-free data. Many business teams do not have a clear understanding of who is responsible for maintaining data quality. And should duplicate data or errors be found, many do not know where to report quality issues. Managing permissions, access, and governance at scale.

Government 98

Government Big Data Data Governance Customer Experience 98

Dataversity

AUGUST 5, 2021

According to Gartner, data fabric is an architecture and set of data services that provides consistent functionality across a variety of environments, from on-premises to the cloud. Data fabric simplifies and integrates on-premises and cloud Data Management by accelerating digital transformation.

Digital Transformation 246

Digital Transformation Digital Data Management Data Warehouse 246

Dataversity

APRIL 30, 2021

The goal of digital transformation remains the same as ever – to become more data-driven. We have learned how to gain a competitive advantage by capturing business events in data. Events are data snap-shots of complex activity sourced from the web, customer systems, ERP transactions, social media, […].

Digital Transformation 246

Digital Transformation Digital Data Warehouse Data Governance 246

Dataversity

MAY 19, 2023

Here’s an important truth: There is no data privacy without data protection. Consumers and companies place their trust in the organizations they do business with and trust that their sensitive data will be kept private.

Data Security 246

Data Security Data Governance Data Quality Data Architecture 246

Dataversity

SEPTEMBER 27, 2021

DataOps, which focuses on automated tools throughout the ETL development cycle, responds to a huge challenge for data integration and ETL projects in general. Click to learn more about author Wayne Yaddow. ETL projects are increasingly based on agile processes and automated testing.

Agile 246

Agile Data Warehouse Data Quality Data Architecture 246

Dataversity

SEPTEMBER 20, 2021

Click to learn more about author Balaji Ganesan. Sources indicate 40% more Americans will travel in 2021 than those in 2020, meaning travel companies will collect an enormous amount of personally identifiable information (PII) from passengers engaging in “revenge” travel.

Digital 246

Digital Data Discovery Data Governance Data Quality 246

Dataversity

JUNE 14, 2022

We are living in turbulent times. Online security has always been an area of concern; however, with recent global events, the world we now live in has become increasingly cloud-centric.

Data Governance 246

Data Governance Government Documentation Artificial Intelligence 246