Data Profiling and Cleansing

New Century Software helps pipeline operators ensure that their data is in excellent shape prior to embarking on data intensive integrity management projects. The three-phased methodology uncovers and repairs gaps in data that can impact important asset management decisions.

Phase 1: Data Profiling
Gain a clear understanding of the data integrity issues that could impact the results of your upcoming project and the steps that will be required in advance to cleanse the data. Our experienced team will conduct a series of interviews with your organization to discuss project requirements, examine existing data architecture, and locate known gaps in the data. A thorough Data Profiling analysis on a copy of your pipeline database will be presented in a detailed report as the deliverable for this phase. The report will prove valuable beyond the life of the project as a guide for future GIS data management practices.

Phase 2: Data Cleansing
Achieve reliable results from your integrity management projects and lay the groundwork for sound long-term decision making by hiring New Century for the data cleansing phase. While your GIS team stays focused on current projects, our data analysts will apply their pipeline domain knowledge and PODS data model expertise to ensure that data improvements are done right.

Phase 3: Integration
Once the improved data structure from the first two phases is in place, expand the value of the Data Profiling and Cleansing service even further by integrating additional datasets such as investigative digs, as-built surveys, ILI runs, hydrostatic test reports, CP surveys, foreign line crossing reports and maintenance inspections. This expanded data integration will validate future regulatory compliance efforts and improve decision making across the enterprise.