Search for:

We aggregate information from all open source repositories to provide the most of useful open source products, from Enterprise product to small libraries across all platforms. Please search and find what you want.

Open Source Data Quality and Profiling

Posted on by Robin Ding Leave a comment Data Warehousing, Front-Ends, Information Analysis
4.8

This project is dedicated to open source data quality and data preparation solutions. Data Quality includes profiling, filtering, governance, similarity check, data enrichment alteration, real time alerting, basket analysis, bubble chart Warehouse validation, single customer view etc. defined by Strategy.

This tool is developing high performance integrated data management platform which will seamlessly do Data Integration, Data Profiling, Data Quality, Data Preparation, Dummy Data Creation, Meta Data Discovery, Anomaly Discovery, Data Cleansing, Reporting and Analytic.

It also had Hadoop ( Big data ) support to move files to/from Hadoop Grid, Create, Load and Profile Hive Tables. This project is also known as “Aggregate Profiler”

Resful API for this project is getting built as (Beta Version) https://sourceforge.net/projects/restful-api-for-osdq/

apache spark based data quality is getting built at https://sourceforge.net/projects/apache-spark-osdq/

Cloudbased voice solutions are common in enterprise networks and frustrating for operations teams to manage. Simplify VoIP monitoring by having a proactive analysis of on-prem, hybrid and UCaaS voice services. Try the ThousandEyes VoIP monitoring solution today, free.

Post Views: 510

Related Projects:

  1. OpenReports
  2. Talend Open Studio for Data Quality
  3. DB Browser
  4. Reverse Snowflake Joins
Website http://www.arrahtec.com
Tags
License Apache License V2.0
Platform BSD Linux Windows
Features
  • Teiid, Mysql, Oracle,Postgres,Access,Db2,SQL Server certified Big data support - HIVE
  • Create Hive table, Profile Hive table, Move file to/from Profiler System and Hadoop Grid
  • Fuzzy Logic based similarity check, Cardinailty check between tables and files
  • Export and import from XML, XLS or CSV format, PDF export
  • File Analysis, Regex search, Standardization, DB search
  • Complete DB Scan, SQL interface, Data Dictionary, Schema Comparison
  • Statistical Analysis, Reporting ( dimension and measure based), Ad Hoc reports and Analytics
  • Pattern Matching , DeDuplication, Case matching, Basket Analysis, Distribution Chart
  • Data generation, Data Preparation and Data masking features
  • Meta Data Information, Reverse engineering of Data Model
  • Timeliness analysis , String length analysis, KMean, Prediction, Regression
  • Address Correction, Single View of Customer, Product, Golden merge for records
  • Record Match, Linkage and Merge added based on fuzzy logic
  • Format Creation, Format Matching ( Phone, Date, String and Number), Format standardization
  • Data Preparation: Ordinal,Normalization,Bucketing,Regression
  • data masking, encryption, randomization of data