Solution overview
With the deepening of digitalization, customers need to analyze historical data to explore business value. Such historical data is managed by diverse systems, including relational, non-relational, text, and file systems. How to efficiently integrate these diverse systems into data warehouses, optimize the quality of data with varying quality levels, conduct hierarchical governance, and then open it up to various business intelligence (BI) systems or data consumption ends, presents a series of demands such as data integration, data governance, and data opening
Challenges
Diversified Heterogeneous Data Sources
Systems from different vendors feature varying data formats and interface protocols, posing significant challenges to data collection and conversion
Inconsistent Data Quality
Historical data may be generated by machines or entered manually, with inconsistent standards in terms of uniformity, completeness, and accuracy. Data quality exerts a substantial impact on the quality of business analysis
High Threshold for Data Governance
Data governance requires high proficiency in SQL and scripting languages. Reducing the operational threshold to enable quick data understanding and efficient governance is a key challenge
High Risks of Data Security
Different data source systems manage data permissions independently. Effectively controlling permissions for integrated and open data in data warehouses is a critical issue
Solution Advantages
High-Performance Distributed Data Warehouse Storage and Computing Engine
HexaDB-A (Analytic Edition) supports a fully parallel vectorized storage and computing engine, with TPCH benchmark test results outperforming mainstream industry data warehouse products
High-Performance Integration of Over 40 Heterogeneous Data Sources
HexaDB-A (Analytic Edition) is deeply integrated with Luban and Liquid, supporting the integration of multiple heterogeneous data sources, RPA integration, and real-time data integration
Multi-Dimensional Data Quality Cleaning and Optimization
Built-in quality inspection and optimization across six dimensions: completeness, timeliness, accuracy, validity, consistency, and uniqueness; featuring industry-leading massive data deduplication capabilities
Efficient and Intelligent Governance Task Orchestration
Luban, based on a microservices architecture, offers visual task orchestration, error handling, data lineage detection, and an intelligent task scheduling engine, supporting up to 1,000+ concurrent tasks in a single cluster
Low-Threshold Data Governance Delivery
Low-code governance task development, supporting multiple task definition methods such as SQL and scripts; integrating NL2SQL (Natural Language to SQL) technology to enable data governance development via natural language input
Role and Permission Control
Luban is integrated with HexaDB Database, supporting system-level permission management as well as row and column-level permission management for business data, along with data watermarking and dynamic desensitization
Customer Cases
