Change Log Entry for Waii Version 1.9.0
New Feature: Automatic Join Relationship Prediction
We are excited to announce a significant enhancement in version 1.9.0 of Waii, introducing our new feature: Automatic Join Relationship Prediction. This capability is designed to simplify the work and data modeling required to set up Waii, giving you much better out-of-the-box experiences in generating precise SQL queries through our API.
Problem Addressed:
Understanding table relationships within a relational database is essential for generating accurate queries. Previously, Waii users needed to manually add these relationships to the database in many cases. OLAP systems like Snowflake oftentimes don't enforce or use primary key / foreign key constraints, so naturally many opt not to include those in the database definition. This gap often led to challenges in finding the right data and generating correct code to answer specific queries.
Our Solution:
Waii now leverages a sophisticated combination of mechanisms, including Large Language Models (LLMs), naming conventions, data samples, query history, statistical measures (notably number of distinct values or ndv), and validation checks. This approach allows Waii to predict join relationships automatically, ensuring users can generate the correct queries out of the box, without delving into the intricacies of their data model.
Benefits of the New Feature:
Automatic Discovery: When you connect your database to Waii, our system automatically constructs the correct join information based on the available metadata and data samples.
Enhanced Accuracy: By understanding both the existence and meaning of table relationships, Waii ensures that users can retrieve the right data and generate the appropriate queries to answer their questions efficiently.
Optimized Performance: This feature is designed to provide good join performance out of the box, simplifying the query generation process and enhancing the overall user experience.
How It Works:
The feature operates seamlessly in the background. Once your database is connected to Waii, our algorithms immediately begin analyzing your database's schema, query logs, and data characteristics to build a comprehensive understanding of potential join relationships. This process is entirely automatic, requiring no additional effort from the user, yet it offers profound insights and capabilities that were previously unattainable.
We are committed to continuously enhancing the capabilities of Waii to meet the evolving needs of our users. This feature is a testament to our dedication to innovation, aiming to simplify the complexities of database management and query generation for developers and analysts alike.