Understand automatic schema discovery
mainThe system uses DatasetSchema and ColumnInfo to automatically categorize data types and suggest analyses. This allows the AI to understand the structure and potential utility of a dataset without manual configuration.
Column Roles
Columns are assigned a suggested_role based on their characteristics:
numerical: Numeric data types.temporal: Datetime/date types.categorical: Low-cardinality data (where unique values < 50% of total rows).identifier: High-cardinality data where every value is unique.
Analysis Suggestions
Based on the discovered roles, the system suggests specific analysis types:
- Correlation Analysis: Suggested if there are $\ge 2$ numerical columns.
- Segmentation Analysis: Suggested if categorical columns are present.
- Time Series Analysis: Suggested if temporal columns are present.