Analysis overview and configuration
| Parameter | Value | _row |
|---|---|---|
| outlier_method | iqr | outlier_method |
| outlier_threshold | 1.5 | outlier_threshold |
| correlation_method | pearson | correlation_method |
| correlation_threshold | 0.7 | correlation_threshold |
| alpha | 0.05 | alpha |
| max_categories | 20 | max_categories |
| missing_warn_threshold | 0.05 | missing_warn_threshold |
| missing_critical_threshold | 0.3 | missing_critical_threshold |
This analysis provides a comprehensive data quality and statistical profile of a 500-row, 31-column dataset. The objective is to automatically characterize the dataset's structure, completeness, distributions, and relationships to establish a baseline understanding before deeper analytical work. This foundational assessment ensures data reliability and identifies potential issues early.
The dataset exhibits exceptional data quality with complete coverage and minimal data integrity issues. The low
Data preprocessing and column mapping
| Metric | Value |
|---|---|
| Initial Rows | 500 |
| Final Rows | 500 |
| Rows Removed | 0 |
| Retention Rate | 100% |
This section documents the data preprocessing pipeline applied to the 500-row dataset before analysis. It demonstrates data integrity through the preprocessing stage and establishes the foundation for the statistical analysis and outlier detection performed across 31 columns with a 97.7% data quality score.
The complete retention of all 500 observations indicates the dataset arrived in excellent condition with no data quality issues requiring removal. Combined with the 0% overall missing rate and 97.7% quality score, this suggests the data preprocessing phase was minimal—primarily validation rather than transformation. This clean state enables confident statistical analysis, correlation assessment, and outlier detection without concerns about data loss biasing results.
The absence of documented train/test splits indicates this analysis focuses
| Metric | Value |
|---|---|
| Total Rows | 500 |
| Total Columns | 31 |
| Numeric Columns | 12 |
| Categorical Columns | 19 |
| Missing Data % | 0.00% |
| Data Quality Score | 97.7/100 |
| High Correlations | 4 |
| Columns with Outliers | 6 |
This section synthesizes the complete data quality and structural assessment of a 500-row, 31-column dataset. Understanding these foundational metrics is critical for determining whether the data is suitable for downstream analysis and what preprocessing steps are required before modeling or statistical testing.
This dataset demonstrates exceptional data quality with zero missing values and a 97.7 quality score, indicating minimal data entry errors or structural problems. The presence of 4 high-correlation pairs suggests redundancy in tenure-related
Per-column statistics and type detection results
| column_name | detected_type | unique_values | missing_count | missing_pct | min_value | max_value | mean_value | median_value | std_dev |
|---|---|---|---|---|---|---|---|---|---|
| Age | numeric | 43 | 0 | 0 | 18 | 60 | 36.9 | 36 | 9.36 |
| Attrition | categorical | 2 | 0 | 0 | |||||
| BusinessTravel | categorical | 3 | 0 | 0 | |||||
| DailyRate | numeric | 415 | 0 | 0 | 103 | 1499 | 838.9 | 843 | 408.8 |
| Department | categorical | 3 | 0 | 0 | |||||
| DistanceFromHome | numeric | 29 | 0 | 0 | 1 | 29 | 9.12 | 6 | 8.255 |
| Education | categorical | 5 | 0 | 0 | |||||
| EducationField | categorical | 6 | 0 | 0 | |||||
| EnvironmentSatisfaction | categorical | 4 | 0 | 0 | |||||
| Gender | categorical | 2 | 0 | 0 | |||||
| HourlyRate | numeric | 71 | 0 | 0 | 30 | 100 | 65.74 | 66 | 20.6 |
| JobInvolvement | categorical | 4 | 0 | 0 | |||||
| JobLevel | categorical | 5 | 0 | 0 | |||||
| JobRole | categorical | 9 | 0 | 0 | |||||
| JobSatisfaction | categorical | 4 | 0 | 0 | |||||
| MaritalStatus | categorical | 3 | 0 | 0 | |||||
| MonthlyIncome | numeric | 482 | 0 | 0 | 1102 | 19999 | 6599 | 4952 | 4815 |
| MonthlyRate | numeric | 497 | 0 | 0 | 2094 | 26959 | 1.416e+04 | 14174 | 7003 |
| NumCompaniesWorked | categorical | 10 | 0 | 0 | |||||
| OverTime | categorical | 2 | 0 | 0 | |||||
| PercentSalaryHike | numeric | 15 | 0 | 0 | 11 | 25 | 15.22 | 14 | 3.729 |
| PerformanceRating | categorical | 2 | 0 | 0 | |||||
| RelationshipSatisfaction | categorical | 4 | 0 | 0 | |||||
| StockOptionLevel | categorical | 4 | 0 | 0 | |||||
| TotalWorkingYears | numeric | 38 | 0 | 0 | 0 | 40 | 11.46 | 10 | 7.777 |
| TrainingTimesLastYear | categorical | 7 | 0 | 0 | |||||
| WorkLifeBalance | categorical | 4 | 0 | 0 | |||||
| YearsAtCompany | numeric | 33 | 0 | 0 | 0 | 40 | 7.038 | 5 | 6.458 |
| YearsInCurrentRole | numeric | 19 | 0 | 0 | 0 | 18 | 4.238 | 3 | 3.72 |
| YearsSinceLastPromotion | numeric | 15 | 0 | 0 | 0 | 15 | 2.194 | 1 | 3.275 |
| YearsWithCurrManager | numeric | 16 | 0 | 0 | 0 | 17 | 4.184 | 3 | 3.576 |
This section provides a structural overview of the dataset's composition, identifying which columns are numeric versus categorical. Understanding column types is foundational for selecting appropriate statistical methods, interpreting distributions, and detecting data quality issues across the 500-row dataset.
The dataset demonstrates balanced composition between numeric and categorical variables, enabling comprehensive multivariate analysis. The absence of missing values eliminates imputation concerns and ensures all 500 observations are usable across all 31 dimensions. The high data quality score validates that the subsequent correlation analysis (4 high-correlation pairs identified) and outlier detection (6 columns with outliers) are based on reliable, complete information.
The column profile table appears empty in the provided summary, suggesting detailed per-column statistics are available elsewhere in the analysis framework. The type detection logic applied here (numeric >10 unique values; categorical ≤10
Data distributions: histograms for numeric, bar charts for categorical
This section visualizes how values are distributed across the 31 variables in the dataset (12 numeric, 19 categorical). Distribution analysis reveals data shape, concentration patterns, and potential data quality issues—essential for understanding whether variables are suitable for modeling and whether transformations are needed.
The moderate right skew across numeric variables suggests natural business metrics (income, rates, tenure) follow typical organizational patterns where most values cluster at lower ranges with occasional high outliers. The uneven bin distribution and categorical sparsity indicate that some variables may have limited discriminative power for analysis. The multi
Missing data patterns and co-occurrence
This section evaluates data completeness across all 500 rows and 31 columns to identify missing value patterns that could compromise analysis validity. Understanding missingness is critical for determining whether data can be analyzed as-is or requires imputation, and for detecting systematic collection issues that might bias results.
The absence of missing data eliminates a major source of analytical bias and simplifies downstream processing. With zero missingness, there is no need to investigate collection failures, survey skip logic, or imputation strategies. This complete dataset enables direct statistical analysis without the complications of handling incomplete information, making correlation analysis, outlier detection, and distribution assessment more straightforward and reliable.
This perfect completeness is relatively rare in real-world datasets and suggests either careful data collection practices or pre-processing that removed incomplete records. The finding directly supports the high **data quality score of 97.7%
Correlation matrix for numeric variables with hierarchical clustering
This section identifies multicollinearity in the dataset by detecting strong linear relationships among numeric variables. Understanding these correlations is critical for predictive modeling, as highly correlated variables can inflate standard errors, reduce model interpretability, and create redundancy in feature sets. This analysis directly supports the overall data quality assessment (97.7% score) by flagging potential structural issues.
The dataset exhibits localized multicollinearity concentrated in tenure-related variables rather than systemic redundancy. The four high-correlation pairs suggest that years with current manager, years at company, and years in current role measure related but distinct aspects of employee tenure. This pattern is typical in HR datasets and
IQR-based outlier detection for numeric variables
This section identifies and classifies anomalous values in numeric variables using the Interquartile Range (IQR) method. Outlier detection is critical for understanding data distribution shape, identifying potential data quality issues, and determining whether statistical transformations or specialized modeling approaches are needed for accurate analysis.
The dataset exhibits minimal but meaningful outlier presence (2.3% total), concentrated in 6 numeric columns. The 17 extreme outliers warrant verification but represent <0.6% of observations, suggesting they are genuine data points rather than systematic errors. The right-skewed distribution pattern (skewness=1.12) indicates
Frequency analysis and cardinality warnings for categorical variables
This section evaluates the distribution and quality of categorical variables across the dataset. It identifies class imbalance patterns and cardinality issues that could affect model performance and interpretability. Understanding categorical structure is essential for feature engineering and ensuring meaningful variation in predictive analysis.
The absence of high-cardinality variables simplifies analysis and reduces preprocessing burden. However, pronounced class imbalance in key variables like Attrition limits discriminative power—models may struggle to learn minority patterns. The concentration of observations in dominant categories (e.g., 71% rarely travel) reflects real-world distributions but reduces variation available for distinguishing between groups.
Overall data quality assessment
This section evaluates the overall integrity and completeness of your dataset before analysis. A high data quality score indicates minimal data issues, enabling reliable statistical analysis and meaningful insights. This foundational assessment determines whether the dataset is suitable for downstream analytical work without extensive preprocessing.
The dataset demonstrates exceptional quality with zero missing values and negligible outlier contamination. This pristine condition suggests the data has been well-curated or preprocessed before analysis. The 97.7 score reflects only the natural presence of statistical outliers (2.3%), which is expected in real-world distributions and does not warrant removal. This quality level supports confident analysis across all 12 numeric and 19 categorical variables without data imputation or extensive cleaning.
The scoring methodology prioritizes completeness and outlier detection. The absence of missing