Analysis Overview
Analysis overview and configuration
| Parameter | Value | _row |
|---|---|---|
| outlier_method | iqr | outlier_method |
| outlier_threshold | 1.5 | outlier_threshold |
| correlation_method | pearson | correlation_method |
| correlation_threshold | 0.7 | correlation_threshold |
| alpha | 0.05 | alpha |
| max_categories | 20 | max_categories |
| missing_warn_threshold | 0.05 | missing_warn_threshold |
| missing_critical_threshold | 0.3 | missing_critical_threshold |
Purpose
This analysis provides a comprehensive data quality and statistical profile of a 500-row, 31-column dataset. The objective is to automatically characterize the dataset's structure, completeness, distributions, and relationships to establish a baseline understanding before deeper analytical work. This foundational assessment ensures data reliability and identifies potential issues early.
Key Findings
- Data Quality Score: 97.7% - Exceptionally clean dataset with zero missing values across all 500 observations and 31 variables
- Column Composition: 12 numeric and 19 categorical columns with no high-cardinality categorical variables, indicating manageable dimensionality
- Correlation Structure: 4 high-correlation pairs identified, primarily among tenure-related variables (YearsWithCurrManager correlates 0.77 with YearsAtCompany and 0.74 with YearsInCurrentRole)
- Outlier Prevalence: 6 columns contain outliers; 97.7% of values are normal, 2.4% are mild outliers, and 0.3% are extreme outliers
- Distribution Skewness: Numeric values show moderate positive skew (mean 1.23), suggesting right-tailed distributions in several variables
Interpretation
The dataset exhibits exceptional data quality with complete coverage and minimal data integrity issues. The low
Data preprocessing and column mapping
Purpose
This section documents the data preprocessing pipeline applied to the 500-row dataset before analysis. It demonstrates data integrity through the preprocessing stage and establishes the foundation for the statistical analysis and outlier detection performed across 31 columns with a 97.7% data quality score.
Key Findings
- Retention Rate: 100% (500/500 rows retained) - No observations were removed during cleaning, indicating either pristine input data or minimal preprocessing requirements
- Rows Removed: 0 - Zero data loss suggests no duplicate records, invalid entries, or rows failing quality thresholds were detected
- Data Quality Score: 97.7% - Exceptionally high quality aligns with zero missing values across all 31 columns, supporting reliable downstream analysis
- Train/Test Split: Not specified - No explicit model training/validation split documented, suggesting this is exploratory analysis rather than predictive modeling
Interpretation
The complete retention of all 500 observations indicates the dataset arrived in excellent condition with no data quality issues requiring removal. Combined with the 0% overall missing rate and 97.7% quality score, this suggests the data preprocessing phase was minimal—primarily validation rather than transformation. This clean state enables confident statistical analysis, correlation assessment, and outlier detection without concerns about data loss biasing results.
Context
The absence of documented train/test splits indicates this analysis focuses
Executive Summary
Executive summary and recommended next steps
| Metric | Value |
|---|---|
| Total Rows | 500 |
| Total Columns | 31 |
| Numeric Columns | 12 |
| Categorical Columns | 19 |
| Missing Data % | 0.00% |
| Data Quality Score | 97.7/100 |
| High Correlations | 4 |
| Columns with Outliers | 6 |
Dataset Characteristics:
• 500 rows × 31 columns (12 numeric, 19 categorical)
• Missing data: 0.00% overall
• Data quality score: 97.7/100
Key Findings:
• 4 high correlation pairs detected
• 6 columns with outliers
• 0 high-cardinality categoricals
Recommended Next Steps:
• ANOVA or Chi-Square tests (categorical grouping variables)
• Address multicollinearity before regression (drop redundant features)
• Outlier investigation (verify data entry, consider robust methods)
EXECUTIVE SUMMARY
Purpose
This section synthesizes the complete data quality and structural assessment of a 500-row, 31-column dataset. Understanding these foundational metrics is critical for determining whether the data is suitable for downstream analysis and what preprocessing steps are required before modeling or statistical testing.
Key Findings
- Data Quality Score: 97.7/100 – Exceptionally clean dataset with minimal data integrity issues
- Missing Data: 0.00% overall – Complete dataset with no gaps requiring imputation
- High Correlation Pairs: 4 detected (|r| > 0.70) – Indicates potential multicollinearity between features, particularly among tenure-related variables (YearsWithCurrManager, YearsAtCompany, YearsInCurrentRole)
- Outlier Prevalence: 6 columns contain outliers; 97.7% of values are normal, 2.4% are mild/extreme – Manageable outlier burden
- Categorical Structure: 19 categorical variables with 0 high-cardinality columns – Well-balanced categorical feature space
Interpretation
This dataset demonstrates exceptional data quality with zero missing values and a 97.7 quality score, indicating minimal data entry errors or structural problems. The presence of 4 high-correlation pairs suggests redundancy in tenure-related
Column Profiles
Per-column statistics and type detection results
| column_name | detected_type | unique_values | missing_count | missing_pct | min_value | max_value | mean_value | median_value | std_dev |
|---|---|---|---|---|---|---|---|---|---|
| Age | numeric | 43 | 0 | 0 | 18 | 60 | 36.9 | 36 | 9.36 |
| Attrition | categorical | 2 | 0 | 0 | |||||
| BusinessTravel | categorical | 3 | 0 | 0 | |||||
| DailyRate | numeric | 415 | 0 | 0 | 103 | 1499 | 838.9 | 843 | 408.8 |
| Department | categorical | 3 | 0 | 0 | |||||
| DistanceFromHome | numeric | 29 | 0 | 0 | 1 | 29 | 9.12 | 6 | 8.255 |
| Education | categorical | 5 | 0 | 0 | |||||
| EducationField | categorical | 6 | 0 | 0 | |||||
| EnvironmentSatisfaction | categorical | 4 | 0 | 0 | |||||
| Gender | categorical | 2 | 0 | 0 | |||||
| HourlyRate | numeric | 71 | 0 | 0 | 30 | 100 | 65.74 | 66 | 20.6 |
| JobInvolvement | categorical | 4 | 0 | 0 | |||||
| JobLevel | categorical | 5 | 0 | 0 | |||||
| JobRole | categorical | 9 | 0 | 0 | |||||
| JobSatisfaction | categorical | 4 | 0 | 0 | |||||
| MaritalStatus | categorical | 3 | 0 | 0 | |||||
| MonthlyIncome | numeric | 482 | 0 | 0 | 1102 | 19999 | 6599 | 4952 | 4815 |
| MonthlyRate | numeric | 497 | 0 | 0 | 2094 | 26959 | 1.416e+04 | 14174 | 7003 |
| NumCompaniesWorked | categorical | 10 | 0 | 0 | |||||
| OverTime | categorical | 2 | 0 | 0 | |||||
| PercentSalaryHike | numeric | 15 | 0 | 0 | 11 | 25 | 15.22 | 14 | 3.729 |
| PerformanceRating | categorical | 2 | 0 | 0 | |||||
| RelationshipSatisfaction | categorical | 4 | 0 | 0 | |||||
| StockOptionLevel | categorical | 4 | 0 | 0 | |||||
| TotalWorkingYears | numeric | 38 | 0 | 0 | 0 | 40 | 11.46 | 10 | 7.777 |
| TrainingTimesLastYear | categorical | 7 | 0 | 0 | |||||
| WorkLifeBalance | categorical | 4 | 0 | 0 | |||||
| YearsAtCompany | numeric | 33 | 0 | 0 | 0 | 40 | 7.038 | 5 | 6.458 |
| YearsInCurrentRole | numeric | 19 | 0 | 0 | 0 | 18 | 4.238 | 3 | 3.72 |
| YearsSinceLastPromotion | numeric | 15 | 0 | 0 | 0 | 15 | 2.194 | 1 | 3.275 |
| YearsWithCurrManager | numeric | 16 | 0 | 0 | 0 | 17 | 4.184 | 3 | 3.576 |
Purpose
This section provides a structural overview of the dataset's composition, identifying which columns are numeric versus categorical. Understanding column types is foundational for selecting appropriate statistical methods, interpreting distributions, and detecting data quality issues across the 500-row dataset.
Key Findings
- Total Columns: 31 columns analyzed with clear type separation
- Numeric Columns: 12 columns suitable for correlation, regression, and outlier detection
- Categorical Columns: 19 columns appropriate for frequency analysis and cross-tabulation
- Missing Data: 0% overall missing rate indicates complete data integrity across all columns
- Data Quality Score: 97.7% reflects high-quality, analysis-ready data with minimal anomalies
Interpretation
The dataset demonstrates balanced composition between numeric and categorical variables, enabling comprehensive multivariate analysis. The absence of missing values eliminates imputation concerns and ensures all 500 observations are usable across all 31 dimensions. The high data quality score validates that the subsequent correlation analysis (4 high-correlation pairs identified) and outlier detection (6 columns with outliers) are based on reliable, complete information.
Context
The column profile table appears empty in the provided summary, suggesting detailed per-column statistics are available elsewhere in the analysis framework. The type detection logic applied here (numeric >10 unique values; categorical ≤10
Distribution Analysis
Data distributions: histograms for numeric, bar charts for categorical
Purpose
This section visualizes how values are distributed across the 31 variables in the dataset (12 numeric, 19 categorical). Distribution analysis reveals data shape, concentration patterns, and potential data quality issues—essential for understanding whether variables are suitable for modeling and whether transformations are needed.
Key Findings
- Right Skew (1.23): Numeric distributions show moderate positive skew, indicating right-tailed patterns where extreme high values pull the mean above the median (mean=2325 vs median=24.25).
- Bin Frequency Imbalance: Count values range 0–422 with high variance (sd=68.13), showing uneven population across bins; some intervals contain zero observations.
- Categorical Dominance: 75.3% of categorical data concentrates in empty/missing categories, suggesting sparse representation in certain categorical variables.
- Multimodal Pattern: Age distribution shows peaks at intervals (10, 14, 23, 27 counts), indicating potential subgroups or cohorts within the workforce.
Interpretation
The moderate right skew across numeric variables suggests natural business metrics (income, rates, tenure) follow typical organizational patterns where most values cluster at lower ranges with occasional high outliers. The uneven bin distribution and categorical sparsity indicate that some variables may have limited discriminative power for analysis. The multi
Missing Data Patterns
Missing data patterns and co-occurrence
Purpose
This section evaluates data completeness across all 500 rows and 31 columns to identify missing value patterns that could compromise analysis validity. Understanding missingness is critical for determining whether data can be analyzed as-is or requires imputation, and for detecting systematic collection issues that might bias results.
Key Findings
- Total Missing Values: 0 (0.00% of all cells) – The dataset is completely complete with no gaps across any row or column
- Missing Pattern Type: No vertical bands, horizontal bands, or random speckles detected – absence of systematic or random missingness patterns
- Data Integrity: All 15,500 cell observations (500 rows × 31 columns) contain valid values with no MCAR, MAR, or MNAR mechanisms present
Interpretation
The absence of missing data eliminates a major source of analytical bias and simplifies downstream processing. With zero missingness, there is no need to investigate collection failures, survey skip logic, or imputation strategies. This complete dataset enables direct statistical analysis without the complications of handling incomplete information, making correlation analysis, outlier detection, and distribution assessment more straightforward and reliable.
Context
This perfect completeness is relatively rare in real-world datasets and suggests either careful data collection practices or pre-processing that removed incomplete records. The finding directly supports the high **data quality score of 97.7%
Correlation Matrix
Correlation matrix for numeric variables with hierarchical clustering
Purpose
This section identifies multicollinearity in the dataset by detecting strong linear relationships among numeric variables. Understanding these correlations is critical for predictive modeling, as highly correlated variables can inflate standard errors, reduce model interpretability, and create redundancy in feature sets. This analysis directly supports the overall data quality assessment (97.7% score) by flagging potential structural issues.
Key Findings
- High Correlation Pairs: 4 pairs identified with |r| ≥ 0.7, indicating moderate-to-strong redundancy among tenure-related variables
- YearsWithCurrManager Relationships: Shows strong correlations with YearsAtCompany (0.77) and YearsInCurrentRole (0.74), suggesting these variables capture overlapping information about employee tenure
- Overall Correlation Range: Mean correlation of 0.22 across all pairs indicates most variables are relatively independent, with only tenure metrics showing clustering
- Perfect Correlations: Diagonal values of 1.0 represent expected self-correlations, not data issues
Interpretation
The dataset exhibits localized multicollinearity concentrated in tenure-related variables rather than systemic redundancy. The four high-correlation pairs suggest that years with current manager, years at company, and years in current role measure related but distinct aspects of employee tenure. This pattern is typical in HR datasets and
Outlier Detection
IQR-based outlier detection for numeric variables
Purpose
This section identifies and classifies anomalous values in numeric variables using the Interquartile Range (IQR) method. Outlier detection is critical for understanding data distribution shape, identifying potential data quality issues, and determining whether statistical transformations or specialized modeling approaches are needed for accurate analysis.
Key Findings
- Columns with Outliers: 6 numeric variables flagged - indicates moderate presence of extreme values across the dataset
- Outlier Distribution: 97.7% normal values, 2% mild outliers (120 cases), 0.3% extreme outliers (17 cases) - highly concentrated in the tails
- Value Range Skewness: Mean of 1,812.58 vs. median of 15 suggests right-skewed distributions with high-value outliers pulling the mean upward
- IQR Bounds Variability: Upper bounds range from 7.5 to 37,446.88, indicating heterogeneous spread across numeric columns
Interpretation
The dataset exhibits minimal but meaningful outlier presence (2.3% total), concentrated in 6 numeric columns. The 17 extreme outliers warrant verification but represent <0.6% of observations, suggesting they are genuine data points rather than systematic errors. The right-skewed distribution pattern (skewness=1.12) indicates
Categorical Breakdown
Frequency analysis and cardinality warnings for categorical variables
Purpose
This section evaluates the distribution and quality of categorical variables across the dataset. It identifies class imbalance patterns and cardinality issues that could affect model performance and interpretability. Understanding categorical structure is essential for feature engineering and ensuring meaningful variation in predictive analysis.
Key Findings
- Categorical Columns: 19 variables analyzed with 0 high-cardinality fields (>20 unique values), indicating clean, manageable categorical data
- Class Imbalance Detected: Attrition shows 84.4% "No" vs. 15.6% "Yes"—severe imbalance suggesting predictive modeling challenges
- Dominant Categories: BusinessTravel (71.2% "Travel_Rarely") and WorkLifeBalance (61.6% rating "3") exhibit strong skew toward single categories
- Distribution Pattern: Mean category frequency of 114.46 with right skew (0.86) indicates uneven representation across categories
Interpretation
The absence of high-cardinality variables simplifies analysis and reduces preprocessing burden. However, pronounced class imbalance in key variables like Attrition limits discriminative power—models may struggle to learn minority patterns. The concentration of observations in dominant categories (e.g., 71% rarely travel) reflects real-world distributions but reduces variation available for distinguishing between groups.
Context
Data Quality Score
Overall data quality assessment
Scoring Logic:
• Start: 100 points
• Deduct: -10 points per 10% missing data
• Deduct: -5 points per 10% outliers (numeric columns)
Score Interpretation:
• 90-100: Excellent - ready for analysis
• 70-89: Good - minor cleanup recommended
• 50-69: Fair - significant data issues to address
• <50: Poor - major data quality problems
✅ Your data is high quality and ready for analysis.
Purpose
This section evaluates the overall integrity and completeness of your dataset before analysis. A high data quality score indicates minimal data issues, enabling reliable statistical analysis and meaningful insights. This foundational assessment determines whether the dataset is suitable for downstream analytical work without extensive preprocessing.
Key Findings
- Data Quality Score: 97.7/100 - Falls in the "Excellent" range (90-100), indicating the dataset is production-ready
- Missing Data: 0% across all 500 rows and 31 columns - Complete dataset with no gaps
- Outliers: 2.3% of numeric values flagged (120 mild, 17 extreme) - Minimal contamination within acceptable thresholds
- Data Completeness: Zero deductions applied; score reflects only minor outlier presence
Interpretation
The dataset demonstrates exceptional quality with zero missing values and negligible outlier contamination. This pristine condition suggests the data has been well-curated or preprocessed before analysis. The 97.7 score reflects only the natural presence of statistical outliers (2.3%), which is expected in real-world distributions and does not warrant removal. This quality level supports confident analysis across all 12 numeric and 19 categorical variables without data imputation or extensive cleaning.
Context
The scoring methodology prioritizes completeness and outlier detection. The absence of missing