Regression, correlation, and curve fitting.
| Area | Key Idea | Representative Method | |------|----------|------------------------| | | (p) comparable or larger than (n) | Lasso, Ridge, Elastic Net | | Non‑parametric inference | Infinite‑dimensional parameter spaces | Kernel density estimation, empirical processes | | Robust statistics | Resistance to outliers/model misspecification | M‑estimators, Huber loss | | Sequential analysis | Data accrue over time; early stopping | SPRT, Bayesian monitoring | | Causal inference | Distinguish correlation from causation | Potential outcomes, instrumental variables | | Machine learning theory | Statistical guarantees for algorithms | VC dimension, Rademacher complexity, PAC bounds | Regression, correlation, and curve fitting