Overview of Machine Learning Basic Concepts
Machine learning is categorized into two primary tasks:
- Classification: Assigning instance data to appropriate categories (e.g., binary classification for detecting website hacks, multi-class classification for handwritten digit recognition).
- Regression: Predicting numerical values (e.g., stock price fluctuations, house price predictions).
Learning paradigms include:
- Supervised Learning: Algorithms where training samples have both features and target variables. Key considerations include the bias-variance tradeoff, complexity of functions relative to training data volume, dimensionality of the input space, and output values in noise.
- Unsupervised Learning: Data processing methods that analyze samples without target variables or category information. Types include Clustering (grouping similar objects) and Density Estimation.