Master programming syntax, solve interactive challenges & run live code in Syntaxis Explore Arena →

menu_book Course Curriculum (Machine Learning) expand_more

Data Preparation

Train test split Feature matrix and target Standard scaling Min-max scaling One-hot encoding Ordinal encoding Missing value imputation Pipeline preprocessing

Regression

Linear regression Ridge regression Lasso regression Polynomial features Mean squared error Mean absolute error R squared Residual inspection

Classification

Logistic regression Decision tree classifier Random forest classifier K nearest neighbors Support vector classifier Naive Bayes Probability prediction Decision threshold

Evaluation

Accuracy Precision Recall F1 score Confusion matrix ROC AUC Cross validation Stratified split

Unsupervised Learning

K-means clustering Cluster inertia Silhouette score DBSCAN Principal component analysis Explained variance Nearest neighbors search Anomaly detection

Feature Engineering

Interaction feature Log transform Binning Polynomial feature expansion Feature selection Mutual information Permutation importance Class weighting

Model Selection

Grid search Randomized search Validation curve Learning curve Baseline model Bias variance tradeoff Overfitting check Underfitting check

Production

Serialize model Load model Batch prediction Single prediction API shape Drift metric Input schema check Reproducible random state Model version metadata

Machine Learning / Feature Engineering

Mutual information

Learn Mutual information in Machine Learning with a dedicated explanation, a topic-specific example, edge guidance, and a mastery check.

12 min read • Intermediate

machine-learning-046.py

python

from sklearn.feature_selection import mutual_info_classif
scores=mutual_info_classif(X_train,y_train,random_state=42)

What to watch

Content source & attribution

Original Syntaxis Content · Original Syntaxis Content

Lesson quizzes

Mutual information Mastery Check →

Feature selection

Permutation importance