projeduc/projeduc_ML

Machine Learning support course for ESI, Algiers, Algeria # Machine Learning This repo contains some lectures and labs presented in "Machine Learning" designed for students of "école nationale supérieure d'informatique (ESI)", Algiers, Algeria. Download here ## Full lectures - **Data preparation and models' evaluation** - Data collection - Data quality - Data integration - Data annotation - Data cleaning - Data transformation - Numerical features - Categorical features - Feature generation - Data sampling and splitting - Unbalanced data - Data splitting - Cross validation - Models' evaluation - Classification - Regression - Clustering - **Naı̈ve Bayes and hidden Markov model** - Classification models - Non-tenporal problems - Temporal problems - Discriminative models - Generative models - Naı̈ve Bayes - Estimation - Prior probability - Likelihood - Numerical application - Multinomial NB - Bernoulli NB - Normal NB - HMM - **Neural Networks** - Neuron - Network - Activation functions - Cost functions - Optimization functions - Feedforward Neural Networks (FFNN) - Multi-layers architecture - Auto-encoders - Convolutional Neural Network (CNN) - Regularization - Recurrent Neural Networks (RNN) - Architecture (RNN) - Long Short-Term Memory (LSTM) - Gated Recurrent Unit (GRU) - Attention - Attention mechanism - Multi-Head Attention - Self-attention - Transformer ## Lab supports - **Multi-class and multi-label classification** - Classification - Binary classification - Multi-class classification - Multi-label classification - Binary logistic regression - Probability estimation - Cost and Gradient - Gradient (derivation) - Parameters' update - Multi-class logistic regression - One-vs-Rest - One-vs-One - Multinomial - Multi-label logistic regression - Binary relevance - Label powerset - **Decision trees and Ensemble learning** - Decision trees - Algorithms - Stop conditions - Review - ID3 - Homogeneity of a set - Set's split - Choice of split feature - Example - CART - Homogeneity of a set - Set's split - Choice of spli …