Media Summary: BERT & GPT - Word embedding review - Contextualized word embedding (ELMo, GPT-1, BERT) - GPT-2 & GPT-3 & ChatGPT ... Transformer - Self-attention - Multi-head attention - Transformer (encoder) - Positional encoding - Sequence-to-sequence with ... Transformers - Prepare input - Implement Transformer - Train and Evaluate - Visualize attention.
Programming For Ai Ai504 Fall - Detailed Analysis & Overview
BERT & GPT - Word embedding review - Contextualized word embedding (ELMo, GPT-1, BERT) - GPT-2 & GPT-3 & ChatGPT ... Transformer - Self-attention - Multi-head attention - Transformer (encoder) - Positional encoding - Sequence-to-sequence with ... Transformers - Prepare input - Implement Transformer - Train and Evaluate - Visualize attention. Basic Machine Learning: - Data plotting using Matplotlib - Generating samples - Regression (overfitting, underfitting) - Loading the ... Project 2 Announcement: Language Modeling. Generative Adversarial Network - GAN - VAE vs Autoregressive vs GAN (vs Diffusion) - Evaluation - Applications of GAN.
Introduction to Numpy: - Scalars, vectors, matrices, tensors - Defining N-dimensional arrays - Indexing, slicing - Math operations ... Basic machine learning: - Supervised, unsupervised, reinforcement learning - Optimization: Objective function, loss function, ... Deep Diffusion Probabilistic Model - Generative model recap - DDPM - Generalized DDPM (DDIM) - Classifier guided diffusion ... Project 1 Announcement: Image Classification. Convolutional Neural Networks - Practice session (implementing and training ResNet) - CNN architectures. Diffusion Model - DDPM recap - DDPM implementation.
PyTorch & Neural Networks: - PyTorch intro (comparison with NumPy) - PyTorch autograd - PyTorch modules - MNIST ...
