Finetuning LLM
# Instruct Finetuning Datasets # Some datasets for you to try #pretrained_dataset = load_dataset("EleutherAI/pile", split="train", streaming=True) pretrained_dataset = load_dataset("c4"...
AI Notes
Mastering Gradients, `zero_grad`, and Optimizers in PyTorch
Mastering Gradients, zero_grad, and Optimizers in PyTorch A practical guide to what actually happens under the hood when you train a neural network in PyTorch—and how to take full control of it...
SVM
Q&A What is a Support Vector Machine (SVM)? A Support Vector Machine (SVM) is a supervised machine learning algorithm used for classification and regression tasks. It works by find...
RNN
Q&A What is RNN? A Recurrent Neural Network (RNN) is a type of artificial neural network designed for processing sequences of data. Unlike traditional neural networks, RNNs have connections t...
NLP
Q&A Read in the texts of the State of the Union addresses, using the state_union corpus reader. Count occurrences of men, women, and people in each document. What has happened to the...
Machine Learning Notes
# each algo optimization function there working and comparison l1 l2 regularization Supervised Learning http://www.stat.yale.edu/Courses/1997-98/101/linreg.htm#:~:text=A%20linear%20regression%2...
Machine Learning Library
# https://scikit-learn.org/stable/modules/linear_model.html Linear Models The following are a set of methods intended for regression in which the target value is expected to be a linear combinatio...
Linear Regression
Q&A What is Gradient Descent in Machine Learning? #### Gradient Gradient descent is an optimization algorithm used to minimize a function by iteratively moving towards the steepest des...
K-Means
Q&A
Deep Learning
Q&A How are overfitting and underfitting handled in deep learning? **Overfitting**: Overfitting occurs when a deep learning model learns the noise in the training data rather than ...