Dealing-Imbalanced-Data-UnderSampling.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Credit Card Kaggle- Handle Imbalanced Dataset\n",
    "\n",
    "### Context\n",
    "It is important that credit card companies are able to recognize fraudulent credit card transactions so that customers are not charged for items that they did not purchase.\n",
    "\n",
    "### Content\n",
    "The datasets contains transactions made by credit cards in September 2013 by european cardholders. This dataset presents transactions that occurred in two days, where we have 492 frauds out of 284,807 transactions. The dataset is highly unbalanced, the positive class (frauds) account for 0.172% of all transactions.\n",
    "\n",
    "It contains only numerical input variables which are the result of a PCA transformation. Unfortunately, due to confidentiality issues, we cannot provide the original features and more background information about the data. Features V1, V2, ... V28 are the principal components obtained with PCA, the only features which have not been transformed with PCA are 'Time' and 'Amount'. Feature 'Time' contains the seconds elapsed between each transaction and the first transaction in the dataset. The feature 'Amount' is the transaction Amount, this feature can be used for example-dependant cost-senstive learning. Feature 'Class' is the response variable and it takes value 1 in case of fraud and 0 otherwise.\n",
    "\n",
    "### Inspiration\n",
    "Identify fraudulent credit card transactions.\n",
    "\n",
    "Given the class imbalance ratio, we recommend measuring the accuracy using the Area Under the Precision-Recall Curve (AUPRC). Confusion matrix accuracy is not meaningful for unbalanced classification."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import pandas as pd\n",
    "import sklearn\n",
    "import scipy\n",
    "import matplotlib.pyplot as plt\n",
    "import seaborn as sns\n",
    "from sklearn.metrics import classification_report,accuracy_score\n",
    "from sklearn.ensemble import IsolationForest\n",
    "from sklearn.neighbors import LocalOutlierFactor\n",
    "from sklearn.svm import OneClassSVM\n",
    "from pylab import rcParams\n",
    "rcParams['figure.figsize'] = 14, 8\n",
    "RANDOM_SEED = 42\n",
    "LABELS = [\"Normal\", \"Fraud\"]\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Time</th>\n",
       "      <th>V1</th>\n",
       "      <th>V2</th>\n",
       "      <th>V3</th>\n",
       "      <th>V4</th>\n",
       "      <th>V5</th>\n",
       "      <th>V6</th>\n",
       "      <th>V7</th>\n",
       "      <th>V8</th>\n",
       "      <th>V9</th>\n",
       "      <th>...</th>\n",
       "      <th>V21</th>\n",
       "      <th>V22</th>\n",
       "      <th>V23</th>\n",
       "      <th>V24</th>\n",
       "      <th>V25</th>\n",
       "      <th>V26</th>\n",
       "      <th>V27</th>\n",
       "      <th>V28</th>\n",
       "      <th>Amount</th>\n",
       "      <th>Class</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.359807</td>\n",
       "      <td>-0.072781</td>\n",
       "      <td>2.536347</td>\n",
       "      <td>1.378155</td>\n",
       "      <td>-0.338321</td>\n",
       "      <td>0.462388</td>\n",
       "      <td>0.239599</td>\n",
       "      <td>0.098698</td>\n",
       "      <td>0.363787</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.018307</td>\n",
       "      <td>0.277838</td>\n",
       "      <td>-0.110474</td>\n",
       "      <td>0.066928</td>\n",
       "      <td>0.128539</td>\n",
       "      <td>-0.189115</td>\n",
       "      <td>0.133558</td>\n",
       "      <td>-0.021053</td>\n",
       "      <td>149.62</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.0</td>\n",
       "      <td>1.191857</td>\n",
       "      <td>0.266151</td>\n",
       "      <td>0.166480</td>\n",
       "      <td>0.448154</td>\n",
       "      <td>0.060018</td>\n",
       "      <td>-0.082361</td>\n",
       "      <td>-0.078803</td>\n",
       "      <td>0.085102</td>\n",
       "      <td>-0.255425</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.225775</td>\n",
       "      <td>-0.638672</td>\n",
       "      <td>0.101288</td>\n",
       "      <td>-0.339846</td>\n",
       "      <td>0.167170</td>\n",
       "      <td>0.125895</td>\n",
       "      <td>-0.008983</td>\n",
       "      <td>0.014724</td>\n",
       "      <td>2.69</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-1.358354</td>\n",
       "      <td>-1.340163</td>\n",
       "      <td>1.773209</td>\n",
       "      <td>0.379780</td>\n",
       "      <td>-0.503198</td>\n",
       "      <td>1.800499</td>\n",
       "      <td>0.791461</td>\n",
       "      <td>0.247676</td>\n",
       "      <td>-1.514654</td>\n",
       "      <td>...</td>\n",
       "      <td>0.247998</td>\n",
       "      <td>0.771679</td>\n",
       "      <td>0.909412</td>\n",
       "      <td>-0.689281</td>\n",
       "      <td>-0.327642</td>\n",
       "      <td>-0.139097</td>\n",
       "      <td>-0.055353</td>\n",
       "      <td>-0.059752</td>\n",
       "      <td>378.66</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.966272</td>\n",
       "      <td>-0.185226</td>\n",
       "      <td>1.792993</td>\n",
       "      <td>-0.863291</td>\n",
       "      <td>-0.010309</td>\n",
       "      <td>1.247203</td>\n",
       "      <td>0.237609</td>\n",
       "      <td>0.377436</td>\n",
       "      <td>-1.387024</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.108300</td>\n",
       "      <td>0.005274</td>\n",
       "      <td>-0.190321</td>\n",
       "      <td>-1.175575</td>\n",
       "      <td>0.647376</td>\n",
       "      <td>-0.221929</td>\n",
       "      <td>0.062723</td>\n",
       "      <td>0.061458</td>\n",
       "      <td>123.50</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2.0</td>\n",
       "      <td>-1.158233</td>\n",
       "      <td>0.877737</td>\n",
       "      <td>1.548718</td>\n",
       "      <td>0.403034</td>\n",
       "      <td>-0.407193</td>\n",
       "      <td>0.095921</td>\n",
       "      <td>0.592941</td>\n",
       "      <td>-0.270533</td>\n",
       "      <td>0.817739</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.009431</td>\n",
       "      <td>0.798278</td>\n",
       "      <td>-0.137458</td>\n",
       "      <td>0.141267</td>\n",
       "      <td>-0.206010</td>\n",
       "      <td>0.502292</td>\n",
       "      <td>0.219422</td>\n",
       "      <td>0.215153</td>\n",
       "      <td>69.99</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 31 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   Time        V1        V2        V3        V4        V5        V6        V7  \\\n",
       "0   0.0 -1.359807 -0.072781  2.536347  1.378155 -0.338321  0.462388  0.239599   \n",
       "1   0.0  1.191857  0.266151  0.166480  0.448154  0.060018 -0.082361 -0.078803   \n",
       "2   1.0 -1.358354 -1.340163  1.773209  0.379780 -0.503198  1.800499  0.791461   \n",
       "3   1.0 -0.966272 -0.185226  1.792993 -0.863291 -0.010309  1.247203  0.237609   \n",
       "4   2.0 -1.158233  0.877737  1.548718  0.403034 -0.407193  0.095921  0.592941   \n",
       "\n",
       "         V8        V9  ...       V21       V22       V23       V24       V25  \\\n",
       "0  0.098698  0.363787  ... -0.018307  0.277838 -0.110474  0.066928  0.128539   \n",
       "1  0.085102 -0.255425  ... -0.225775 -0.638672  0.101288 -0.339846  0.167170   \n",
       "2  0.247676 -1.514654  ...  0.247998  0.771679  0.909412 -0.689281 -0.327642   \n",
       "3  0.377436 -1.387024  ... -0.108300  0.005274 -0.190321 -1.175575  0.647376   \n",
       "4 -0.270533  0.817739  ... -0.009431  0.798278 -0.137458  0.141267 -0.206010   \n",
       "\n",
       "        V26       V27       V28  Amount  Class  \n",
       "0 -0.189115  0.133558 -0.021053  149.62      0  \n",
       "1  0.125895 -0.008983  0.014724    2.69      0  \n",
       "2 -0.139097 -0.055353 -0.059752  378.66      0  \n",
       "3 -0.221929  0.062723  0.061458  123.50      0  \n",
       "4  0.502292  0.219422  0.215153   69.99      0  \n",
       "\n",
       "[5 rows x 31 columns]"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data = pd.read_csv('creditcard.csv',sep=',')\n",
    "data.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 284807 entries, 0 to 284806\n",
      "Data columns (total 31 columns):\n",
      " #   Column  Non-Null Count   Dtype  \n",
      "---  ------  --------------   -----  \n",
      " 0   Time    284807 non-null  float64\n",
      " 1   V1      284807 non-null  float64\n",
      " 2   V2      284807 non-null  float64\n",
      " 3   V3      284807 non-null  float64\n",
      " 4   V4      284807 non-null  float64\n",
      " 5   V5      284807 non-null  float64\n",
      " 6   V6      284807 non-null  float64\n",
      " 7   V7      284807 non-null  float64\n",
      " 8   V8      284807 non-null  float64\n",
      " 9   V9      284807 non-null  float64\n",
      " 10  V10     284807 non-null  float64\n",
      " 11  V11     284807 non-null  float64\n",
      " 12  V12     284807 non-null  float64\n",
      " 13  V13     284807 non-null  float64\n",
      " 14  V14     284807 non-null  float64\n",
      " 15  V15     284807 non-null  float64\n",
      " 16  V16     284807 non-null  float64\n",
      " 17  V17     284807 non-null  float64\n",
      " 18  V18     284807 non-null  float64\n",
      " 19  V19     284807 non-null  float64\n",
      " 20  V20     284807 non-null  float64\n",
      " 21  V21     284807 non-null  float64\n",
      " 22  V22     284807 non-null  float64\n",
      " 23  V23     284807 non-null  float64\n",
      " 24  V24     284807 non-null  float64\n",
      " 25  V25     284807 non-null  float64\n",
      " 26  V26     284807 non-null  float64\n",
      " 27  V27     284807 non-null  float64\n",
      " 28  V28     284807 non-null  float64\n",
      " 29  Amount  284807 non-null  float64\n",
      " 30  Class   284807 non-null  int64  \n",
      "dtypes: float64(30), int64(1)\n",
      "memory usage: 67.4 MB\n"
     ]
    }
   ],
   "source": [
    "data.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(284807, 30)\n",
      "(284807,)\n"
     ]
    }
   ],
   "source": [
    "#Create independent and Dependent Features\n",
    "columns = data.columns.tolist()\n",
    "# Filter the columns to remove data we do not want \n",
    "columns = [c for c in columns if c not in [\"Class\"]]\n",
    "# Store the variable we are predicting \n",
    "target = \"Class\"\n",
    "# Define a random state \n",
    "state = np.random.RandomState(42)\n",
    "X = data[columns]\n",
    "Y = data[target]\n",
    "X_outliers = state.uniform(low=0, high=1, size=(X.shape[0], X.shape[1]))\n",
    "# Print the shapes of X & Y\n",
    "print(X.shape)\n",
    "print(Y.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exploratory Data Analysis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "False"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.isnull().values.any()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Text(0, 0.5, 'Frequency')"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA1YAAAHwCAYAAAClhv6xAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nO3df7yu53wn+s9XosSQSCSI/LCp0AlDEKHTUiZtghkTplTUIcdJG3Xi9Jd2ijqN0pxDT4kaZcpJ5AdKUMRgiN/MQbJpKiI1SUlkSyohIaESEt/zx3OverKsvfZKrr322mvv9/v1el7rfr73fV33dT9rv9bKJ9d9X6u6OwAAANx6t1nrAQAAAKx3ghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrABYc1X1vaq69xqc98VV9aZtfd7lVNUHquqYrdTXI6vqK3PvL6mqX94afU/9XVBVj95a/QGsZ4IVwDo0BZGF14+r6gdz75++1uNbTlV9vKp+Y77W3Xfs7q+u0vl+vao2Tp/NFVNw+cXVONcKxtJV9f1pLN+uqo9U1VPnj+nux3X3aSvs6z7LHdPdn+ru+42OezrfqVX1Z4v6v393f3xr9A+w3glWAOvQFETu2N13TPL1JE+Yq7154biq2nXtRrn2qur3k7wqyf+V5G5JDkzy2iRHreGwHjR93+6X5NQkr6mqE7b2SXb27z3AtiZYAexAqurRVbWpqv6oqv4pyRuras+q+m9VdVVVXTNt7z/X5uNV9dKq+h9VdV1Vfaiq9p723b6q3jTNrnynqs6tqrtN+55VVRdObb5aVc9eNJajquq8qrq2qv6xqh5bVScmeWRmYeJ7VfWa6dh/mX2pqj2q6vRpvJdW1Yuq6jbTvv+1qj5dVX8xXcvXqupxm/ks9kjykiTHd/ffdvf3u/tH3f3e7v7DzbR5e1X9U1V9t6o+WVX3n9v3+Kr68nS936iqP5jqe0+f6Xeq6uqq+tTCeJfT3d/q7jOSPCfJC6rqLnPfj9+Ytu9TVZ+YxvOtqnrbVP/k1M3fT5/jUzfzvX90VW1adOqHTddxTVW9sapuP//ZLvo8ehrDcUmenuQ/T+d777T/X24trKrbVdWrqury6fWqqrrdtG9hbM+rqiunmcNnbekzAlhPBCuAHc/dk+yV5J5JjsvsZ/0bp/cHJvlBktcsavPrSZ6V5K5JfibJH0z1Y5LskeSAJHdJ8ltT+yS5Msl/SLL71PakqnpIklTVYUlOT/KHSe6c5FFJLunuP07yqSTPnWbXnrvE+P/LdM57J/mlJM+c+l/w8CRfSbJ3kj9PcnJV1RL9/HyS2yd519If05I+kOSg6XP4QpI3z+07Ocmzu/tOSR6Q5KNT/XlJNiXZJ7NZsRcm6Vtwzvck2TXJYUvse2mSDyXZM8n+mX026e5HTfsfNH2Ob5veL/7eL+XpSY5M8rNJ7pvkRVsaYHe/PrPP4s+n8z1hicP+OMkjkhyS5EHT9cz3fffMvq/7JTk2yV9V1Z5bOjfAeiFYAex4fpzkhO6+obt/0N3f7u53dvc/d/d1SU7MLLDMe2N3/8/u/kGSMzP7j+Mk+VFmgeo+3X1Td3++u69Nku5+X3f/Y898IrMA8Mip3bFJTunus7v7x939je7+hy0NvKp2SfLUJC/o7uu6+5Ikr0jyjLnDLu3uN3T3TUlOS7JvZoFmsbsk+VZ337il8y7o7lOm896Q5MVJHjTNfC18FgdX1e7dfU13f2Guvm+Se04zYp/q7hUHq+7+UZJvZRaIFvtRZiHpHt19fXd/eolj5t3se7+ZY17T3Zd199WZ/Vt42krHugVPT/KS7r6yu69K8qe5+fftR9P+H3X3+5N8L7PbIQF2CIIVwI7nqu6+fuFNVd2hqv56uq3u2iSfTHLnKcQs+Ke57X9Ocsdp+4wkH0zy1un2rj+vqttO/T6uqj473f72nSSPz2wWKZnNcP3jrRj73pnNmF06V7s0s1mOnxprd//ztHnH/LRvJ9m7VvisUVXtUlUvm25bvDbJJXNjSpJfzewaL51uz/v5qf7/JLk4yYemWyKfv5LzzZ33tpnNdl29xO7/nKSSnFOzFfj+ty10d7Pv/WZcNrd9aZJ7rHiwy7tHfvr7Nt/3txeF3Pl/ZwDrnmAFsONZPFvyvMxmBh7e3btndlteMvsP9uU7ms0u/Gl3H5zk32Z2698zp2dn3pnkL5LcrbvvnOT9c31eltmtZisZ37xv5SezNAsOTPKNLY11CZ9Jcn2SJ67w+F/PbFGLX87slrUNU72SpLvP7e6jMrtN8N2ZzexlmuF6XnffO8kTkvx+VR1+C8Z5VJIbk5yzeEd3/1N3/2Z33yPJs5O8tpZfCXAlM2UHzG0fmOTyafv7Se6wsKOq7n4L+748P/19u3wzxwLscAQrgB3fnTJ7Luo7VbVXkhWvQFdVj6mqfzPNbl2bWei5KbNZpdsluSrJjdMCEkfMNT05ybOq6vCquk1V7VdVPzft+2Zmz0/9lOn2vjOTnFhVd6qqeyb5/SS3+G9Ndfd3k/xJZs/yPHGaubvtNNP250s0uVOSGzKb6bpDZisJLnwOP1NVT6+qPaZb966dPodU1X+YFnioufpNWxpfVe1Vs6Xx/yrJy7v720sc85T6yUIj12QWbhb63uznuAXHV9X+07+FFyZZeD7r75Pcv6oOmRa0ePGidls6398keVFV7VOzxU/+JLfi+wawXglWADu+VyXZLbPZoM8m+e+3oO3dk7wjs8BwYZJPJHnT9KzWb2cWgq7JbLbnrIVG3X1OpgUtknx3arcwm/GXSZ48rUr36iXO+X9kNnvy1SSfTvKWJKfcgjH/i+5+ZWbB7EWZhcDLkjw3sxmnxU7P7Pa1byT5cmaf1bxnJLlkuk3wt5L8L1P9oCQfzuyZoc8kee0W/rbT31fV9zK7ffA3kvxed//JZo59WJLPTcefleR3uvtr074XJzltWo3w15Y532Jvyex5uK9Orz9Lku7+n5mtovjhJBdl9tnPOzmzZ8y+U1VLfX5/lmRjki8mOT+zxT/+bInjAHZIdQuerwUAAGAJZqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGDQiv4a/c5g77337g0bNqz1MAAAgO3Y5z//+W919z6L64LVZMOGDdm4ceNaDwMAANiOVdWlS9XdCggAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAM2nWtBwDzNjz/fWs9BNguXPKyf7/WQwAAbgEzVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBo1YJVVR1QVR+rqgur6oKq+p2p/uKq+kZVnTe9Hj/X5gVVdXFVfaWqjpyrP7Sqzp/2vbqqaqrfrqreNtU/V1Ub5tocU1UXTa9jVus6AQAAdl3Fvm9M8rzu/kJV3SnJ56vq7GnfSd39F/MHV9XBSY5Ocv8k90jy4aq6b3fflOR1SY5L8tkk70/y2CQfSHJskmu6+z5VdXSSlyd5alXtleSEJIcm6encZ3X3Nat4vQAAwE5q1WasuvuK7v7CtH1dkguT7LdMk6OSvLW7b+juryW5OMlhVbVvkt27+zPd3UlOT/LEuTanTdvvSHL4NJt1ZJKzu/vqKUydnVkYAwAA2Oq2yTNW0y16D07yuan03Kr6YlWdUlV7TrX9klw212zTVNtv2l5cv1mb7r4xyXeT3GWZvgAAALa6VQ9WVXXHJO9M8rvdfW1mt/X9bJJDklyR5BULhy7RvJep39o282M7rqo2VtXGq666atnrAAAA2JxVDVZVddvMQtWbu/tvk6S7v9ndN3X3j5O8Iclh0+Gbkhww13z/JJdP9f2XqN+sTVXtmmSPJFcv09fNdPfru/vQ7j50n332GblUAABgJ7aaqwJWkpOTXNjdr5yr7zt32JOSfGnaPivJ0dNKf/dKclCSc7r7iiTXVdUjpj6fmeQ9c20WVvx7cpKPTs9hfTDJEVW153Sr4RFTDQAAYKtbzVUBfyHJM5KcX1XnTbUXJnlaVR2S2a15lyR5dpJ09wVVdWaSL2e2ouDx04qASfKcJKcm2S2z1QA/MNVPTnJGVV2c2UzV0VNfV1fVS5OcOx33ku6+epWuEwAA2MmtWrDq7k9n6Wed3r9MmxOTnLhEfWOSByxRvz7JUzbT1ylJTlnpeAEAAG6tbbIqIAAAwI5MsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABg0KoFq6o6oKo+VlUXVtUFVfU7U32vqjq7qi6avu451+YFVXVxVX2lqo6cqz+0qs6f9r26qmqq366q3jbVP1dVG+baHDOd46KqOma1rhMAAGA1Z6xuTPK87v7XSR6R5PiqOjjJ85N8pLsPSvKR6X2mfUcnuX+SxyZ5bVXtMvX1uiTHJTloej12qh+b5Jruvk+Sk5K8fOprryQnJHl4ksOSnDAf4AAAALamVQtW3X1Fd39h2r4uyYVJ9ktyVJLTpsNOS/LEafuoJG/t7hu6+2tJLk5yWFXtm2T37v5Md3eS0xe1WejrHUkOn2azjkxydndf3d3XJDk7PwljAAAAW9U2ecZqukXvwUk+l+Ru3X1FMgtfSe46HbZfksvmmm2aavtN24vrN2vT3Tcm+W6SuyzT1+JxHVdVG6tq41VXXXXrLxAAANiprXqwqqo7Jnlnkt/t7muXO3SJWi9Tv7VtflLofn13H9rdh+6zzz7LDA0AAGDzVjVYVdVtMwtVb+7uv53K35xu78v09cqpvinJAXPN909y+VTff4n6zdpU1a5J9khy9TJ9AQAAbHWruSpgJTk5yYXd/cq5XWclWVil75gk75mrHz2t9HevzBapOGe6XfC6qnrE1OczF7VZ6OvJST46PYf1wSRHVNWe06IVR0w1AACArW7XVez7F5I8I8n5VXXeVHthkpclObOqjk3y9SRPSZLuvqCqzkzy5cxWFDy+u2+a2j0nyalJdkvygemVzILbGVV1cWYzVUdPfV1dVS9Ncu503Eu6++rVulAAAGDntmrBqrs/naWfdUqSwzfT5sQkJy5R35jkAUvUr88UzJbYd0qSU1Y6XgAAgFtrm6wKCAAAsCMTrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBKwpWVfWA1R4IAADAerXSGav/WlXnVNX/XlV3XtURAQAArDMrClbd/YtJnp7kgCQbq+otVfUrqzoyAACAdWLFz1h190VJXpTkj5L8UpJXV9U/VNV/Wq3BAQAArAcrfcbqgVV1UpILk/y7JE/o7n89bZ+0iuMDAADY7u26wuNek+QNSV7Y3T9YKHb35VX1olUZGQAAwDqx0mD1+CQ/6O6bkqSqbpPk9t39z919xqqNDgAAYB1Y6TNWH06y29z7O0w1AACAnd5Kg9Xtu/t7C2+m7TuszpAAAADWl5UGq+9X1UMW3lTVQ5P8YJnjAQAAdhorfcbqd5O8vaoun97vm+SpqzMkAACA9WVFwaq7z62qn0tyvySV5B+6+0erOjIAAIB1YqUzVknysCQbpjYPrqp09+mrMioAAIB1ZEXBqqrOSPKzSc5LctNU7iSCFQAAsNNb6YzVoUkO7u5ezcEAAACsRytdFfBLSe6+mgMBAABYr1Y6Y7V3ki9X1TlJblgodvd/XJVRAQAArCMrDVYvXs1BAAAArGcrXW79E1V1zyQHdfeHq+oOSXZZ3aEBAACsDyt6xqqqfjPJO5L89VTaL8m7V2tQAAAA68lKF684PskvJLk2Sbr7oiR3Xa5BVZ1SVVdW1Zfmai+uqm9U1XnT6/Fz+15QVRdX1Veq6si5+kOr6vxp36urqqb67arqbVP9c1W1Ya7NMVV10fQ6ZoXXCAAAcKusNFjd0N0/XHhTVbtm9neslnNqkscuUT+puw+ZXu+f+js4ydFJ7j+1eW1VLdxq+LokxyU5aHot9Hlskmu6+z5JTkry8qmvvZKckOThSQ5LckJV7bnC6wQAALjFVhqsPlFVL0yyW1X9SpK3J3nvcg26+5NJrl5h/0cleWt339DdX0tycZLDqmrfJLt392emv6F1epInzrU5bdp+R5LDp9msI5Oc3d1Xd/c1Sc7O0gEPAABgq1hpsHp+kquSnJ/k2Unen+RFt/Kcz62qL063Ci7MJO2X5LK5YzZNtf2m7cX1m7Xp7huTfDfJXZbp66dU1XFVtbGqNl511VW38nIAAICd3YqCVXf/uLvf0N1P6e4nT9tbuhVwKa9L8rNJDklyRZJXTPVa6rTL1G9tm5sXu1/f3Yd296H77LPPcuMGAADYrBUtt15VX8sS4aS7731LTtbd35zr8w1J/tv0dlOSA+YO3T/J5VN9/yXq8202Tc987ZHZrYebkjx6UZuP35JxAgAA3BIrvRXw0CQPm16PTPLqJG+6pSebnpla8KQkCysGnpXk6Gmlv3tltkjFOd19RZLrquoR0/NTz0zynrk2Cyv+PTnJR6dZtA8mOaKq9pxuNTxiqgEAAKyKlf6B4G8vKr2qqj6d5E8216aq/iazmaO9q2pTZiv1PbqqDsls9uuSzJ7XSndfUFVnJvlykhuTHN/dN01dPSezFQZ3S/KB6ZUkJyc5o6ouzmym6uipr6ur6qVJzp2Oe0l3r3QRDQAAgFtspbcCPmTu7W0ym8G603JtuvtpS5RPXub4E5OcuER9Y5IHLFG/PslTNtPXKUlOWW58AAAAW8uKglV+sshEMptRuiTJr2310QAAAKxDK70V8DGrPRAAAID1aqW3Av7+cvu7+5VbZzgAAADrz0pvBVxYFfCs6f0TknwyN/9DvAAAADullQarvZM8pLuvS5KqenGSt3f3b6zWwAAAANaLlf4dqwOT/HDu/Q+TbNjqowEAAFiHVjpjdUaSc6rqXZn9DaonJTl91UYFAACwjqx0VcATq+oDSR45lZ7V3X+3esMCAABYP1Z6K2CS3CHJtd39l0k2VdW9VmlMAAAA68qKglVVnZDkj5K8YCrdNsmbVmtQAAAA68lKZ6yelOQ/Jvl+knT35UnutFqDAgAAWE9WGqx+2N2d2cIVqap/tXpDAgAAWF9WGqzOrKq/TnLnqvrNJB9O8obVGxYAAMD6scVVAauqkrwtyc8luTbJ/ZL8SXefvcpjAwAAWBe2GKy6u6vq3d390CTCFAAAwCIrvRXws1X1sFUdCQAAwDq1oj8QnOQxSX6rqi7JbGXAymwy64GrNTAAAID1YtlgVVUHdvfXkzxuG40HAABg3dnSjNW7kzykuy+tqnd2969ui0EBAACsJ1t6xqrmtu+9mgMBAABYr7YUrHoz2wAAAEy2dCvgg6rq2sxmrnabtpOfLF6x+6qODgAAYB1YNlh19y7baiAAAADr1Ur/jhUAAACbIVgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMGjVglVVnVJVV1bVl+Zqe1XV2VV10fR1z7l9L6iqi6vqK1V15Fz9oVV1/rTv1VVVU/12VfW2qf65qtow1+aY6RwXVdUxq3WNAAAAyerOWJ2a5LGLas9P8pHuPijJR6b3qaqDkxyd5P5Tm9dW1S5Tm9clOS7JQdNroc9jk1zT3fdJclKSl0997ZXkhCQPT3JYkhPmAxwAAMDWtmrBqrs/meTqReWjkpw2bZ+W5Ilz9bd29w3d/bUkFyc5rKr2TbJ7d3+muzvJ6YvaLPT1jiSHT7NZRyY5u7uv7u5rkpydnw54AAAAW822fsbqbt19RZJMX+861fdLctnccZum2n7T9uL6zdp0941JvpvkLsv0BQAAsCq2l8UraolaL1O/tW1uftKq46pqY1VtvOqqq1Y0UAAAgMW2dbD65nR7X6avV071TUkOmDtu/ySXT/X9l6jfrE1V7Zpkj8xuPdxcXz+lu1/f3Yd296H77LPPwGUBAAA7s20drM5KsrBK3zFJ3jNXP3pa6e9emS1Scc50u+B1VfWI6fmpZy5qs9DXk5N8dHoO64NJjqiqPadFK46YagAAAKti19XquKr+Jsmjk+xdVZsyW6nvZUnOrKpjk3w9yVOSpLsvqKozk3w5yY1Jju/um6aunpPZCoO7JfnA9EqSk5OcUVUXZzZTdfTU19VV9dIk507HvaS7Fy+iAQAAsNWsWrDq7qdtZtfhmzn+xCQnLlHfmOQBS9SvzxTMlth3SpJTVjxYAACAAdvL4hUAAADrlmAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwKA1CVZVdUlVnV9V51XVxqm2V1WdXVUXTV/3nDv+BVV1cVV9paqOnKs/dOrn4qp6dVXVVL9dVb1tqn+uqjZs62sEAAB2Hms5Y/WY7j6kuw+d3j8/yUe6+6AkH5nep6oOTnJ0kvsneWyS11bVLlOb1yU5LslB0+uxU/3YJNd0932SnJTk5dvgegAAgJ3U9nQr4FFJTpu2T0vyxLn6W7v7hu7+WpKLkxxWVfsm2b27P9PdneT0RW0W+npHksMXZrMAAAC2trUKVp3kQ1X1+ao6bqrdrbuvSJLp612n+n5JLptru2mq7TdtL67frE1335jku0nusgrXAQAAkF3X6Ly/0N2XV9Vdk5xdVf+wzLFLzTT1MvXl2ty841moOy5JDjzwwOVHDAAAsBlrMmPV3ZdPX69M8q4khyX55nR7X6avV06Hb0pywFzz/ZNcPtX3X6J+szZVtWuSPZJcvcQ4Xt/dh3b3ofvss8/WuTgAAGCns82DVVX9q6q608J2kiOSfCnJWUmOmQ47Jsl7pu2zkhw9rfR3r8wWqThnul3wuqp6xPT81DMXtVno68lJPjo9hwUAALDVrcWtgHdL8q5pLYldk7ylu/97VZ2b5MyqOjbJ15M8JUm6+4KqOjPJl5PcmOT47r5p6us5SU5NsluSD0yvJDk5yRlVdXFmM1VHb4sLAwAAdk7bPFh191eTPGiJ+reTHL6ZNicmOXGJ+sYkD1iifn2mYAYAALDatqfl1gEAANYlwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMC6LshgAAAZkSURBVEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQYIVAADAIMEKAABgkGAFAAAwSLACAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAYJVgAAAIMEKwAAgEGCFQAAwCDBCgAAYJBgBQAAMEiwAgAAGCRYAQAADBKsAAAABglWAAAAgwQrAACAQTt0sKqqx1bVV6rq4qp6/lqPBwAA2DHtsMGqqnZJ8ldJHpfk4CRPq6qD13ZUAADAjmiHDVZJDktycXd/tbt/mOStSY5a4zEBAAA7oF3XegCraL8kl82935Tk4Ws0FgDgVtrw/Pet9RBgu3DJy/79Wg+BZezIwaqWqPXNDqg6Lslx09vvVdVXVn1UsD7sneRbaz2InVm9fK1HAHAzfi9sB/xu2G7cc6nijhysNiU5YO79/kkunz+gu1+f5PXbclCwHlTVxu4+dK3HAcD2we8F2LId+Rmrc5McVFX3qqqfSXJ0krPWeEwAAMAOaIedseruG6vquUk+mGSXJKd09wVrPCwAAGAHtMMGqyTp7vcnef9ajwPWIbfIAjDP7wXYguruLR8FAADAZu3Iz1gBAABsE4IV7GCqqqvqFXPv/6CqXryNx/DxqrJ6FMB2qKpuqqrz5l4bVuEcl1TV3lu7X9ie7dDPWMFO6oYk/6mq/u/uvsV/c6Sqdu3uG1dhXABsH37Q3YcstaOqKrNHRX68jccE654ZK9jx3JjZQ8a/t3hHVd2zqj5SVV+cvh441U+tqldW1ceSvHx6/7qq+lhVfbWqfqmqTqmqC6vq1Ln+XldVG6vqgqr60211gQBsPVW1Yfr5/tokX0hywOZ+vs/PRFXVoVX18Wn7LlX1oar6u6r66yS1FtcCa0mwgh3TXyV5elXtsaj+miSnd/cDk7w5yavn9t03yS939/Om93sm+XeZBbT3Jjkpyf2T/JuqWvg/nX88/cHIByb5pap64KpcDQBb025ztwG+a6rdL7PfDw/u7ktzy3++n5Dk09394Mz+buiBqzZ62E4JVrAD6u5rk5ye5LcX7fr5JG+Zts9I8otz+97e3TfNvX9vz5YNPT/JN7v7/OnWkAuSbJiO+bWq+kKSv8ssdB28VS8EgNXwg+4+ZHo9aapd2t2fnTvmlv58f1SSNyVJd78vyTVbe9CwvfOMFey4XpXZLR1vXOaY+b+38P1F+26Yvv54bnvh/a5Vda8kf5DkYd19zXSL4O2HRgzAWvmX3wFb+Pl+Y37yP+YX/8z3N3zYqZmxgh1Ud1+d5Mwkx86V/78kR0/bT0/y6YFT7J7ZL+LvVtXdkjxuoC8Ath/L/Xy/JMlDp+1fnat/MrPfK6mqx2V2OznsVAQr2LG9Isn8cre/neRZVfXFJM9I8ju3tuPu/vvMbhG5IMkpSf7HwDgB2E5s4ef7nyb5y6r6VJKbFtUfNd0+eESSr2+j4cJ2o2aPUAAAAHBrmbECAAAYJFgBAAAMEqwAAAAGCVYAAACDBCsAAIBBghUAO42quntVvbWq/rGqvlxV76+q+1bVl9Z6bACsb7uu9QAAYFuoqkryriSndffRU+2QJHdb04EBsEMwYwXAzuIxSX7U3f91odDd5yW5bOF9VW2oqk9V1Rem17+d6vtW1Ser6ryq+lJVPbKqdqmqU6f351fV7237SwJge2HGCoCdxQOSfH4Lx1yZ5Fe6+/qqOijJ3yQ5NMmvJ/lgd59YVbskuUOSQ5Ls190PSJKquvPqDR2A7Z1gBQA/cdskr5luEbwpyX2n+rlJTqmq2yZ5d3efV1VfTXLvqvovSd6X5ENrMmIAtgtuBQRgZ3FBkodu4ZjfS/LNJA/KbKbqZ5Kkuz+Z5FFJvpHkjKp6ZndfMx338STHJ/l/V2fYAKwHghUAO4uPJrldVf3mQqGqHpbknnPH7JHkiu7+cZJnJNllOu6eSa7s7jckOTnJQ6pq7yS36e53Jvk/kzxk21wGANsjtwICsFPo7q6qJyV5VVU9P8n1SS5J8rtzh702yTur6ilJPpbk+1P90Un+sKp+lOR7SZ6ZZL8kb6yqhf9J+YJVvwgAtlvV3Ws9BgAAgHXNrYAAAACDBCsAAIBBghUAAMAgwQoAAGCQYAUAADBIsAIAABgkWAEAAAwSrAAAAAb9/1mAL/NSavSSAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 1008x576 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "count_classes = pd.value_counts(data['Class'], sort = True)\n",
    "\n",
    "count_classes.plot(kind = 'bar', rot=0)\n",
    "\n",
    "plt.title(\"Transaction Class Distribution\")\n",
    "\n",
    "plt.xticks(range(2), LABELS)\n",
    "\n",
    "plt.xlabel(\"Class\")\n",
    "\n",
    "plt.ylabel(\"Frequency\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "## Get the Fraud and the normal dataset \n",
    "\n",
    "fraud = data[data['Class']==1]\n",
    "\n",
    "normal = data[data['Class']==0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(492, 31) (284315, 31)\n"
     ]
    }
   ],
   "source": [
    "print(fraud.shape,normal.shape)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "from imblearn.under_sampling import NearMiss"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Implementing Undersampling for Handling Imbalanced \n",
    "nm = NearMiss()\n",
    "X_res,y_res=nm.fit_sample(X,Y)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "((984, 30), (984,))"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_res.shape,y_res.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Original dataset shape Counter({0: 284315, 1: 492})\n",
      "Resampled dataset shape Counter({0: 492, 1: 492})\n"
     ]
    }
   ],
   "source": [
    "from collections import Counter\n",
    "print('Original dataset shape {}'.format(Counter(Y)))\n",
    "print('Resampled dataset shape {}'.format(Counter(y_res)))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}