## Instructions
1. This note book contains instructions for **COMP9318-lab3**.
* You are required to complete your implementation in a file `submission.py` provided along with this notebook.
* You are not allowed to print out unnecessary stuff. We will not consider any output printed out on the screen. All results should be returned in appropriate data structures via corresponding functions.
* You can submit your implementation for **lab3** via following link: https://kg.cse.unsw.edu.au:8318/lab3/ .
* For each question, we have provided you with detailed instructions along with question headings. In case of any problem, you can post your query @ Piazza.
* You are allowed to add other functions and/or import modules (you may have to in this lab), but you are not allowed to define global variables. **Only functions are allowed** in `submission.py`.
* You should not import unnecessary modules/libraries, failing to import such modules at test time will lead to errors.
* We will provide immediate feedback on your submission. You can access your scores using the online submission portal on the same day.
* For **Final Evaluation** we will be using a different dataset, so your final scores may vary.
* You are allowed to submit as many times as you want before the deadline, but **ONLY the latest version will be kept and marked**.
* Submission deadline for this assignment is **23:59:59 on 2nd May, 2018**. We will **not** accept any late submissions.
# Question-1: Text Classification using Multinomial Naive Bayes
You are required to implement a multinomial naive bayes classifier to predict spam SMS.
The training data is a set of SMS categoried into `spam` and `ham`.
In order to implement a unigram model, first we tokenize the text. We use the count corresponding to each token (word) in the SMS as its feature (i.e., bag of words). We store the features and catrgorical information for each SMS in a `dictionary`.
For this lab, you need to **implement** a multinomial naive bayes classifier (i.e., `multinomial_nb()` in the file: `submission.py`) with add-1 smoothing. The input arguments of `multinomial_nb()` are:
* `training_data`: pre-processed data stored as a `dictionary`
* `sms`: test-sms (i.e., a list of tokens) that you need to categorize as `spam` and/or `ham`
The return value of `multinomial_nb()` should be the **ratio** of the probability of sms is spam and the probability of sms is ham. A return value larger than 1 implies the `sms` is spam and vice versa.
For example, a sample output is shown in the cell given below: