scala

Marks: Type: Due Date: Submission: Lateness: Authorship: Monash University Bigdata Assignment-Programming This assignment is worth 140 marks and it forms 40% of all marks for the unit Individual submission Week 10: Mon 01-Oct-2018, 2pm The assignment must be uploaded to the unit’s portal on Moodle as a single ZIP or GZIP file (using any other […]

COMP9313 2018s2 Project 2 (25 marks) Problem 1 (13 pts): Given a corpus of documents, compute the relative frequency f(wj|wi), i.e., Here, N(., .) indicates the number of times a particular co-occurring term pair is observed in the corpus. In this problem, we consider that 𝑤 and 𝑤 co-occur if 𝑤 appears after 𝑤 in

INF 553 – Spring 2018 Assignment 4 Community Detection Deadline: 04/09 2018 11:59 PM PST Assignment Overview In this assignment you are asked to implement the Girvan-Newman algorithm using the Spark Framework in order to detect communities in the graph. You will use only video_small_num.csv dataset in order to find users who have the similar

INF 553 – Spring 2018 Assignment 5 Streaming Data Deadline: 04/23 2018 11:59 PM PST Assignment Overview In this assignment we’re going to implement some streaming algorithms. One is some analysis of Twitter stream. The other runs on a simulated data stream. Environment Requirements Python: 2.7 Scala: 2.11 Spark: 2.2.1 IMPORTANT: We will use these

COMP9313 2017s2 Project 4 Set Similarity Join Using Spark on AWS Problem Definition: Given two collections of records R and S, a similarity function sim(., .), and a threshold τ, the set similarity join between R and S, is to find all record pairs r (from R) and s (from S), such that sim(r, s)

INF 553 – Spring 2018 Assignment 5 Streaming Data Deadline: 04/23 2018 11:59 PM PST Assignment Overview In this assignment we’re going to implement some streaming algorithms. One is some analysis of Twitter stream. The other runs on a simulated data stream. Environment Requirements Python: 2.7 Scala: 2.11 Spark: 2.2.1 IMPORTANT: We will use these