Zhendong_Hu_Description
Versions Used
I choose Scala for this project. The version I use is 2.11. The spark version I use is 2.2.1.
Run
TrackHashTags
AveTweetLength
UniqueUserCount
run StreamingSimulation first
then run spark
Ctr-c stop, the program will print the estimate.
bin/spark-submit –class TrackHashTags Zhendong_Hu_hw5.jar
bin/spark-submit –class AveTweetLength Zhendong_Hu_hw5.jar
java -cp simulation.jar StreamingSimulation userId.txt 9999 1
bin/spark-submit –class UniqueUserCount Zhendong_Hu_hw5.jar localhost 9999
Versions Used
Run
TrackHashTags
AveTweetLength
UniqueUserCount