Showing posts with label BigData. Show all posts
Showing posts with label BigData. Show all posts

July 21, 2017

Spark word count example

example: import org.apache.spark.SparkContext import org.apache.spark.SparkConf object Wordcount {  def main(args: Array[String]) {    //Create conf object  val conf = new SparkConf()  .setMaster("local")// to set the environment  .set("spark.driver.memory","1g") // to resolve the memory issue(Could not reserve enough space for 3145728KB object heap)  .setAppName("WordCount")//application...
Read more ...

My Favorite Site's List

#update below script more than 500 posts