how to start the Apache spark with Kafka application in windows?

To configure Apache Kafka in Windows: https://www.youtube.com/watch?v=MVdGjs0YQBQ https://www.youtube.com/watch?v=LS6WiHs_m5w Apache Spark With Kafka: https://spark.apache.org/docs/latest/streaming-kafka-integration.html http://kafka.apache.org/documentation.html Integrating Spark Streaming with Apache Kafka: https://www.youtube.com/watch?v=5V-Wtfrc38U&t=621s Advanced Apache Spark Training - Sameer Farooqui (Databricks): https://www.youtube.com/watch?v=7ooZ4S7Ay6Y Intro...

Read more ...

Spark word count example

example: import org.apache.spark.SparkContext import org.apache.spark.SparkConf object Wordcount {  def main(args: Array[String]) {    //Create conf object  val conf = new SparkConf()  .setMaster("local")// to set the environment  .set("spark.driver.memory","1g") // to resolve the memory issue(Could not reserve enough space for 3145728KB object heap)  .setAppName("WordCount")//application...

Read more ...

Situation: Creating spark context 2 times by mistake while creating spark mongo db configuration

Situation: Creating spark context 2 times by mistake.  val spark = SparkSession.builder()       .master("local")       .appName("SparkMongoDB")       .config("spark.mongodb.input.uri", "mongodb://127.0.0.1/Spark.sparkCollection")       .config("spark.mongodb.output.uri", "mongodb://127.0.0.1/Spark.sparkCollection")       .getOrCreate()    //val...

Read more ...

Why is VirtualBox only showing 32 bit guest versions on my 64 bit host OS?

Step1: Please download the virtual box. if not showing 64bit version while configuring vm. please follow step2 and step3. Virtual box download  Step2: Need check BIOS settings(is it enable or not for virtual machine? if not enable, should be enable) How to enable virtual machine in windows 10 Step3: Please check now, virtual box. Still if not working, please click on the bellow link: How to fix issue wint...

Read more ...