Author: theprogrammersbook


In this blog we will be discussing about how to install oozie in hadoop 2.x cluster. First we need to download the oozie-4.1.0 tar file from the below link: Oozie-4.1.0 tar file By default it will be downloaded in the Downloads folder. We need to Read more…


You can do the following method, copy to clipboard datanode clusterID for your example, CID-8bf63244-0510-4db6-a949-8f74b50f2be9 and run following command under HADOOP_HOME/bin directory then this code formatted the namenode with datanode cluster ids. OR ou must do as follow : bin/stop-all.sh Read more…


nagaraju@nagaraju:/usr/local/softwares/hadoop-2.10.0$ sbin/stop-all.sh This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh Stopping namenodes on [localhost] localhost: chown: changing ownership of ‘/usr/local/softwares/hadoop-2.10.0/logs’: Operation not permitted localhost: no namenode to stop localhost: chown: changing ownership of ‘/usr/local/softwares/hadoop-2.10.0/logs’: Operation not permitted localhost: no Read more…


Solr – > solr-7.0.7 is working with Java 1.8 only … I have tested everything is working fine.


nagaraju@nagaraju:~/IdeaProjects/scalaClone$ git add ScalaTestApp/** The following paths are ignored by one of your .gitignore files: ScalaTestApp/project ScalaTestApp/target Use -f if you really want to add them. nagaraju@nagaraju:~/IdeaProjects/scalaClone$ git status On branch master Changes to be committed: (use “git reset HEAD Read more…


Check the available files . Make a directory After creating the directory , now check the list. Now , go to the created directory. Initialize the git in that folder. Add github url as origin Pull the github url (here Read more…


In this Article, we are going to lean how to create scala project with sbt in IntellijIDEA. And also we will learn how to test this scala project with scalatest jar. Technologies used are IntellijIDEA 2018.3.2(Community Edition) Scala 2.11.7 Sbt Read more…


when I am practicing the following https://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html I have used the following sbts.

I have changed the hive dependency from

to

then I am able to execute the program without any errors.



For this purpose the following process we have to follow 1 : First time to create one executable jar file . 2: Java code to run this executable JAR file let me explain first we have to create one Java Read more…