Posts

Twitter Analysis Using R

Image
PREREQUISITES: You have already installed  R  and are using  RStudio . In order to extract tweets, you will need a Twitter application and hence a Twitter account. If you don’t have a Twitter account, please  sign up . Use your Twitter login ID and password to sign in at  Twitter Developers . 1.  STEPS TO CREATE A TWITTER APPLICATION a.  Navigate to My Applications in the upper right hand corner. b.  Navigate to My Applications in the upper right hand corner. c.  Create a new application. d.  Fill out the new app form. Names should be unique, i.e., no one else should have used this name for their Twitter app. Give   a brief description of the app. You can change this later on if needed. Enter   your website or blog address.   Callback URL can be left blank. Once you’ve done this, make sure you’ve read the “Developer Rules Of The Road” blurb, check the “Yes, I agree” box, fill in the CAPTCHA and click the “Create Your Twitter Application” button. e.  

Facebook Data Analysis Using R

Image
Hey Folks, Today We gonna Learn to Analyse Facebook Data using R . Before Going to concept, makesure you Have R Installed in your System, If Not Proceed the Following Steps to Install. Step 1 – Install R  1. Download the R installer from: https://cran.r-project.org/ 2. Run the installer. Default settings are fine. If you do not have admin rights on your laptop, then ask your local IT support. In that case, it is important that you also ask them to give you full permissions to the R directories. Without this, you will not be able to install additional packages later. Step 2 – Install RStudio 1. Download RStudio: https://www.rstudio.com/products/rstudio/download/ 2. Once the installation of R has completed successfully (and not before), run the RStudio installer. 3. If you do not have administrative rights on your laptop, step 2 may fail. Ask your IT Support or download a pre-built zip archive of RStudio which doesn’t need installing.    a. Download the appropriate a

Road Map For Data Science Career !!!!

Image
Decide a Proper Career Path And Follow in a Proper way to get Succeeded in the Field Of Data Science!!! There are Many Road Map's Available in google but i feel this is Best Appropriate to my Knowledge... Thanks, Have Fun!!!! Please Leave your Comment Below If you Have Any Clarifications or Any Suggestions.

Performance Improvement in Hive (Properties in HIVE -SITE.XML)

There are list of Properties Available to increase the Performance in hive. Use the Properties Appropriate to your Need. <?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://localhost:3306/metastore_db_3?createDatabaseIfNotExist=true&amp;useSSL=false</value> <description>JDBC connect string for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> <description>Driver class name for a JDBC metastore</description> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hiveuser</value>

Quick Setup Steps For Installing & Integrating Spark,Hive,Hadoop Processess Together !!!

Image
If you wish For Indepth Understanding go to my Previous Blog and Install All  Separately. You can Install all the Packages Separately or Install together using the following Commands. SSH :                                                                            #For Interacting With All   - ssh-keygen -t rsa -P ""  - cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys  - # ssh-add -l # Not Working the run the command  - ssh localhost Install and Configuration for Spark, Hive and Hadoop: Make a separate Directory for Installing All the Packages you can use 'mkdir' command to create a directory   - mkdir /home/user/Dilli/Installed/All_Setup  - cd /home/user/Dilli/Installed/All_Setup  - java -version  - readlink -f /usr/bin/java | sed "s:bin/java::"  - wget https://archive.apache.org/dist/hadoop/core/hadoop-2.9.0/hadoop-2.9.0.tar.gz  - tar -xzvf hadoop-2.9.0.tar.gz  - mv hadoop-2.9.0 hadoop  - wget http://www-eu

Installation Steps For Spark

Image
Downloading  and Installation Steps for Spark: Step 1 : Make sure whether  Java is installed Correctly:               Open Terminal and type.                                                  java -version If Java is already installed correctly on your system, you will  see the following output on your screen:                            Java version "1.8.0_71"              Java(TM) SE Runtime Environment (build 1.8.0_71-b13)              Java HotSpot(TM) Client VM (build 25.0-b02, mixed mode). If java is not installed on your system, then install it.           Ubuntu 14.04 : - sudo add-apt-repository ppa:openjdk-r/ppa - sudo apt-get update - sudo apt-get install openjdk-8-jdk - sudo apt-get install openjdk-8-jre Ubuntu 16.04 : - sudo ap