sqoop - Load JDBC Driver - apache sqoop - sqoop tutorial - sqoop hadoop



Load JDBC Driver

  • For accessing the MS SQL Server database Sqoop requires an additional JDBC driver which can be downloaded from Microsoft. The following steps will install MSSQL Server JDBC driver to Sqoop:
  • wget 'http://download.microsoft.com/download/0/2/A/02AAE597-3865-456C-AE7F-613F99F850A8/sqljdbc_4.0.2206.100_enu.tar.gz'
    
    tar -xvzf sqljdbc_4
    
    cp sqljdbc_4.0/enu/sqljdbc4.jar /usr/hdp/current/sqoop-server/lib/
    Click "Copy code" button to copy into clipboard - By wikitechy - sqoop tutorial - team

    Validate the connection

  • To check that the connection to the server is valid:
  • sqoop list-tables --connect "jdbc:sqlserver:// <server_ip>:1433;database= <database_name>" 
                      --username  <user_name>
                      --password  <password> 
    Click "Copy code" button to copy into clipboard - By wikitechy - sqoop tutorial - team
  • Before doing this it is recommended to check if SqlServer's configuration allows remote access to 1433 port.
  • Open Configuration Manager =>SQL Server Network configuration => Protocols for MSSQLSERVER and check that Protocol is enabled and the needed IP and port is enabled and is active.
  • SQOOP forum

    Sqoop Installation and Download :

    Connecting Sqoop to other databases/datastores :

  • Import data directly into Hive Warehouse
  • Import data from RDBMS to HBase table
  • Import data to new catalog
  • Import the results of a query from a relational database into HDFS
  • Load JDBC Driver
  • Sqoop Export :

  • Sqoop Export basic example
  • Sqoop Import RDBMS Table to HDFS :

  • Sqoop Import RDBMS Table to HDFS
  • Merge data-sets imported via incremental import using Sqoop :

  • Import New as well as Updated Data - lastmodified mode - Append Mode
  • Hadoop with Kite SDK :

  • Kite SDK to demonstrate copying of various file formats to Hadoop
  • Sqoop Advanced :

  • Use Sqoop to copy an Oracle table to Hadoop

  • Related Searches to Load JDBC Driver