Update command in sqoop:

  • There are two approaches to update in sqoop.
    • The records inserted are to be added to the target table.
    • The sqoop provides an update mode by providing “update-key <column(s)>” command.
  • This command is used to generate the SQl update statement.
  • If the value in column 1 matches the data is updated else the data is inserted into the table.
  • This technique is also refered to as upsert where the default action is update but insertion takes place when matching data is not available.
$ sqoop export (Generic Arguments)
--table target-relational-table
--update-key column1
--export-dir /user/my-hdfs-file
...
Generates => UPDATE target-relational-table SET
column2=1000,column3=2000
WHERE column1=100;

Categorized in:

Tagged in:

, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,