pig tutorial - apache pig tutorial - Apache Pig - SubtractDuration() - pig latin - apache pig - pig hadoop




What is SubtractDuration() function in Apache Pig ?

  • The SubtractDuration() function accepts a date-time object and a duration objects, and subtract the given duration to the date-time object and returns a new date-time object.
 Apache Pig Subtract Duration

Learn apache pig - apache pig tutorial - Apache Pig Subtract Duration - apache pig examples - apache pig programs

Syntax

grunt> SubtractDuration(datetime, duration)

Example

  • Ensure that we have a file named wikitechy_date.txt in the HDFS directory /pig_data/.
  • This file contains the date-of-birth details of a particular person, it has person id, date and time and some duration according to ISO 8601 standard.

wikitechy_date.txt

001,1989/09/26 09:00:00,PT1M
002,1980/06/20 10:22:00,P1Y
003,1990/12/19 03:11:44,P3M 
  • We have loaded this file into Pig with a relation named date_duration as given below.
grunt> date_duration = LOAD 'hdfs://localhost:9000/pig_data/wikitechy_date.txt' USING PigStorage(',')
   as (id:int, date:chararray, duration:chararray)
  • We have loaded this file into Pig with a relation named date_duration as given below.
  • Following is an example of the SubtractDuration() function.
  • Now you can subtract certain duration from the given date-time object using this method as given below.
subtractduration_data = foreach date_duration generate(date,duration), 
   SubtractDuration(ToDate(date,'yyyy/MM/dd HH:mm:ss'), duration);

Verification

  • Verify the content of this relation using the Dump operator as given below.
grunt> Dump subtractduration_data;

Output

  • The result of the statement will be stored in the relation named subtractduration_data.
((1989/09/26 09:00:00,PT1M),1989-09-26 T08:59:00.000+05:30)
((1980/06/20 10:22:00,P1Y),1979-06-20 T10:22:00.000+05:30)
((1990/12/19 03:11:44,P3M),1990-09-19 T03:11:44.000+05:30)

Related Searches to Apache Pig - SubtractDuration()

Adblocker detected! Please consider reading this notice.

We've detected that you are using AdBlock Plus or some other adblocking software which is preventing the page from fully loading.

We don't have any banner, Flash, animation, obnoxious sound, or popup ad. We do not implement these annoying types of ads!

We need money to operate the site, and almost all of it comes from our online advertising.

Please add wikitechy.com to your ad blocking whitelist or disable your adblocking software.

×