pig tutorial - apache pig tutorial - Apache Pig - YearsBetween() - pig latin - apache pig - pig hadoop



What is YearsBetween() Function?

  • YearsBetween returns the number of whole years between ANow and AThen.
  • This number is an approximation, based on an average number of days of 365.25 per year (average over 4 years).
  • This means the fractional part of a year is dropped.
 Apache Pig Years Between

Learn apache pig - apache pig tutorial - Apache Pig Years Between - apache pig examples - apache pig programs

YearsBetween() function in Apache Pig

This function accepts two date-time objects and calculates the number of years between the two given date-time objects.

Syntax

grunt> YearsBetween(datetime1, datetime2) 

Example

  • Ensure that we have a file named wikitechy_doj_dob.txt in the HDFS directory /pig_data/.
  • This file contains the date-of-birth and date-of-joining details of a particular person, id, date of-birth and date-of-joining.

wikitechy_doj_dob.txt

001,26/09/1989 08:00:00,16/01/2015 08:00:00
002,20/06/1980 10:22:00,10/08/2011 09:00:00
003,19/12/1990 03:11:44,25/10/2012 09:00:00 
  • We have loaded this file into Pig with a relation named doj_dob_data as given below.
doj_dob_data = LOAD 'hdfs://localhost:9000/pig_data/wikitechy_doj_dob.txt' USING PigStorage(',')
   as (id:int, dob:chararray, doj:chararray);
  • Now you can calculate the number of years between date-of-birth and date-of-joining of the employees using the YearsBetween() function as given below.
grunt> yearsbetween_data = foreach Wikitecy_doj_dob_data generate YearsBetween(ToDate(doj,
   'dd/MM/yyyy HH:mm:ss'),ToDate(dob,'dd/MM/yyyy HH:mm:ss'));

Verification

  • Verify the contents of the relation using the Dump operator as given below.
grunt> Dump yearsbetween_data;

Output

  • The above statement stores the result in the relation named yearsbetween_data.

(25)
(31)
(21)

Related Searches to Apache Pig - YearsBetween()