pig tutorial - apache pig tutorial - Apache Pig - YearsBetween() - pig latin - apache pig - pig hadoop




What is YearsBetween() Function?

  • YearsBetween returns the number of whole years between ANow and AThen.
  • This number is an approximation, based on an average number of days of 365.25 per year (average over 4 years).
  • This means the fractional part of a year is dropped.
 Apache Pig Years Between

Learn apache pig - apache pig tutorial - Apache Pig Years Between - apache pig examples - apache pig programs

YearsBetween() function in Apache Pig

This function accepts two date-time objects and calculates the number of years between the two given date-time objects.

Syntax

grunt> YearsBetween(datetime1, datetime2) 

Example

  • Ensure that we have a file named wikitechy_doj_dob.txt in the HDFS directory /pig_data/.
  • This file contains the date-of-birth and date-of-joining details of a particular person, id, date of-birth and date-of-joining.

wikitechy_doj_dob.txt

001,26/09/1989 08:00:00,16/01/2015 08:00:00
002,20/06/1980 10:22:00,10/08/2011 09:00:00
003,19/12/1990 03:11:44,25/10/2012 09:00:00 
  • We have loaded this file into Pig with a relation named doj_dob_data as given below.
doj_dob_data = LOAD 'hdfs://localhost:9000/pig_data/wikitechy_doj_dob.txt' USING PigStorage(',')
   as (id:int, dob:chararray, doj:chararray);
  • Now you can calculate the number of years between date-of-birth and date-of-joining of the employees using the YearsBetween() function as given below.
grunt> yearsbetween_data = foreach Wikitecy_doj_dob_data generate YearsBetween(ToDate(doj,
   'dd/MM/yyyy HH:mm:ss'),ToDate(dob,'dd/MM/yyyy HH:mm:ss'));

Verification

  • Verify the contents of the relation using the Dump operator as given below.
grunt> Dump yearsbetween_data;

Output

  • The above statement stores the result in the relation named yearsbetween_data.

(25)
(31)
(21)

Related Searches to Apache Pig - YearsBetween()

Adblocker detected! Please consider reading this notice.

We've detected that you are using AdBlock Plus or some other adblocking software which is preventing the page from fully loading.

We don't have any banner, Flash, animation, obnoxious sound, or popup ad. We do not implement these annoying types of ads!

We need money to operate the site, and almost all of it comes from our online advertising.

Please add wikitechy.com to your ad blocking whitelist or disable your adblocking software.

×