{"id":25142,"date":"2017-10-15T14:45:35","date_gmt":"2017-10-15T09:15:35","guid":{"rendered":"https:\/\/www.wikitechy.com\/technology\/?p=25142"},"modified":"2017-10-15T14:45:35","modified_gmt":"2017-10-15T09:15:35","slug":"quicksort","status":"publish","type":"post","link":"https:\/\/www.wikitechy.com\/technology\/quicksort\/","title":{"rendered":"QuickSort"},"content":{"rendered":"

Like Merge Sort<\/a>, QuickSort is a Divide and Conquer algorithm. It picks an element as pivot and partitions the given array around the picked pivot. <\/span>There are many different versions of quickSort that pick pivot in different ways.<\/p>\n

    \n
  1. Always pick first element as pivot.<\/li>\n
  2. Always pick last element as pivot (implemented below)<\/li>\n
  3. Pick a random element as pivot.<\/li>\n
  4. Pick median as pivot.<\/li>\n<\/ol>\n

    The key process in quickSort is partition(). Target of partitions is, given an array and an element x of array as pivot, put x at its correct position in sorted array and put all smaller elements (smaller than x) before x, and put all greater elements (greater than x) after x. All this should be done in linear time.<\/p>\n

    Pseudo Code for recursive QuickSort function :<\/strong><\/p>\n

    \/* low  --> Starting index,  high  --> Ending index *\/\r\nquickSort(arr[], low, high)\r\n{\r\n    if (low < high)\r\n    {\r\n        \/* pi is partitioning index, arr[p] is now\r\n           at right place *\/\r\n        pi = partition(arr, low, high);\r\n\r\n        quickSort(arr, low, pi - 1);  \/\/ Before pi\r\n        quickSort(arr, pi + 1, high); \/\/ After pi\r\n    }\r\n}\r\n<\/pre>\n
     <\/p>\n
    \"Quick<\/p>\n[ad type=”banner”]\n
    Partition Algorithm<\/strong>
    \nThere can be many ways to do partition, following pseudo code adopts the method given in CLRS book. The logic is simple, we start from the leftmost element and keep track of index of smaller (or equal to) elements as i. While traversing, if we find a smaller element, we swap current element with arr[i]. Otherwise we ignore current element.<\/p>\n
    \/* low  --> Starting index,  high  --> Ending index *\/\r\nquickSort(arr[], low, high)\r\n{\r\n    if (low < high)\r\n    {\r\n        \/* pi is partitioning index, arr[p] is now\r\n           at right place *\/\r\n        pi = partition(arr, low, high);\r\n\r\n        quickSort(arr, low, pi - 1);  \/\/ Before pi\r\n        quickSort(arr, pi + 1, high); \/\/ After pi\r\n    }\r\n}\r\n<\/pre>\n
    Pseudo code for partition()<\/strong><\/p>\n
    \/* This function takes last element as pivot, places\r\n   the pivot element at its correct position in sorted\r\n    array, and places all smaller (smaller than pivot)\r\n   to left of pivot and all greater elements to right\r\n   of pivot *\/\r\npartition (arr[], low, high)\r\n{\r\n    \/\/ pivot (Element to be placed at right position)\r\n    pivot = arr[high];  \r\n \r\n    i = (low - 1)  \/\/ Index of smaller element\r\n\r\n    for (j = low; j <= high- 1; j++)\r\n    {\r\n        \/\/ If current element is smaller than or\r\n        \/\/ equal to pivot\r\n        if (arr[j] <= pivot)\r\n        {\r\n            i++;    \/\/ increment index of smaller element\r\n            swap arr[i] and arr[j]\r\n        }\r\n    }\r\n    swap arr[i + 1] and arr[high])\r\n    return (i + 1)\r\n}\r\n<\/pre>\n[ad type=”banner”]\n
    Illustration of partition() :<\/strong><\/p>\n
    arr[] = {10, 80, 30, 90, 40, 50, 70}\r\nIndexes:  0   1   2   3   4   5   6 \r\n\r\nlow = 0, high =  6, pivot = arr[h] = 70\r\nInitialize index of smaller element, i = -1<\/strong>\r\n\r\nTraverse elements from j = low to high-1\r\nj = 0<\/strong> : Since arr[j] <= pivot, do i++ and swap(arr[i], arr[j])\r\ni = 0 <\/strong>\r\narr[] = {10, 80, 30, 90, 40, 50, 70} \/\/ No change as i and j \r\n                                     \/\/ are same\r\n\r\nj = 1<\/strong> : Since arr[j] > pivot, do nothing\r\n\/\/ No change in i and arr[]\r\n\r\nj = 2<\/strong> : Since arr[j] <= pivot, do i++ and swap(arr[i], arr[j])\r\ni = 1<\/strong>\r\narr[] = {10, 30, 80, 90, 40, 50, 70} \/\/ We swap 80 and 30 \r\n\r\nj = 3<\/strong> : Since arr[j] > pivot, do nothing\r\n\/\/ No change in i and arr[]\r\n\r\nj = 4<\/strong> : Since arr[j] <= pivot, do i++ and swap(arr[i], arr[j])\r\ni = 2<\/strong>\r\narr[] = {10, 30, 40, 90, 80, 50, 70} \/\/ 80 and 40 Swapped\r\nj = 5<\/strong> : Since arr[j] <= pivot, do i++ and swap arr[i] with arr[j] \r\ni = 3<\/strong> \r\narr[] = {10, 30, 40, 50, 80, 90, 70} \/\/ 90 and 50 Swapped \r\n\r\nWe come out of loop because j is now equal to high-1.\r\nFinally we place pivot at correct position by swapping\r\narr[i+1] and arr[high] (or pivot)<\/strong> \r\narr[] = {10, 30, 40, 50, 70, 90, 80} \/\/ 80 and 70 Swapped \r\n\r\nNow 70 is at its correct place. All elements smaller than\r\n70 are before it and all elements greater than 70 are after\r\nit.<\/pre>\n
    \n
    Recommended: Please solve it on “PRACTICE<\/u><\/b>” first, before moving on to the solution.<\/h4>\n[ad type=”banner”]\n<\/div>\n
    Implementation:<\/strong>
    \nFollowing are C++, Java and Python implementations of QuickSort.<\/p>\n
    C++<\/strong><\/p>\n
     
     c<\/span> <\/div> 
    \/* C implementation QuickSort *\/#include<stdio.h> \/\/ A utility function to swap two elementsvoid swap(int* a, int* b){    int t = *a;    *a = *b;    *b = t;} \/* This function takes last element as pivot, places   the pivot element at its correct position in sorted    array, and places all smaller (smaller than pivot)   to left of pivot and all greater elements to right   of pivot *\/int partition (int arr[], int low, int high){    int pivot = arr[high];    \/\/ pivot    int i = (low - 1);  \/\/ Index of smaller element     for (int j = low; j <= high- 1; j++)    {        \/\/ If current element is smaller than or        \/\/ equal to pivot        if (arr[j] <= pivot)        {            i++;    \/\/ increment index of smaller element            swap(&arr[i], &arr[j]);        }    }    swap(&arr[i + 1], &arr[high]);    return (i + 1);} \/* The main function that implements QuickSort arr[] --> Array to be sorted,  low  --> Starting index,  high  --> Ending index *\/void quickSort(int arr[], int low, int high){    if (low < high)    {        \/* pi is partitioning index, arr[p] is now           at right place *\/        int pi = partition(arr, low, high);         \/\/ Separately sort elements before        \/\/ partition and after partition        quickSort(arr, low, pi - 1);        quickSort(arr, pi + 1, high);    }} \/* Function to print an array *\/void printArray(int arr[], int size){    int i;    for (i=0; i < size; i++)        printf("%d ", arr[i]);    printf("\\n");} \/\/ Driver program to test above functionsint main(){    int arr[] = {10, 7, 8, 9, 1, 5};    int n = sizeof(arr)\/sizeof(arr[0]);    quickSort(arr, 0, n-1);    printf("Sorted array: \\n");    printArray(arr, n);    return 0;}<\/code><\/pre> <\/div>\n
    Java<\/strong><\/p>\n
     
     <\/div> 
    \/\/ Java program for implementation of QuickSortclass QuickSort{    \/* This function takes last element as pivot,       places the pivot element at its correct       position in sorted array, and places all       smaller (smaller than pivot) to left of       pivot and all greater elements to right       of pivot *\/    int partition(int arr[], int low, int high)    {        int pivot = arr[high];         int i = (low-1); \/\/ index of smaller element        for (int j=low; j<high; j++)        {            \/\/ If current element is smaller than or            \/\/ equal to pivot            if (arr[j] <= pivot)            {                i++;                 \/\/ swap arr[i] and arr[j]                int temp = arr[i];                arr[i] = arr[j];                arr[j] = temp;            }        }         \/\/ swap arr[i+1] and arr[high] (or pivot)        int temp = arr[i+1];        arr[i+1] = arr[high];        arr[high] = temp;         return i+1;    }      \/* The main function that implements QuickSort()      arr[] --> Array to be sorted,      low  --> Starting index,      high  --> Ending index *\/    void sort(int arr[], int low, int high)    {        if (low < high)        {            \/* pi is partitioning index, arr[pi] is               now at right place *\/            int pi = partition(arr, low, high);             \/\/ Recursively sort elements before            \/\/ partition and after partition            sort(arr, low, pi-1);            sort(arr, pi+1, high);        }    }     \/* A utility function to print array of size n *\/    static void printArray(int arr[])    {        int n = arr.length;        for (int i=0; i<n; ++i)            System.out.print(arr[i]+" ");        System.out.println();    }     \/\/ Driver program    public static void main(String args[])    {        int arr[] = {10, 7, 8, 9, 1, 5};        int n = arr.length;         QuickSort ob = new QuickSort();        ob.sort(arr, 0, n-1);         System.out.println("sorted array");        printArray(arr);    }}\/*This code is contributed by Rajat Mishra *\/<\/code><\/pre> <\/div>\n
    Python<\/strong><\/p>\n
     
     <\/div> 
    # Python program for implementation of Quicksort Sort # This function takes last element as pivot, places# the pivot element at its correct position in sorted# array, and places all smaller (smaller than pivot)# to left of pivot and all greater elements to right# of pivotdef partition(arr,low,high):    i = ( low-1 )         # index of smaller element    pivot = arr[high]     # pivot     for j in range(low , high):         # If current element is smaller than or        # equal to pivot        if   arr[j] <= pivot:                     # increment index of smaller element            i = i+1            arr[i],arr[j] = arr[j],arr[i]     arr[i+1],arr[high] = arr[high],arr[i+1]    return ( i+1 ) # The main function that implements QuickSort# arr[] --> Array to be sorted,# low  --> Starting index,# high  --> Ending index # Function to do Quick sortdef quickSort(arr,low,high):    if low < high:         # pi is partitioning index, arr[p] is now        # at right place        pi = partition(arr,low,high)         # Separately sort elements before        # partition and after partition        quickSort(arr, low, pi-1)        quickSort(arr, pi+1, high) # Driver code to test abovearr = [10, 7, 8, 9, 1, 5]n = len(arr)quickSort(arr,0,n-1)print ("Sorted array is:")for i in range(n):    print ("%d" %arr[i]), <\/code><\/pre> <\/div>\n
    Output:<\/p>\n
    Sorted array:\r\n1 5 7 8 9 10<\/pre>\n[ad type=”banner”]\n
    Analysis of QuickSort<\/strong>
    \nTime taken by QuickSort in general can be written as following.<\/p>\n
     T(n) = T(k) + T(n-k-1) + \"\\theta\"(n)<\/pre>\n
    The first two terms are for two recursive calls, the last term is for the partition process. k is the number of elements which are smaller than pivot.
    \nThe time taken by QuickSort depends upon the input array and partition strategy. Following are three cases.<\/p>\n
    Worst Case:<\/strong><\/em> The worst case occurs when the partition process always picks greatest or smallest element as pivot. If we consider above partition strategy where last element is always picked as pivot, the worst case would occur when the array is already sorted in increasing or decreasing order. Following is recurrence for worst case.<\/p>\n
     T(n) = T(0) + T(n-1) + \"\\theta\"(n)\r\nwhich is equivalent to  \r\n T(n) = T(n-1) + \"\\theta\"(n)\r\n<\/pre>\n
    The solution of above recurrence is \"\\theta\"(n2<\/sup>).<\/p>\n
    Best Case:<\/strong><\/em> The best case occurs when the partition process always picks the middle element as pivot. Following is recurrence for best case.<\/p>\n
     T(n) = 2T(n\/2) + \"\\theta\"(n)<\/pre>\n
    The solution of above recurrence is \"\\theta\"(nLogn). It can be solved using case 2 of Master Theorem<\/a>.<\/p>\n
    Average Case:<\/strong><\/em>
    \nTo do average case analysis, we need to     consider all possible permutation of array and calculate time taken by every permutation which doesn\u2019t look easy<\/a>.
    \nWe can get an idea of average case by considering the case when partition puts O(n\/9) elements in one set and O(9n\/10) elements in other set. Following is recurrence for this case.<\/p>\n
     T(n) = T(n\/9) + T(9n\/10) + \"\\theta\"(n)<\/pre>\n
    Solution of above recurrence is also O(nLogn)<\/p>\n
    Although the worst case time complexity of QuickSort is O(n2<\/sup>) which is more than many other sorting algorithms like Merge Sort<\/a> and Heap Sort<\/a>, QuickSort is faster in practice, because its inner loop can be efficiently implemented on most architectures, and in most real-world data. QuickSort can be implemented in different ways by changing the choice of pivot, so that the worst case rarely occurs for a given type of data. However, merge sort is generally considered better when data is huge and stored in external storage.<\/p>\n[ad type=”banner”]\n
    What is 3-Way QuickSort?<\/strong>
    \nIn simple QuickSort algorithm, we select an element as pivot, partition the array around pivot and recur for subarrays on left and right of pivot.
    \nConsider an array which has many redundant elements. For example, {1, 4, 2, 4, 2, 4, 1, 2, 4, 1, 2, 2, 2, 2, 4, 1, 4, 4, 4}. If 4 is picked as pivot in Simple QuickSort, we fix only one 4 and recursively process remaining occurrences. In 3 Way QuickSort, an array arr[l..r] is divided in 3 parts:
    \na) arr[l..i] elements less than pivot.
    \nb) arr[i+1..j-1] elements equal to pivot.
    \nc) arr[j..r] elements greater than pivot.
    \nSee     this<\/a> for implementation.<\/p>\n
    How to implement QuickSort for Linked Lists?<\/strong>
    \n    QuickSort on Singly Linked List<\/a>
    \n    QuickSort on Doubly Linked List<\/a><\/p>\n
    Can we implement QuickSort Iteratively?<\/strong>
    \nYes, please refer     Iterative Quick Sort<\/a>.<\/p>\n
    Why Quick Sort is preferred over MergeSort for sorting Arrays<\/strong>
    \nQuick Sort in its general form is an in-place sort (i.e. it doesn\u2019t require any extra storage) whereas merge sort requires O(N) extra storage, N denoting the array size which may be quite expensive. Allocating and de-allocating the extra space used for merge sort increases the running time of the algorithm. Comparing average complexity we find that both type of sorts have O(NlogN) average complexity but the constants differ. For arrays, merge sort loses due to the use of extra O(N) storage space.<\/p>\n
    Most practical implementations of Quick Sort use randomized version. The randomized version has expected time complexity of O(nLogn). The worst case is possible in randomized version also, but worst case doesn\u2019t occur for a particular pattern (like sorted array) and randomized Quick Sort works well in practice.<\/p>\n
    Quick Sort is also a cache friendly sorting algorithm as it has good locality of reference when used for arrays.<\/p>\n
    Quick Sort is also tail recursive, therefore tail call optimizations is done.<\/p>\n
    Why MergeSort is preferred over QuickSort for Linked Lists?<\/strong>
    \nIn case of linked lists the case is different mainly due to difference in memory allocation of arrays and linked lists. Unlike arrays, linked list nodes may not be adjacent in memory. Unlike array, in linked list, we can insert items in the middle in O(1) extra space and O(1) time. Therefore merge operation of merge sort can be implemented without extra space for linked lists.<\/p>\n
    In arrays, we can do random access as elements are continuous in memory. Let us say we have an integer (4-byte) array A and let the address of A[0] be x then to access A[i], we can directly access the memory at (x + i*4). Unlike arrays, we can not do random access in linked list. Quick Sort requires a lot of this kind of access. In linked list to access i\u2019th index, we have to travel each and every node from the head to i\u2019th node as we don\u2019t have continuous block of memory. Therefore, the overhead increases for quick sort. Merge sort accesses data sequentially and the need of random access is low.<\/p>\n[ad type=”banner”]\n","protected":false},"excerpt":{"rendered":"
    QuickSort – Searching and Sorting – Like Merge Sort, QuickSort is a Divide and Conquer algorithm. It picks an element as pivot and partitions.There are many different versions of quickSort that pick pivot in different ways.<\/p>\n","protected":false},"author":1,"featured_media":25150,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[83502,71670],"tags":[70054,71128,71706,71133,71723,70461,71121,71135,71134,71137,71130,71122,71129,70780,70465,71710,70497,71708,71496,71720,70271,70928,71216,70017,71699,71705,70969,70262,71262,71263,71698,71701,71716,71718,71070,71700,71703,71267,71728,71713,71709,71172,71693,71704,71707,71711,70046,71714,71712,71702,71715,71717,71721,71725,71265,71677,71722,71696,71724,71719,71694,71727,71266,70056,71697,71695,70020,70967,71726],"class_list":["post-25142","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-quick-sort","category-searching-and-sorting","tag-algorithm","tag-algorithm-for-bubble-sort","tag-algorithm-for-quicksort","tag-algorithm-of-bubble-sort","tag-algorithm-of-quicksort","tag-bubble-sort","tag-bubble-sort-algorithm","tag-bubble-sort-algorithm-in-data-structure","tag-bubble-sort-algorithm-with-example","tag-bubble-sort-example-step-by-step","tag-bubble-sort-in-data-structure","tag-bubble-sort-java","tag-bubble-sort-program","tag-bubblesort","tag-bucket-sort","tag-c-program-for-quick-sort","tag-counting-sort","tag-dr-scheme","tag-dynamic-programming-algorithm","tag-example-of-quicksort","tag-heap-sort","tag-heap-sort-algorithm","tag-insertion-sort","tag-insertion-sort-algorithm","tag-java","tag-java-process","tag-java-sorting-algorithms","tag-merge-sort","tag-merge-sort-algorithm","tag-merge-sort-java","tag-oops","tag-parallel-quicksort","tag-program-for-quick-sort","tag-program-for-quicksort-in-c","tag-programming","tag-programming-algorithms","tag-quick-short","tag-quick-sort-algorithm","tag-quick-sort-algorithm-in-c","tag-quick-sort-c-program","tag-quick-sort-ppt","tag-quick-sort-program","tag-quick-sort-program-in-c","tag-quick-sort-program-in-c-with-explanation","tag-quick-sort-program-in-cpp","tag-quick-sort-program-in-java","tag-quicksort","tag-quicksort-algorithm-in-data-structure","tag-quicksort-algorithm-with-example","tag-quicksort-algorithm-with-example-in-data-structure","tag-quicksort-analysis","tag-quicksort-animation","tag-quicksort-c-code","tag-quicksort-code-in-c","tag-quicksort-example","tag-quicksort-explained","tag-quicksort-explanation-with-example","tag-quicksort-in-c","tag-quicksort-in-c-program","tag-quicksort-in-data-structure-with-example","tag-quicksort-in-java","tag-quicksort-tutorial","tag-radix-sort-algorithm","tag-recursion","tag-shell-sort","tag-sorted","tag-sorting-algorithms","tag-sorting-algorithms-java","tag-what-is-quicksort"],"_links":{"self":[{"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/posts\/25142","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/comments?post=25142"}],"version-history":[{"count":0,"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/posts\/25142\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/media\/25150"}],"wp:attachment":[{"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/media?parent=25142"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/categories?post=25142"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wikitechy.com\/technology\/wp-json\/wp\/v2\/tags?post=25142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}