Standard Chartered Global Business Services Private Limited interview questions and answers - Wikitechy https://www.wikitechy.com/interview-questions/tag/standard-chartered-global-business-services-private-limited-interview-questions-and-answers/ Interview Questions Thu, 09 Sep 2021 06:48:44 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 https://www.wikitechy.com/interview-questions/wp-content/uploads/2025/10/cropped-wikitechy-icon-32x32.png Standard Chartered Global Business Services Private Limited interview questions and answers - Wikitechy https://www.wikitechy.com/interview-questions/tag/standard-chartered-global-business-services-private-limited-interview-questions-and-answers/ 32 32 What are the differences between Impala and Apache Drill ? https://www.wikitechy.com/interview-questions/cloudera-impala/what-are-the-differences-between-impala-and-apache-drill/ https://www.wikitechy.com/interview-questions/cloudera-impala/what-are-the-differences-between-impala-and-apache-drill/#respond Mon, 19 Jul 2021 06:41:05 +0000 https://www.wikitechy.com/interview-questions/?p=1025

Difference between Impala and Apache Drill

Index Cloudera impala Apache Drill
Description Analytic DBMS for Hadoop Schema-free SQL Query Engine for Hadoop,
NoSQL and Cloud Storage
Primary database modele relational DBMS document store relational DBMS
Developer Cloudera Apache Software Foundation
License open source open source
Server operating systems Linux Linux,OSX, Windows
Data scheme yes schema-free
Secondary indexes yes no
SQL SQL-like DML and DDL statements SQL SELECT statement is SQL:2003 compliant
Supported programming languages All languages supporting JDBC/ODBC C++
cloudera-impala-tutorials
Query planner
ximpala arch
]]> https://www.wikitechy.com/interview-questions/cloudera-impala/what-are-the-differences-between-impala-and-apache-drill/feed/ 0 What is the difference between Impala and Apache Hive ? https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-difference-between-impala-and-apache-hive/ https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-difference-between-impala-and-apache-hive/#respond Mon, 19 Jul 2021 06:40:04 +0000 https://www.wikitechy.com/interview-questions/?p=1024

Difference between Impala and Apache Hive

Impala Apache hive
Impala does runtime code generations
for “big loops ” using llvm.		 Apache hive generates query
expressions at compile time.
Hadoop 2.6.0 Hadoop 2.7.3
Runtime Filtering Optimization Enabled All queries run through LLAP
Parquet format with snappy compression ORCFile format with zlib compression
Impala avoids startup overhead
as daemon processes are started at boot
time itself, always being ready to processes a query.		 Every hive query has this problem
of “cold start”.
Impala is meant for interactive computing. Apache Hive might not be ideal
for interactive computing .
Impala is more like MPP database. Hive is batch based Hadoop MapReduce .
Impala does not support complex types. Hive supports complex types .
Impala does not support fault tolerance Apache Hive is fault tolerant
hive-architecture

rimpala
]]> https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-difference-between-impala-and-apache-hive/feed/ 0 What is the difference between Apache Hadoop and Cloudera in big data ? https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-difference-between-apache-hadoop-and-cloudera-in-big-data/ https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-difference-between-apache-hadoop-and-cloudera-in-big-data/#respond Mon, 19 Jul 2021 06:38:24 +0000 https://www.wikitechy.com/interview-questions/?p=1023

Difference between Apache Hadoop and Cloudera in big data

  • Apache Hadoop is the Hadoop distribution from Apache group.
  • Cloudera Hadoop has its own supply of Hadoop which is designed on top of Apache Hadoop. so it does not have latest release of Hadoop.
  • Cloudera Hadoop contains extra tools. while Hadoop distributions like Cloudera Search, Impala, Cloudera Navigator and Cloudera Manager these are not involved in Cloudera Hadoop.
  • These additional tools turns out Cloudera Hadoop to be slightly open source and proprietary.
Distribution hadoop
  • Apache Hadoop is very important to use to cope up with any data, no matter how large or what type or complex it is. It works like a fluid way or can say it is very faster, cheaper and reliable analytic tool than others.
  • Even, it can easily work on unstructured, and schemaless data and people can easily ground their data into a format without reformating or putting any other efforts.
  • Apart from this, via Apache Hadoop various programming model has been simplified to allow you to quickly write and test the software in distributed systems.
  • This is an open-source Apache Hadoop distribution usually, focus on enterprise-class deployments.
  • Cloudera Inc is a very popular American software company, known for providing Apache Hadoop-based software, services, and full support for the same.
  • With Cloudera, it is said that Hadoop is just a starting to create your data management strategy, and you can easily use the same to add the security and other various functions to create an enterprise-grade foundation for your data.
]]> https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-difference-between-apache-hadoop-and-cloudera-in-big-data/feed/ 0 What is the architectural design and features of Cloudera Impala ? https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-architectural-design-and-features-of-cloudera-impala/ https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-architectural-design-and-features-of-cloudera-impala/#respond Mon, 19 Jul 2021 06:35:32 +0000 https://www.wikitechy.com/interview-questions/?p=1022

Components of the Impala Server

cloudera-impala-tutorials
  • The impala server consist of distributed and massively parallel processing info engine.
  • It run on particular hosts among your CDH cluster with a various daemon processes.
The Impala Daemon
  • The core impala element may be a daemon method that runs on every node of the cluster, and its physically described by the impalad method.
  • Then read and write a informative files; which accepts questions transmitted from the impala-shell command, Hue, JDBC, or ODBC; parallelizes the questions can seperate work to alternative nodes within the impala cluster; and transmits intermediate question results back to the central organizer node.
  • The impala daemon running on any node, and that node is the organizer node for that question when You can submit a question.
  • The other nodes transmit partial results back to the organizer, that constructs the ultimate result set for a question.
  • You may continuously connect with a similar impala daemon for convenience.When running experiments with possibility through the impala-shell command.
  • For clusters running production workloads, you would possibly load-balance between the nodes by submitting every question to a distinct impala daemon in round-robin vogue, exploitation the JDBC or ODBC interfaces.
  • Its verify that nodes and may settle for new work. Through the impala daemons are in constant communication with the statestore.

The Impala Statestore

  • The impala element called the statestore checks on the health of impala daemons on all the nodes during a cluster, and unendingly relays its findings to every of these daemons.
  • It is physically described by a daemon method named statestored; you simply would like such a method on one node within the cluster.
  • If an impala node goes offline because of hardware failure, network error, software package issue, or alternative reason, the statestore informs all the opposite nodes so future queries will avoid creating requests to the unreached node.
architectural design

New options in Impala:

  • Performance and quantifiability enhancements.
  • Integration with Apache koodoo.
  • Security.
  • The REFRESH statement currently updates data regarding HDFS block locations.
  • [IMPALA-1654] many varieties of DDL operations will currently work on a spread of partitions.
]]> https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-the-architectural-design-and-features-of-cloudera-impala/feed/ 0 What is Cloudera’s technology stack ? https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-clouderas-technology-stack/ https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-clouderas-technology-stack/#respond Mon, 19 Jul 2021 06:33:22 +0000 https://www.wikitechy.com/interview-questions/?p=1021

Cloudera’s technology stack

  • Here are some products that make up Cloudera’s tech stack:
    • Adobe Experience Manager,
    • Amazon EC2,
    • Apache (Ant, HBase, Kafka, Maven, Mesos, Solr, Spark, Web Server),
    • Atlassian JIRA,
    • Bugsnag,
    • C++,
    • Cask Data Applicaiton Platform,
    • Dyn DNS,
    • Fastly,
    • Git,
    • GitHub,
    • Google Fonts,
    • Impala,
    • Java,
    • Jenkins,
    • Mirantis,
    • Piston,
    • Python,
    • RBCommons,
    • Red Hat Enterprise Linux,
    • Scala, and
    • VMware vSphere.

Additionally, here’s a list of other software products that Cloudera is using internally,

  • Marketing: AdRoll, AppNexus, BrightFunnel, Demandbase
  • Sales and Support: Infer, MindTickle, Outreach, Salesforce Sales Cloud
  • Analytics: Adobe Analytics, Amplitude, Chartbeat, Tableau Software
  • HR: AngelList Jobs, Codility, RolePoint, The Muse
  • Finance: Concur, Ombud, SteelBrick
  • Productivity: Box, Google Apps for Work, LibreOffice, Microsoft Office 365
Cloudera enterprise
]]> https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-clouderas-technology-stack/feed/ 0 What is cloudera impala ? https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-cloudera-impala/ https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-cloudera-impala/#respond Mon, 19 Jul 2021 06:30:25 +0000 https://www.wikitechy.com/interview-questions/?p=1015

Cloudera’s Impala

cloudera-impala-tutorial
Impala was the first to bring SQL querying to the public in April 2013. Impala comes with a bunch of interesting features:
  • Impala can query many file format such as Parquet, Avro, Text, RCFile, SequenceFile
  • Impala supports data stored in HDFS, Apache HBase and Amazon S3
  • Impala supports multiple compression codecs:
    • Snappy (Recommended for its effective balance between compression ratio and decompression speed),
    • Gzip (Recommended when achieving the highest level of compression),
    • Deflate (not supported for text files), Bzip2, LZO (for text files only);
  • Impala provides security through authorization based on Sentry (OS user ID)
    • Defining which users are allowed to access which resources,
    • What operations are they allowed to perform authentication based on Kerberos + ability to specify Active Directory username/password,
    • How does Impala verify the identity of the users to confirm that they are allowed exercise their privileges assigned to that user auditing,
    • What operations were attempted,
    • Did they succeed or not, allowing to track down suspicious activity; audit data are collected by Cloudera Manager;
  • Impala supports SSL network encryption between Impala and client programs, and between the Impala-related daemons running on different nodes in the cluster;
  • Impala allows to use UDFs and UDAFs;
  • Impala orders the joins automatically to be the most efficient;
  • Impala allows admission control – prioritization and queueing of queries within impala;
  • Impala allows multi-user concurrent queries;
  • Impala caches frequently accessed data in memory;
  • Impala computes statistics (with COMPUTE STATS);
  • Impala provides window functions (aggregation OVER PARTITION, RANK, LEAD, LAG, NTILE, and so on) – to provide more advanced SQL analytic capabilities (since version 2.0);
  • Impala allows external joins and aggregation using disk (since version 2.0) – enables operations to spill to disk if their internal state exceeds the aggregate memory size;
  • Impala allows subqueries inside WHERE clauses;
  • Impala allows incremental statistics – only run statistics on the new or changed data for even faster statistics computations;
  • Impala enables queries on complex nested structures including maps, structs and arrays;
  • Impala enables merging (MERGE) in updates into existing tables;
  • Impala enables some OLAP functions (ROLLUP, CUBE, GROUPING SET);
  • Impala allows use of impala for inserts and updates into HBase.
]]> https://www.wikitechy.com/interview-questions/cloudera-impala/what-is-cloudera-impala/feed/ 0