Morningstar interview questions and answers - Wikitechy

What is the advantages of VB.NET ?

Editor — Thu, 22 Jul 2021 07:43:21 +0000

VB.NET offers code execution that runs under the Common Language Runtime (CLR), resulting in robust, stable and secure applications. Both features of the .NET framework are eagerly obtainable in VB.NET.
VB.NET is object oriented. This is a major addition that VB6 and other earlier releases didn’t have.
The .NET framework comes with ADO.NET, which follows the disconnected paradigm, i.e. once the required records are fetched the connection no longer exists.
It also retrieves the records that are expected to be accessed in the immediate future.
This enhances Scalability of the application to a great extent.
VB.NET uses XML to transfer data between the various layers in the DNA Architecture i.e. data are passed as simple text strings.
Error handling has changed in VB.NET. A new Try-Catch-Finally block has been introduced to handle errors and exceptions as a unit, allowing appropriate action to be taken at the place the error occurred thus discouraging the use of ON ERROR GOTO statement. This again credits to the maintainability of the code.

What is the difference between vb and vb.net ?

Editor — Thu, 22 Jul 2021 07:41:06 +0000

VB	VB.NET
VB stands for Visual Basic. It is a high level programming language that is used for the fast development of Windows based programs.	VB.NET stands for Visual Basic Network Enabled Technology. It is one of the languages for the .NET framework by Microsoft. This language has been created specifically for VB developers. It belongs to the category of object oriented computer programming languages that is implemented on the .NET framework.
Interpreter based Language	Compiled language
VB Runtime	Common Language Specification
This type of language is not safe.	This language is safe compared to visual basic.
Multithreaded applications Cannot be developed.	Multithreaded applications Can be developed.
Data is handled using DAO protocol, then RDO, followed by ADO (ActiveX Data Objects)	Data is handled using ADO.net
An object based language.	A true object oriented language.
Most of the parameters passed by reference.	Parameters passing by Default value.
Objects support default property	Objects does not support default property
Replaced by elements in Collection QBColor, RGB DateAdd, DateDiff, DatePart, DateSerial, DateValue, TimeSerial, TimeValue	System.Collection System.Drawing.Color Replaced by elements in System.DateTime
End Type structure can be used in declare function.	Declared using the Structure…End Structure construct.

What is the difference between sqoop and pig ?

Editor — Thu, 22 Jul 2021 06:59:29 +0000

Pig:

Pig is a platform for managing large data.
It uses high level programming to analyse the data.
The programming is done using the language pig latin.
It is simple and highly specific.
The pig Metastore stores all info about the tables. And we can execute spark sql queries because spark can interact with pig Metastore

Sqoop:

Sqoop is a simple tool used for transferring large amount of data.
It is used for transferring data from hadoop to relational database.
sqoop can import data from Oracle,MYSQL,SQl.
Sqoop metastore is a tool for using hosts in a shared metadata repository. Multiple users and remote users execute saved jobs in metastore.

What is staging table in sqoop ?

Editor — Thu, 22 Jul 2021 06:53:48 +0000

Staging table in sqoop:

Staging table is used to stage the exported data.
Sqoop breaks down method into multiple transactions. A failing job may create partial knowledge.
This could result in job failing because it could cause duplication of data or even collision while insertion.
Staging tables are simple database tables that contain business details.
Staging table acts as an auxiliary table that’s used to transferred data.
Sqoop breaks down export method into multiple transactions, it’s possible that a failing export job may lead to partial data being committed to the database

What is update command in sqoop ?

Editor — Thu, 22 Jul 2021 06:52:07 +0000

Update command in sqoop:

There are two approaches to update in sqoop.
- The records inserted are to be added to the target table.
- The sqoop provides an update mode by providing “update-key ” command.
This command is used to generate the SQl update statement.
If the value in column 1 matches the data is updated else the data is inserted into the table.
This technique is also refered to as upsert where the default action is update but insertion takes place when matching data is not available.

 
$ sqoop export (Generic Arguments)
  --table target-relational-table 
  --update-key column1
  --export-dir /user/my-hdfs-file
  ...
Generates => UPDATE target-relational-table SET
                    column2=1000,column3=2000
		          WHERE column1=100;

What is the use of sqoop ?

Editor — Thu, 22 Jul 2021 06:49:42 +0000

Sqoop uses:

Sqoop is a simple tool that is used for moving data.
It is generally used move data from non hadoop data stores.
These non hadoop data stores are the relational databases and data warehouses .
Sqoop allows the users to specify the target (i.e) the place where the data is to be moved inside of hadoop from relational databases like Oracle,Teredata.
Data ingestion is important in any big data project because the volume of data is generally in petabytes or exabytes.
Hadoop Sqoop and Hadoop Flume are the two tools in Hadoop which is used to gather data from different sources and load them into HDFS.

What is sqoop metastore ?

Editor — Thu, 22 Jul 2021 06:47:16 +0000

Sqoop Metastore:

Sqoop metastore is an internally implemented database that can hold the definition of a given job.
It includes details like which database,which table,which approach,what query to extract from,what target to write to and so on.
Consider an array of SQL databases that have the same structure, but are partitioned by for performance reasons.
Thus we have the same sqoop job running against multiple database instances at the same time, all unified at a single table in Hadoop.
In order to get parallelization, we generate a job that manages the Sqoop sub-workflows. This results in 500 distinct sqoop jobs.
Metastore is used to handle these complexities.

What is sqoop ?

Editor — Thu, 22 Jul 2021 06:22:24 +0000

Sqoop:

Apache Sqoop is efficiently transferring data between Relational databases and Apache Hadoop.
It is used to import data from relational databases such as MySQL, Oracle to Hadoop HDFS, and export from Hadoop file system to relational databases.
It improves the efficiency of data analysis by combining structured data and unstructured data.
Sqoop stands for SQL for Hadoop.SQL + HADOOP =SQOOP