Data Engineer

Industry: Defense

Duration:  12 Months.

Job Description:

The data engineer will be responsible for collecting, managing, and converting raw data into information that can be interpreted by data scientists and business analysts. Data accessibility and interoperability will be their ultimate goal, which is to enable organizations to utilize data for performance evaluation and optimization.

Qualifications:

• Programming Skills: You should have a strong foundation in programming languages like Python, RUST, Java, and Scala.
• Database Skills: You should be proficient in SQL and know about NoSQL databases such as Cassandra, MongoDB, and HBase.
• Data Warehousing: Understanding the concepts of data warehousing, including ETL (Extract, Transform, Load) processes and data modeling is essential.
• Data Integration: You should be able to integrate data from various sources, such as web services, APIs, and file systems.
• Big Data: Knowledge of distributed computing technologies like Hive, Hadoop, and Spark, is becoming increasingly important for data engineers.
• Cloud Computing: Familiarity with cloud-based storage and computing platforms such as Azure, AWS, and GCP is crucial.
• Data Pipelines: Understanding how to build data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow is critical.
• Version Control: Proficiency in version control systems such as Git and understanding the concepts of branching, merging, and tagging is essential.
• Data Visualization: You should have a good understanding of data visualization tools such as QlikView, Tableau, and Power BI.

Shift: Day