hidden hit counter

Junior Data Engineer Job at Recruitment Room, Egypt

VG1jN0c0V2NuTGNoTG44Q1EvYWtwVkZqZVE9PQ==
  • Recruitment Room
  • Egypt

Job Description

What we are looking for

Were looking for a candidate with a foundational understanding of data engineering concepts and handson experience with relevant technologies. This role provides the opportunity to grow into a senior data engineering position contributing to innovative cloudbased projects.

What does the job involve

  • Data Pipeline Development: Assist in implementing and maintaining scalable data pipelines for ingesting processing and transforming large volumes of data from various sources using tools such as Databricks Python and PySpark.
  • Data Modeling: Assist in designing data models and schemas for efficient storage retrieval and analysis of structured and unstructured data.
  • ETL Processes : Develop and automate ETL workflows to extract data from diverse sources transform it into usable formats and load it into data warehouses data lakes or lakehouses.
  • Big Data Technologies: Utilize big data technologies such as Spark Kafka and Flink for distributed data processing and analytics.
  • Cloud Platforms: Collaborate with the team to deploy data solutions on cloud platforms such as AWS Azure or Google Cloud Platform (GCP) leveraging cloudnative services for data storage processing and analytics.
  • Data Quality and Governance: Implement data quality checks validation processes and data governance policies to ensure accuracy consistency and compliance with regulations.
  • Monitoring and Troubleshooting: Monitor data pipelines and assist in troubleshooting and resolving datarelated issues.
  • DevOps: Commit code to version control.
  • Collaboration: Collaborate with crossfunctional teams including data scientists analysts and software engineers to understand requirements and deliver datadriven solutions.
  • Documentation: Create and maintain technical documentation including data architecture diagrams ETL workflows and system documentation to facilitate understanding and maintainability of data solutions.
  • Best Practices : Continuously learn and apply best practices in data engineering and cloud computing.

Qualifications

  • Programming Languages: Experience with Python Java Scala or SQL for data manipulation and scripting.
  • Big Data Technologies: Experience with Databricks Spark Kafka and Flink.
  • Version Control : Experience with systems like Git.
  • Cloud Platforms: Familiarity with AWS Azure or GCP services.
  • SQL: Proficiency in SQL for database management and querying.
  • Apache Spark: Knowledge of Apache Spark for distributed data processing.
  • Modern Data Architectures : Exposure to modern data architectures such as lakehouse.
  • ETL Tools: Knowledge of ETL tools and technologies such as Apache Airflow Informatica or Talend.
  • Cl oud Data Tools : Familiarity with cloud data services like AWS S3 EMR Redshift Glue Azure Data Factory Databricks BigQuery Dataflow and Dataproc.

Benefits

Competitive Salary

Location

Remote Egypt Kenya South Africa Nigeria

Job Tags

Full time, Remote job,

Similar Jobs

Bunker Hill Community College

P/T Writing Place Assistant Coordinator - English Department - Bunker Hill Community College | Bunker Hill Community College Job at Bunker Hill Community College

 ...Location: Boston, MA Category: Part Time Non-Benefited Positions Posted On: Thu Sep 5 2024 Job Description: The Writing Place...  ...15 community colleges in Massachusetts, serving some 18,000 students annually across all modes of instruction. The College offers... 

hims & hers

Creative Director, Design Job at hims & hers

 ...Compliance that doesnt SOC 2 much billboards. Were now looking for a Creative Director to elevate Vantas brand to the next level, scale our...  ...of Art Directors and Designers and our external network of agencies and freelancers to produce creative that delights our customers... 

Visiting Angels of Jenkintown

HR Recruitment Coordinator Job at Visiting Angels of Jenkintown

 ...looking for a full-time HR Recruitment Coordinator to join our Human Resources Team! THIS IS AN "IN-OFFICE" Role (not REMOTE) This...  ...and a mentor to caregivers within the organization Assist Manager/Director with varied tasks and duties Our ideal candidate... 

EssilorLuxottica Group

Licensed Optician Job at EssilorLuxottica Group

 ...EssilorLuxottica, a global leader in the design, manufacture and distribution of ophthalmic lenses, frames and sunglasses. The Licensed Optician delivers the brand value proposition & helps establish LensCrafters as the premier destination for all vision needs within the... 

The National Endowment for Democracy

2446 - Data Integration Engineer Job at The National Endowment for Democracy

 ...motivated, energetic, organized, and resourceful Data Integration Engineer who is a mission-oriented team player, and who would be...  ...Dynamics, and ADP systems is a plus. Prior experience in a non-profit environment is highly desirable.Experience with SQL and relational...