Data Engineer

Job Description: Data Engineer

About Data & AI Office: 

• Are you ready to pioneer our Data-driven future? Come be a part of “0 to 1” Data and AI transformation that will enable data driven decisions with actionable intelligence for business leaders to achieve their business outcomes
• An amazing opportunity to be a part of team that is setting up, defining and implementing from the ground up a data management strategy, implementing robust and scalable data ingestion, data storage (data lake, data warehouse) platforms and building an API hub to enable downstream data exchange to shape the future of our rapidly growing business decisions.

Position Overview: We are seeking a skilled and motivated Data Engineer to join our dynamic Data and AI team. The ideal candidate will play a crucial role in designing, building, and maintaining data pipelines and infrastructure, enabling our organization to leverage data for business insights and decision-making.

Key Responsibilities:

• Data Pipeline Development:
  • Design, develop, and maintain scalable and robust data pipelines to ingest, process, and store large volumes of data from various sources.
  • Implement ETL (Extract, Transform, Load) processes to ensure data integrity and quality.
• Data Architecture:
  • Collaborate with data architects and data scientists to create and optimize data models and databases that support analytical needs.
  • Ensure data is organized, accessible, and well-documented for both technical and non-technical stakeholders.
• Collaboration:
  • Work closely with cross-functional teams, including analytics, product, and IT, to understand data requirements and deliver effective solutions.
  • Act as a liaison between data users and technical teams to facilitate data accessibility and usability.
• Performance Optimization:
  • Automate, monitor and optimize data pipelines for performance, scalability, and reliability.
  • Troubleshoot and resolve data quality issues and system failures promptly.
• Tool Implementation:
  • Stay updated on the latest data engineering tools, technologies, and best practices.
  • Evaluate and implement new tools that enhance data processing and analysis capabilities.
• Documentation & Reporting:
  • Create and maintain comprehensive documentation for data workflows, processes, and systems.
  • Provide regular updates and reports on data engineering projects and performance metrics.

Qualifications:

• Education:
  • Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
• Experience:
  • 3+ years of experience in data engineering, data integration, or related roles.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Technical Skills:
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong SQL skills and experience with databases (e.g., MySQL, PostgreSQL, MongoDB).
  • Familiarity with data pipeline frameworks (e.g., Apache Spark, Apache Kafka, Apache Airflow).
• Soft Skills:
  • Excellent analytical and problem-solving skills.
  • Strong communication and teamwork abilities, with a focus on collaboration.
  • Ability to work in a fast-paced environment and manage multiple priorities.