About the role
Job Description WHAT YOU’LL CHAMPION As a Senior Data Engineer, your day-to-day duties will encompass the following areas: Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes. Data Quality Assurance: Ensure absolute data integrity and data quality across environments. Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design. Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment. Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data. Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals. Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards. Continuous Learning: Keep continuously current with the latest technical and industry developments. WHO YOU ARE BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree Experience with one of the following languages: Python, Spark Experience with DAG, airflow, terraform Familiar with data ETL from a wide variety of data sources. Experience with SQL and NoSQL databases. Experience with pipeline and workflow management tools. Experience with various messaging and stream processing. Experience with object-oriented/object function scripting languages. Familiar with containerisation and orchestration tools. Familiar with one of the following cloud-based services: GCP and its tools and services. Ability to work under pressure and change, and balance among speed, reliability, and interpretability. Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence. Experience with code versioning, code review and documentation. Proficient understanding of distributed computing principles. Able to select and integrate big data…
