About the role
Job Description
WHAT YOU’LL CHAMPION
As a Senior Data Engineer, your day-to-day duties will encompass the following areas:
Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes.
Data Quality Assurance: Ensure absolute data integrity and data quality across environments.
Process Optimization: Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design.
Cross-Functional Collaboration: Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment.
Data Impact: Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data.
Internal Stakeholder Management: Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals.
Governance & Compliance: Contribute to improving data governance policies and maintaining data compliance standards.
Continuous Learning: Keep continuously current with the latest technical and industry developments.
WHO YOU ARE
BS/MS/PhD in IT, Mathematics, Science or Engineering discipline Up to 4+ yrs relevant experience beyond first degree
Experience with one of the following languages: Python, Spark
Experience with DAG, airflow, terraform
Familiar with data ETL from a wide variety of data sources.
Experience with SQL and NoSQL databases.
Experience with pipeline and workflow management tools.
Experience with various messaging and stream processing.
Experience with object-oriented/object function scripting languages.
Familiar with containerisation and orchestration tools.
Familiar with one of the following cloud-based services: GCP and its tools and services.
Ability to work under pressure and change, and balance among speed, reliability, and interpretability.
Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
Experience with code versioning, code review and documentation.
Proficient understanding of distributed computing principles.
Able to selec…
