Senior Information Technology Consultant - #1175702

Responsibilities:

• Assist in the design and implementation of data pipelines to collect, process, and store data from various sources.
• Write and optimize SQL queries to extract and manipulate data for reporting and analysis.
• Collaborate with data analysts and data scientists to understand data requirements and provide the necessary data support.
• Organize, build and maintain data stores of structured and unstructured data on a Cloud environment.
• Build data pipelines to enable scalable processing of large volumes of data.
• Develop scalable and high-performance application architectures using modern development frameworks.
• Work closely with business stakeholders and project leads to gather requirements and convert them into effective solutions. Monitor and troubleshoot data pipelines and workflows to ensure data quality and reliability
• Enhance and maintain existing applications, identifying areas for optimization and improvement.
• Document data processes, workflows, and data models to maintain clear communication within the team
• Maintain technical documentation related to application design, workflows, and deployment.

Requirement:

• Bachelor’s degree in computer science, Information Technology, or a related field.
• 5 years of experience in data engineering
• Strong knowledge in SQL, ETL Teradata, Python and experience with writing queries for data extraction and manipulation.
• knowledge of managing messaging tools like Kafka.
• Experience in informatica development.
• Experience implementing complex ETL and data extraction projects from scratch.
• Fluency in Python, Spark, HIVE-QL, Hadoop eco-system, data-centric workflow management tools Unix/Linux/HDFS environments Proficiency in SQL and RDBMS
• Good working knowledge of Git and CI/CD pipelines
• Experience in Graph database desirable but not mandatory
• Thorough knowledge of data security, privacy, and compliance regulations

We regret to inform that only shortlisted candidates will be contacted

Persol Singapore Pte Ltd EA License No. 01C4394 EA Reg No: R1989324 (Tandon Kopal) By submitting your curriculum vitae or personal data to us in connection with your job application, you are deemed to have read and agreed to the terms of our Privacy Policy, and consented to the collection, use and disclosure of your personal data by us and our affiliates, in accordance with our Privacy Policy. If you wish to withdraw your consent, please drop us an email to let us know