Job Title: Data Engineer (3-5 Years Experience)
Location: Hyderabad & Pune
Work Culture: Hybrid
Job Description:
We are seeking a skilled Data Engineer with 3-5 years of experience to join our team.
The ideal candidate will have expertise in Google Cloud BigQuery, Snowflake, AWS, or Cloud SQL, along with strong proficiency in SQL/PL-SQL scripting and Linux/Unix. The candidate must also have experience with ETL tools such as Talend, Datastage, Informatica ISS (Cloud version), Data Fusion, Data Flow, or Data Proc.
Role & responsibilities:
Design, develop, and maintain scalable data pipelines and infrastructure.
Implement and optimize ETL processes using the specified tools.
Work closely with data scientists and analysts to provide data solutions.
Ensure data quality and integrity across various platforms.
Collaborate in an Agile environment, managing changes, incidents, and problem resolutions.
Required Skills:
Mandatory:
Google Cloud BigQuery scripting or Snowflake, AWS, Cloud SQL knowledge.
Experience with at least one ETL tool from Talend, Datastage, Informatica ISS (Cloud version), Data Fusion, Data Flow, Data Proc.
Strong SQL/PL-SQL scripting skills.
Linux/Unix expertise.
Python programming skills.
Knowledge of GCP components: GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow, Google Cloud SDK.
Understanding of Terraform scripting and shell scripting.
Experience with RDBMS.
Familiarity with Hadoop and NiFi/Kafka.
Strong knowledge of scheduling tools, preferably Control M, or experience with UC4 Atomic, Airflow Composer.
Preferred:
GCP Data Engineer certifications.
Experience in the Agile lifecycle, change management, incident management, and problem management.
Role: Data Engineer
Industry Type:IT Services & Consulting
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning