GCP Data Engineer+ Pyspark

TCS · Bengaluru, Karnataka · Posted 3 days ago

About this role

TCS Hiring for GCP Data Engineer+ Pyspark Experience Range: - 06 To 10 Years (Mandatory) (Note: Candidates below 06 years of IT experience shall not be considered) JOB LOCATION: Anywhere in India JOB DESCRIPTION Very good experience in implementing data platform modernization using GCP data services. Good data modelling skills on SQL/NoSQL based data platforms. Key Skills: GCP Data Engineer, Pyspark, Dataflow, Dataproc, BigQuery, Airflow Must Have Skills: • Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc. • Good skills in Python Language, PYSPARK • Good Skills in Linux • Exposure to creation of CI-CD pipelines for promoting big data release deployments and designing log monitoring features. • Excellent written and verbal communication skills in English Good to Have Skills: Experience in On Premise Hadoop technologies (Hive, Sqoop, SPARK, Kafka) Hadoop, Spark, Apache Beam Responsibilities or Expectations from the Role: • Data modelling/Data warehouse modernization/Cloud based data lakes • Create and maintain optimal data pipeline architecture • Define technical roadmap for data platform modernization and analysis and assessment of the existing data platforms • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Build the