GCP Admin and automation. Technical guidance to data engineering team for Talend pipeline design and enhancements. Strong experience in ETL, data migration, data consolidation, and cloud platforms.
Requirements
- GCP Admin and automation
- Ability to provide technical guidance to data engineering team for Talend pipeline design and enhancements
- Strong experience in ETL with Data migration, data consolidation
- Hands-on experience in Talend data pipelines around event and messaging patterns, streaming data, Kafka, API
- Master Proficiency in at least one cloud platform (AWS / Azure / GCP ) and related data services
- Hands-on experience in services Cloud dataflow, Cloud Pub-Sub, Big Query, Cloud Storage, Cloud Dataflow, Google Composer etc.
- Strong SQL knowledge
- Strong leadership quality and able to handle a team
- Understanding of fundamentals of Git and Git workflows.
- Must have used at least one of the SAAS-based Git tools like GitHub, GitLab, Bitbucket
- Experience of working in agile application development environment
- Ability to proactively prioritize tasks in consultation with business stakeholders, Product Owners, Product Managers
- Troubleshoot issues and perform administrative tasks like setting up projects, users, authorizations, Migrations and job scheduling.
- Create and manage workspace, users, roles, groups, projects, access control, native and custom connections.
- Technical support to applications on trouble shooting Environment, software and application level issues
- Write, test programs using Unix Shell scripting, oracle PL/SQL programming
- Perform unit testing Talend server builds, version upgrade, maintenance and migration
- Expertise in Talend products including Talend Studio, Talend Administration Centre, Talend Big Data, Talend Metadata Bridge, and Talend Data Quality
- Managing support services and change management using ServiceNow application.
- Good to Haves:
- Theobald, Collibra DQ Familiarity with Power BI / Tableau based BI framework
- Experience in automation of the deployment of services and configuration updates
- Experience in optimization of existing cloud-based services running in production environments
- Awareness of data governance processes (security, lineage, catalog) and tools like Collibra
- Exposure to CI/CD Infra provisioning on cloud, auto build & deployment pipelines, code quality
- Valid professional certification in cloud platform (AWS / Azure / GCP)
- Exposure to admin activities
- Proficiency on the Linux command line using tools such as bash, SSH, vim
- Experience in python for scripting repetitive tasks