The Senior Software Engineer will design and implement scalable data integration solutions on cloud-based platforms, working with cross-functional teams to deliver high-quality solutions. The ideal candidate will have experience with Databricks, Apache Spark, and cloud-based data integration, as well as strong technical and collaboration skills.
Requirements
- 5+ years of experience with Databricks, Apache Spark, and cloud-based data integration
- Strong Technical expertise with cloud-based platforms, including AWS and or Azure cloud
- Strong programming skills in languages like SQL, Python, Java, or Scala
- 3+ years' experience with cloud-based data infrastructure and integration leveraging tools like S3, Airflow, EC2, AWS Glue, DynamoDB & Lambdas, Athena, AWS Code deploy, Azure Data Factory, or Google Cloud Dataflow
- Experience with Jenkins and other CI/CD tools like GitLab CI/CD, CircleCI, etc.
- Experience with containerization using Docker and Kubernetes
- Experience with infrastructure such as code using tools like Terraform or CloudFormation
- Experience with Agile development methodologies and version control systems like Git
- Experience with IT service management tools like ServiceNow, JIRA, etc.
- AWS Certified Solutions Architect or AWS Certified Developer Associate or Azure Certified Solutions Architect certification
Benefits
- data governance, data quality, and data security principles
- ability to lead and mentor junior team members