Job Description

Senior Data Engineer: 10+yrs NP - immediate preferred, max 1month Coimbatore Location (Work From Office Only) Given Budget - 15 to 20LPA Key Accountabilities: Design, develop, implement, and support data management solutions. Develop, maintain, test, and evaluate large-scale data processing solutions (in both batch and real- time modes). Ongoing development and support of the data infrastructure (Cloud Platform, Data Lakehouse and Dashboards) Provide expertise and practical support in developing data platform solutions. Implement ETL processes/pipelines, using CI/CD processes. Support the development and implementation of Solution Design (developing/ system integration/pre-production/ production /support). Mandatory Skills: Solid exposure in end-to-end implementation of data solutions using AWS (including S3, Lambda, Database Migration Service, Glue , Kinesis , Step Function, Athena), PySpark and SQL. Experience in spatial, semi-structured, and unstructured data manipulation. Strong proven experience working as a Data Engineer leading with complex environments. Good understanding on Data Modelling / Data warehousing. Experienced in Entity Relationship Modelling. Experience with designing, building, operating, and deploying scalable data pipelines. Experience with CI/CD tools: GithubActions or Jenkins Optimize data pipelines and processes for efficiency, scalability, and cost-effectiveness in the AWS environment. Ensure data security, encryption, and compliance with data governance policies and industry regulations. Nice to have: AWS Experience (Sagemaker, EMR, Quicksight) DataBricks / Snowflake Azure GCP

foundit