Lead Consultant Cloud Data Engineer (snowflake)

Year    Chennai, Tamil Nadu, India

Job Description


Job Title - Lead Consultant -Cloud Data Engineer Career Level - E Leverage technology to impact patients and ultimately save lives Do you have expertise in, and passion for, information technology? Would you like to apply your expertise to impact the IT strategy in a company that follows the science and turns ideas into life changing medicines? If so, AstraZeneca might be the one for you! ABOUT ASTRAZENECA AstraZeneca is a global, science-led, patient-focused biopharmaceutical company that focuses on the discovery, development and commercialisation of prescription medicines for some of the world\xe2\x80\x99s most serious disease. But we\xe2\x80\x99re more than one of the world\xe2\x80\x99s leading pharmaceutical companies. At AstraZeneca we\xe2\x80\x99re dedicated to being a Great Place to Work. ABOUT OUR IT TEAM It\xe2\x80\x99s a dynamic and results-oriented environment to work in \xe2\x80\x93 but that\xe2\x80\x99s why we like it. There are countless opportunities to learn and grow, whether that\xe2\x80\x99s exploring new technologies in hackathons, or redefining the roles and work of colleagues, forever. Shape your own path, with support all the way. Diverse minds that work cross- functionally and broadly together. About the role Department \xe2\x80\x93 Enterprise Data Engineering Service The Enterprise Data Engineering Service exists to give our data citizens access to critical data and tools at pace and accelerating their work on life saving medicines. The service team actively collaborate with business partners to deliver brand new data pipelines and self-service data management capabilities to fulfil AstraZeneca\xe2\x80\x99s bold ambition of delivering life changing medicines. Our ambition is to build self-service data solutions and make enterprise data available so our business partners can focus on data product foundations for advanced analytics and insights. Role Through Enterprise Data Engineering Service, we are making our data Findable, Accessible, Interoperable and Re-usable (FAIR). As a Lead Data Engineer, you will lead the effort to bring about a step-change in our data solutions & capabilities and how we can facilitate secure collaborative environment to allow our data citizens performing pool analysis along with external partners. As part of this role, you need to provide the services and pipelines to ingest and consume data into/from the Data Platform, all in a secure and compliant way. You will be involved in building out processes and technology to meet product owner requirements. You will be accountable for the efficient, secure, and compliant running of the solutions and capabilities. You should be well-versed in the design and development of data solutions and database developments for large data products, as well as maintaining and supporting production environments. Essential Skills

  • Must have a B.Tech/ M.Tech/ MSc in Computer Science/ engineering.
  • Excellent experience in AWS data engineering ecosystem. SNS, SQS, Lambda, Glue, S3, EMR, log management, AWS containers, EC2, EBS, control access, data streaming, AWS CLI & SDK, backup & restore, etc.
  • Excellent experience in Object-Oriented programming (Java, Python, C#), Airflow, Apache Spark, source control (GIT) & versioning
  • Excellent experience in Snowflake tools and services
  • A strong understanding of databases and advanced SQL skills
  • Experience of designing self-service data management capabilities. E.g., Auto ingestion, data cataloguing, automated access control, life cycle management, backup & restore, etc.
  • Experience working in software engineering CI/CD processes, with experience in the design and implementation of applications automated test, build, release, deployment, containerization, and configuration control management.
  • Proven record of design, implementation, and performance tuning of large-scale data pipelines using any ETL & orchestration tools. E.g., Talend, informatica, Airflow, etc.
  • Experience of semi-structured (XML, JSON) and unstructured data handling including extraction and ingestion via web-scraping and FTP/SFTP.
  • Experience working with JIRA, Service Now
  • Experience of delivering solutions through Agile and SAFe.
Key Accountabilities
  • Provide detailed design and implementation of capabilities such as, data share & collaboration environment, auto ingestion, data cataloguing, automated access control, life cycle management, backup & restore, etc.
  • Provide detailed design, aligned with the high-level design provided by Solution Architects. This includes, analysing data requirements, source data, model the source, and determine the best methods & tech stack for extracting, redefining, and loading the data into the data platform and processing the data through the layers of the data platform.
  • Implementation of optimal ETL workflows from wide variety of data sources using SQL, APIs, ETL tools, & AWS big data technologies.
  • Support solution development through leading & overseeing technical deliveries across multiple initiatives.
  • Providing technical recommendations around design, architecture, integration, and support of the entire data sourcing platform with a focus on high availability, performance, scalability, and maintainability.
  • liaise with technical infrastructure teams to root cause & resolve problems and implement solutions to technical issues impacting application performance.
  • Liaise with architect, product owner, and business collaborators to ensure sustainable efficient, secure, and compliant engineering and operation of data solutions & capabilities.
  • Engage with senior collaborators for use case and high-level requirement gathering and running the workshops.
  • Collaborate with scrum master and the engineering leads to perform backlog/sprint management, prioritization, and PI planning.
  • Define engineering standards, processes, and roadmap in collaboration with solution architect and the service lead.
  • Collaborate with the service Lead in architecture team engagement for major changes and adjustments to platform blueprint and landscape.
  • Collaborate with international teams in UK, Sweden, US, Japan, India, and Mexico.
  • Test, document, and quality assess new data solutions, to ensure they are fit for release.
  • Research and Development aspirations to explore, actively support, and drive the consolidation of technology stack as well as work on new technology initiatives that best fit for purpose.
  • Know when to take initiative, speak up and are prepared to do so.
  • Have a \xe2\x80\x9ccan do\xe2\x80\x9d approach to technical issues. Coaching and providing guidelines to the team members. Dig for the right technical answer that fits the need. Finding solutions to technical problems that may arise with understanding the technical issue and using all resources to solve that issue.
  • Build and support your teams through hiring, coaching, mentoring, feedback, and hands-on career development that helps drive high quality software delivery.
  • Perform regular quality checks, validation, and steering developers on design patterns and development standard methodologies through comprehensive code/ design review sessions.
  • Estimation, implementation and delivery of features and functional enhancements within the platform that can support the improvement in value, revenue, profitability, and user satisfaction.
  • Provide the Service Lead with regular service performance metrics & maturity.
WHY JOIN US? We\xe2\x80\x99re a network of high-reaching self-starters who contribute to something far bigger. We enable AstraZeneca to perform at its peak by delivering premier technology and data solutions. We\xe2\x80\x99re not afraid to take ownership and run with it. Empowered with unrivalled freedom. Put simply, it\xe2\x80\x99s because we make a significant impact. Everything we do matters. SO, WHAT\xe2\x80\x99S NEXT? Are you already envisioning yourself joining our team? Good, because we\xe2\x80\x99d love to hear from you! Click the link to apply and we\xe2\x80\x99ll be in touch as soon as we can. WHERE CAN I FIND OUT MORE? Our Social Media, Follow AstraZeneca on LinkedIn https://www.linkedin.com/company/1603/ We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3184123
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Chennai, Tamil Nadu, India
  • Education
    Not mentioned
  • Experience
    Year