Data Engineer Databricks 48686br

Year    Bangalore, Karnataka, India

Job Description


:

Quest Global is an organization at the forefront of innovation and one of the world\xe2\x80\x99s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility.

We are looking for humble geniuses, who believe that engineering has the potential to make the impossible, possible; innovators, who are not only inspired by technology and innovation, but also perpetually driven to design, develop, and test as a trusted partner for Fortune 500 customers.

As a team of remarkably diverse engineers, we recognize that what we are really engineering is a brighter future for us all. If you want to contribute to meaningful work and be part of an organization that truly believes when you win, we all win, and when you fail, we all learn, then we\xe2\x80\x99re eager to hear from you.

The achievers and courageous challenge-crushers we seek, have the following characteristics and skills:

Key Accountabilities:

  • Working with colleagues to understand and implement requirements
  • Securing the data supply chain, understanding how data is ingested from different sources and combined / transformed into a single data set.
  • Build complex data pipelines in Microsoft Azure.
  • Implementing designed / specified solutions into the chosen platform (e.g. Azure Data Factories / Data Lakes, HDInsight, Azure Databricks, Azure Synapse Analytics or traditional software).
  • Optimize existing data pipelines.
  • Evaluate and improve existing data analytics solutions.
  • Working with colleagues to ensure that the on-prem/cloud infrastructure available is capable of meeting the solution requirements.
  • Planning, designing and conducting tests of the implementations, correcting errors and re-testing to achieve an acceptable result.
  • Appreciate how to manage the data including; security, archiving, structure and storage.
Key Experience and Qualifications:
  • Mandatory
  • Degree level education in Mathematics, Scientific, Computing or Engineering discipline or equivalent experience
  • 5+ years of experience at various levels of Software /Data Engineering roles
  • Hands-on experience in designing solutions using databases and data storage technology such as RDBMS, Hadoop, NoSQL, Kafka
  • Strong Hands-on experience building and optimizing Big Data data pipelines using Databricks(with good knowledge of Spark), Orchestrating data workloads on Azure Data Factory.
  • Proficiency in Python scripting. Experienced in using different python modules used for data munging.
  • Proficiency in SQL.
  • Hands-on experience on Databricks(Cost Optimization Techniques, Performance Tuning, Cluster Optimization).
  • Strong Hands-on experience on ETL Skills and data modelling.
  • Hands-on Experience in PowerBI.
  • Experienced in DevOps methodology(working with Git Branching, managing conflicts etc. on Azure DevOps)
  • Hands-on experience in handling real-time streaming(Spark Structured Streaming), EventHubs, EventGrid, Azure Stream Analytics, Service Bus etc.
  • Hands-on experience in Azure Key-Vault.
  • Experience of working in at least one of the public cloud platform such as Azure, AWS, Google Cloud and using IaaS / PaaS / SaaS components in building highly scalable solutions
  • Good understanding of infrastructure components and their fit in different types of data solutions.
  • Experience of designing solutions deployed on Microsoft and Linux operating systems.
  • Experience of working in an agile environment, within a self-organizing team.
  • Desirable:
  • Experience in Tableau.
  • Experience with time series data processing and storage including technologies such as InfluxDB, OpenTSDB etc.
  • Exposure to Azure Logic Apps, Power Apps, Power Automate.
  • Experience with Microsoft development stack (C#.net).
Behavioural Competencies:
  • Mandatory
  • Proactive Problem Solver.
  • Should have thirst for Knowledge.
  • Communicate efficiently.
  • Innovative Thinking
  • Strong Team Player
  • Strong Accountability
  • Desirable
  • Emotionally Intelligent
  • Ability to Change
  • Collaboration and Resolving Conflict
  • Clear Vision and Direction
  • Drive for Results
About Company:

Over the past 25 years, we have built a business centered on engineering excellence to solve the most challenging problems for industry. We have deep expertise across the entire product life cycle and a breadth of engineering capabilities from mechanical to embedded software to digital. With our depth and breadth, we not only partner with our customers to tackle their most daunting challenges of today, we retain institutional knowledge to help them again and again. This depth and breadth position Quest Global to function quite uniquely as an extension of our customers\xe2\x80\x99 teams. Sure, we can supplement personnel during staffing crunches, but we can also take full ownership of projects as a trusted, strategic partner for the customers we serve.

Quest Global

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3071943
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year