Lead Data Engineer

Year    TN, IN, India

Job Description

TransUnion's Job Applicant Privacy Notice


What We'll Bring:



Data Pipeline Engineer at Orion project are embedded within our engineering teams and support the development and operation.

What You'll Bring:



Lead Data Engineer



What We Offer



We are looking for an individual to be part of an autonomous, cross-functional agile/scrum team where everyone shares responsibility for all aspects of the work.


The ideal candidate will have a strong interest to join our growing Data Engineering and Analytics track of GFS Core services who will drive building next generation suite of products and platform by designing, coding, building and deploying highly scalable and robust solutions. We are looking for enthusiastic professionals who are excited to learn, love a good challenge, and are always looking for opportunities to contribute. Finally yet importantly, we look for dedicated team players who enjoy collaboration and can work effectively with others to achieve common goals.


TransUnion is currently seeking a

Lead Data Engineer

with

7+ years' experience

to work in our

Chennai

office, India. You will be working with some of the latest tools and a great team of cross-functional engineers. We work with multiple technologies. This will be an opportunity to work on core services of an industrial strength Identity and Risk solution by streamlining design and collaborating with the team to build orchestration platform in cloud.


Who We Are



At TransUnion, we are dedicated to finding ways information can be used to help people make better and smarter decisions. As a trusted provider of global information solutions, our mission is to help people around the world access the opportunities that lead to a higher quality of life, by helping organizations optimize their risk-based decisions and enabling consumers to understand and manage their personal information. Because when people have access to more complete and multidimensional information, they can make decisions that are more informed and achieve great things. Every day TransUnion offers our employees the tools and resources they need to find ways information can be used in diverse ways.


What you'll bring:



Bachelor's Degree in a quantitative field, plus 7+ years of work experience or equivalent practical experience. 5+ years of experience in Big Data technologies Experience designing and implementing data pipelines Experience with SQL, PostgreSQL and/or Redshift, or other data management, reporting and query tools. Big Data Technologies - Hadoop HDFS, Hive, Spark, Kafka, Sqoop Designing Logical Data Model and Physical Data Models including data warehouse and data mart designs. Expertise in writing complex, highly optimized queries across large data sets to write data pipelines and data processing layers. Cloud System experience on AWS, Azure, GCP -Preferably GCP Coach / Mentor / Lead a team of Data Engineers Design, build, test and deploy cutting edge Big Data solutions at scale Extract, Clean, transform, and analyze vast amounts of raw data from various Data Sources Build data pipelines and API integrations with various internal systems Proactively monitor, identify, and escalate issues or root causes of systemic issues Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality Work across Data Engineering, Data Architecture, Data Visualization functions

What we'll bring:



At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation we're - consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius. Come be a part of our team - you will work with great people, pioneering products and cutting-edge technology. This role is for a

Lead Data Engineer

that will operate as a lead for Data Pipeline track and responsible for development of the global fraud solutions of TransUnion. We pride ourselves in working in a collaborative cross-functional manner where all engineers are expected to contribute to design, build, deployment and operation of our cloud platform.

Technical Leadership:



Design/build scalable data pipelines using Java, Spark, PySpark, BigQuery, and AWS (S3, , EMR).


Implement real-time data solutions with Kafka and Nifi.


Optimize distributed systems (Spark/Kubernetes) for performance and cost.


Team Management:



Mentor junior engineers, conduct code reviews, and unblock technical challenges.


Drive agile processes (sprint planning, task grooming).


Data Solutions:



Architect relational and NoSQL databases for transactional/analytical workloads.


Develop reporting tools for big data (e.g., Tableau, Metabase).


Troubleshoot data quality/performance issues end-to-end.


Innovation:



Research new technologies (e.g., Delta Lake, Flink) for feature development.


Location:

Chennai


Job Type:

Full-time day job


We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability status, veteran status, marital status, citizenship status, sexual orientation, gender identity or any other characteristic protected by law.


Impact You'll Make:



N/A


This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.
TransUnion Job Title


Lead Developer, Software Development

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD4799070
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    TN, IN, India
  • Education
    Not mentioned
  • Experience
    Year