Every career journey is personal. That's why we empower you with the tools and support to create your own success story.
Be challenged. Be heard. Be valued. Be you ... be here.
Job Summary
The Senior Data Engineer works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. This role also partners with the data science team on special projects related to model development and deployment framework. The Sr Data Engineer team supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier, faster and smarter. The team brings together data from different internal & external partners and builds a curated Marketing analytics focused data & tools ecosystem. The Sr Data Engineer plays a crucial role in building this ecosystem depending on the Marketing analytics communities need.
Essential Job FunctionsBuilds data pipeline for various data sources, particularly from many external data sources. Works with other project team members to understand the use cases, familiar with data sources, provides recommendation on data ingestion processes, complete data ingestion, monitor and identify potential process or data quality issues. - (15%)
Collaborates with internal/external stakeholders to manage data logistics - including data specifications, transfers, structures, and rules. Collaborates with business users, business analysts and technical architects in transforming business requirements into analytical workbenches, tools and dashboards reflecting usability best practices and current design trends. - (15%)
Demonstrates analytical, interpersonal and professional communication skills. Learns quickly and works effectively individually and as part of a team. Accesses, extracts, and transforms Credit and Retail data from a variety of sources of all sizes (including client marketing databases, 2nd and 3rd party data) using Hadoop, Spark, SQL, Big data technologies etc. - (10%)
Provides automation help to analytical teams around data centric needs using orchestration tools, SQL and possibly other big data/cloud solutions for efficiency improvement. - (5%)
Supports Lead Data Engineer and Principal Data Engineer in new analytical proof of concepts and tool exploration projects. Effectively manages time and computing resources in order to deliver on time/correctly on concurrent projects. Involved in creating POCs to ingest and process streaming data using Spark and HDFS. - (10%)
Answers and trouble shoots questions about data sets and analytical tools; Develops, maintains and enhances new and existing analytics tools/Frameworks to support internal customers/consumers. Design, develop and implement data infrastructure and pipelines that collect, connect, centralize, and curate data from various internal and external data sources. - (10%)
Create automation systems and tools to configure, monitor, and orchestrate our data infrastructure and our data pipelines. Ingests data from different sources, processes it according to the requirement document in order to store data to Hive or NoSQL database or different warehousing solutions. Involved in HDFS maintenance, and loading of structured and unstructured data. - (10%)
Evaluate new technologies for continuous improvements in Data Engineering. Collaborate closely with the product team to build out new data features. Work with the data analysts and scientists to implement descriptive, forecasting, and predictive algorithms and models using the latest technologies. Make technology decisions for our data infrastructure. - (10%)
Consistently write production-ready code that is easily testable, easily understood by other developers, and accounts for edge cases and errors. Use systematic debugging to diagnose all issues located to a single service as well as cross service issues. Approach all engineering work with a security lens. Actively look for security vulnerabilities in the code and when providing peer reviews. - (10%)
Provide technical leadership and guidance to junior team members, fostering a collaborative environment for continuous learning and innovation. Translate complex technical subjects for diverse audiences, ensuring alignment and understanding across technical and non-technical stakeholders. - (5%)
Minimum QualificationsBachelor's Degree in computer science or engineering; or equivalent technical training and experience.
5+ years of experience building and deploying large-scale data processing pipelines.
5+ years of experience with AWS, Spark with Python/Scala, SQL with Redshift, Postgre SQL and Columnar Databases
5+ years of experience with Workflow & pipeline systems with Airflow.
Preferred QualificationsMaster's Degree in computer science, computer engineering, IT or another related field of study.
8+ years of experience in Data & Analytics
Experience with message-based, loosely coupled architectures (e.g. Kafka).
Experience developing systems intended for cloud deployments (AWS, EKS, lambda's, etc.). DevOps experience. Experience with analytics platforms like Looker or Tableau.
SkillsStructured Query Language (SQL)
Azure
Databricks
Terraform
Powershell
Orchestration tools
Spark SQL
Scala (Programming Language)
Python (Programming Language)
PySpark
NoSQL
Linux Shell Scripting
HBase
Cloudera Impala
Cloudera Data Platform (CDP)
Big Data
Apache Hadoop
Reports To: Manager and above
Direct Reports: 0
Work EnvironmentNormal office environment, hybrid.
Other Duties
This job description is illustrative of the types of duties typically performed by this job. It is not intended to be an exhaustive listing of each and every essential function of the job. Because job content may change from time to time, the Company reserves the right to add and/or delete essential functions from this job at any time.
About Bread Financial
At Bread Financial, you'll have the opportunity to grow your career, give back to your community, and be part of our award-winning culture. We've been consistently recognized as a best place to work nationally and in many markets and we're proud to promote an environment where you feel appreciated, accepted, valued, and fulfilled--both personally and professionally. Bread Financial supports the overall wellness of our associates with a diverse suite of benefits and offers boundless opportunities for career development and non-traditional career progression.
Bread Financial (NYSE: BFH) is a tech-forward financial services company that provides simple, personalized payment, lending, and saving solutions to millions of U.S consumers. Our payment solutions, including Bread Financial general purpose credit cards and savings products, empower our customers and their passions for a better life. Additionally, we deliver growth for some of the most recognized brands in travel & entertainment, health & beauty, jewelry and specialty apparel through our private label and co-brand credit cards and pay-over-time products providing choice and value to our shared customers.
To learn more about Bread Financial, our global associates and our sustainability commitments, visit breadfinancial.com or follow us on Instagram and LinkedIn.All job offers are contingent upon successful completion of credit and background checks.
Bread Financial is an Equal Opportunity Employer.
Job Family:
Information Technology
Job Type:
Regular
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.