Senior Data Engineer

Year    Bangalore, Karnataka, India

Job Description


The MarTech, Data and Machine Learning Engineering team is responsible for building Wayfair\'s class leading, data centric technology platform that optimizes and powers all of Wayfair\'s advertising. It touches hundreds of millions of consumers and drives billions of dollars in annual revenue. Our platforms allow us to scale our marketing efforts efficiently by automating key processes, interacting with ad vendors in real time and leveraging hundreds of terabytes of data and ML algorithms for optimization and effective decision making on millions of items in our catalog. The types of systems built by this team range from low latency REST and Graph QL APIs, to streaming systems processing billions of daily events in real time to large scale batch systems.

The Event Exchange team is composed of platforms aimed at empowering every Wayfair team with high-quality data. It accomplishes this through ingesting, organizing, and activating data in a scalable fashion. The platform was born out of an original mission to produce insights that would power a single view of the customer for far-reaching purposes from personalization to predicting behaviors to analytics. Today, those same tools have grown to ingest any type of data (product, customer, order, etc.) in real-time, support any type of prediction (e.g. shipping times, best email send time, class affinity), and activate that data in all the ways teams desire to consume it. This role is for a Frontend Engineer focused on creating tools responsible for empowering event data producers and consumers via tools for event registration, metadata management and monitoring.

Bengaluru is home to our brand new, strategic technology delivery center and will be critical to achieving our future growth plans. We are looking for best in class Engineers to come in and help scale our technical products and teams alike as we continue on our path to be the world\'s number one online destination for the home. As one of the early members of the team here in our strategic technology delivery center, you will partner closely with our technology and business leaders from around the world to help build the platform to support our growth plans to $50B USD and beyond in the next 3 to 5 years.

The team in the Bengaluru delivery center can work across multiple domains that drive speed and convenience for the customer and cost efficiency across the full value chain. The work we do at Wayfair means we have to move quickly, collaborating with the best and brightest engineers, creatives, product managers, data scientists, and analysts to discover, build, and scale world-class software products.

If you love to solve real business problems at scale, in a fast-paced, high growth and agile environment, this is the role for you!

What you will do:

  • Drive the design, development, and launching of new data models, data pipelines, and data products focussed on Search and Recommendations.
  • Helping teams push the boundaries of analytical insights, creating new product features using data, and powering machine learning models
  • Build cross-functional relationships to understand data needs, build key metrics and standardize their usage across the organization.
  • Utilize current and leading edge technologies in software engineering, big data, streaming, and cloud infrastructure
  • Be a technical mentor to junior engineers
What You will Need:
  • Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
  • 6+ years relevant work experience in the Data Engineering field with web scale data sets
  • Expertise with big data technologies & tools like Hadoop, Spark, Hive, Presto, Airflow etc.
  • Experience in cloud platforms such as GCP using technologies like Big Query, Dataproc, GCS, Cloud Composer, Dataflow or related technologies in AWS or Azure
  • Comfortable designing and implementing DW Architecture, OLAP technologies, and star/snowflake-schemas to enable self-service tooling.
  • Expertise in at least one object-oriented or scripting language (Java, Scala, Python etc.) and SQL
  • Experience with real-time data streaming tools like Flink, Kafka, Beam or any similar tools.
  • Experience with designing data models for traditional relational databases or big data stores.
  • Strong understanding of algorithms, data structures, data architecture, and technical designs.
  • Excellent communication and presentation skills, strong business acumen critical thinking, and ability to work cross functionally through collaboration with engineering and business partners.
  • Experience with domain-driven design, event modeling, and event sourcing is preferred
What we\'d love to see (but isn\'t required)
  • Experience architecting data solutions utilizing Bl tools like Looker, Tableau,AtScale, PowerBI, DataStudio or any similar tools. (preferred)
  • Experience using Docker, Kubernetes or other containerization technologies

Wayfair

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3206814
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year