Job Description

Own implement new solutions around the area of Data, AI ML You will lead the new age data architecture solutions big data implementation for the ecommerce business. Build a robust real-time batch analytics platform for analytics machine-learning Design and develop a scalable data pipeline for the organization s data warehouse and other data engineering solutions. Collaborate with various departments to develop, maintain a data platform solution, and recommend emerging technologies for data storage, processing, and analytics An accomplished Data Architect who brings significant experience in building and maintaining a highly scalable infrastructure for a Retail or eCommerce-based platforms. Strong experience in implementing data/bigdata architectures with high volume and throughput Instrumental in driving key initiatives related to data and analytics engineering, focus on building and maintaining a scalable data platform to acquire, process, analyse data in real-time as well batch Hands on experience in implementing real-time as well as batch processing big data technologies (Spark, Storm, Kafka, Flink, MapReduce, Yarn, Pig, Hive, HDFS, Oozie etc) The incumbent will bring exceptional know-how of Data Engineering landscape; create a date driven organization, including strategic data platform upliftment to scale out large-scale data processing using big data technology stack. Extensive experience in managing and scaling highly available, large, multi-datacentre across Cassandra MongoDB clusters in production and lower environments. Experience in gathering and processing raw data at scale including writing scripts, web scraping, calling APIs, writing SQL queries Work with development and infrastructure teams to review application data models and traffic requirements; identify data model issues and potential bottlenecks; recommend schema design changes, compaction strategies, other improvements. Drive an overall data architecture, data governance strategy with domain expertise that supports the information needs of the business in a flexible but secure environment. Education Qualification and Experience: An ideal candidate would bring 12 years of experience in highly scalable data systems with minimum 4 Years of experience in implementing data/bigdata architectures with high volume and throughput in retail or commerce environment. Bachelors or advanced degree (MS / Higher) in Computer science/Applied mathematics/Data management/Information Systems. Solid understanding of big data modelling patterns and anti-patterns; experience working closely with development teams to design optimize database schema based on application access patterns. Accountable for implementing data policies, standards, and processes within their domain, conduct impact/root cause analysis for incoming data governance requests Experience with the design and implementations of data processors, file storage and other graphical components of the Data Architectures Experience with configuration management and source control systems (Jenkins, ZooKeeper, Ansible, Chef, Puppet, GIT, SVN). Solid understanding of Unix/Linux operating system management fundamentals. Bachelors or advanced degree (MS / Higher) in Computer science/Applied mathematics/Data management/Information Systems.

foundit