We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data architecture and engineering, with expertise in handling large datasets and building robust data pipelines. This role requires proficiency in various technologies and tools, including AWS, Azure Data Lake, and Big Data frameworks. The Data Engineer will be responsible for designing, implementing, and maintaining data systems that support our analytics and business intelligence initiatives.
Responsibilities
Design and develop scalable data pipelines to ingest, process, and store large volumes of structured and unstructured data.
Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets for analysis.
Implement ETL processes using tools such as Talend, Informatica, or custom solutions to ensure efficient data transformation.
Optimize database performance by designing effective database schemas and indexing strategies using Microsoft SQL Server, Oracle, or similar technologies.
Work with Big Data technologies such as Hadoop, Spark, Apache Hive, and linked data frameworks to manage large datasets.
Develop RESTful APIs for seamless integration of data services across applications.
Conduct model training and support machine learning initiatives by providing clean and well-structured datasets.
Utilize SQL and Python for data manipulation, analysis, and reporting tasks.
Maintain documentation of data processes, architecture designs, and workflows following Agile methodologies.
Qualifications
Bachelor's degree in Computer Science, Information Technology, or a related field.
Proven experience as a Data Engineer or similar role with a strong understanding of database design principles.
Proficiency in programming languages such as Java and Python; experience with Shell Scripting (Bash) is a plus.
Familiarity with analytics tools like Looker for visualizing data insights.
Strong analytical skills with the ability to troubleshoot issues in complex data systems.
Experience working with cloud platforms such as AWS or Azure Data Lake is highly desirable.
Knowledge of model training techniques and familiarity with machine learning concepts is an advantage.
Excellent communication skills to collaborate effectively within cross-functional teams. We invite qualified candidates who are passionate about leveraging data to drive business decisions to apply for this exciting opportunity.
Job Type: Full-time
Pay: ?129,311.92 - ?155,730.48 per year
Work Location: In person
Beware of fraud agents! do not pay money to get a job
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.