Your Role
Responsibilities:
1. Data Infrastructure Development:
a. Design, develop, and maintain scalable and robust data pipelines and architectures.
b. Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
c. Ensure data quality and integrity by implementing data validation and cleansing processes. d. Identify and implement data security measures to protect sensitive information.
d. Identify and implement appropriate infrastructure solutions, including cloud platforms and computing resources, to support machine learning workflows.
e. Evaluate and integrate data engineering tools, frameworks, and libraries to enhance productivity and efficiency.
f. Stay updated with the latest advancements in machine learning infrastructure and contribute to the continuous improvement of data engineering practices.
2. Data Integration:
a. Extract, transform, and load data from various sources (ERPs, DBs, SharePoint) into data repositories or data lakes.
b. Develop and optimize ETL (Extract, Transform, Load) processes to efficiently handle large volumes of data.
c. Implement data integration solutions to enable seamless data flow between systems.
3. Data Modeling and Database Management:
a. Design and maintain data models to support efficient data storage and retrieval. b. Optimize database performance and ensure scalability to handle growing data volumes.
c. Implement data partitioning, indexing, and caching strategies for improved query performance.
4. Data Analysis and Reporting:
a. Collaborate with stakeholders to understand data analysis requirements and develop reporting solutions.
b. Design and build data visualizations, dashboards, and reports to facilitate data-driven decision-making.
c. Conduct data analysis to identify trends, patterns, and insights to drive business improvements.
5. Data Governance and Compliance:
a. Establish and enforce data governance standards and best practices.
b. Ensure compliance with data protection regulations and industry standards.
c. Implement data privacy and data anonymization techniques as required.
To succeed, you will need
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.