Job Description

Embark on an exciting journey into the realm of data engineering and architecture with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. As a Data Architect you will be at the heart of the organization and support our clients to take control of their data and get value out of it by defining a reference architecture for our customers. This means that you will work closely with business leaders and information management teams to define and implement a roadmap on data architecture, data management, business intelligence or analytics solutions..
###

Minimum Qualifications:

Translate business requirements into data requests, reports and dashboards. Strong Database & modeling concepts with exposure to SQL & NoSQL Databases Strong data architecture patterns & principles, ability to design secure & scalable data lakes, data warehouse, data hubs, and other event-driven architectures Expertise in designing and writing ETL processes in Python / Java / Scala Understanding of Hadoop framework - Exposure to PySpark, Spark, Storm, HDFS, Hive Strong hands-on experience with either Databricks or Snowflake; experience with both is desirable. Knowledge of Master Data management and related tools Strong exposure to data security and privacy regulations (GDPR, HIPAA) and best practices Skilled in ensuring data accuracy, consistency, and quality Experience with the AWS/Azure/GCP data engineering services Knowledge of AWS services viz., AWS S3, Redshift, Lambda, DynamoDB, EMR, Glue, Lakeformation, Athena, Quicksight, RDS, Kinesis, Managed Kafka, API Gateway, CloudWatch And / OR Knowledge of Azure services viz., ADF, Data Catalog, Databricks, Azure Synapse Analytics, ADLS Gen2, Azure Devops Ability to implement data validation processes and establish data quality standards. Experience in Linux Proficiency in data visualization tools like Tableau, Power BI or similar to create meaningful insights
###

Additional Experience Desired:

Experience working with data ingestion tools such as Fivetran, stitch, or Matillion AWS IOT solutions Apache NiFi, Talend, Informatica * Exposure to AI / ML technologies