Description
Mindex is a software development and cloud services company with over 30 years of experience delivering innovative solutions. We are seeking a Data Engineer to design, develop, and optimize data platforms that support analytics, reporting, machine learning, and AI initiatives. The ideal candidate will collaborate with cross-functional teams to build scalable data solutions and contribute to technical architecture decisions.
Essential Functions
- Assemble large, complex data sets through extraction, transformation, and loading (ETL) from diverse sources.
- Provide operational support and troubleshooting for existing data processes and systems.
- Collaborate with architects, data scientists, and stakeholders to manage the data platform backlog and triage feature requests.
- Deliver automation and efficient processes to ensure high-quality performance of the data and analytics platform.
- Ensure all data operations meet stringent security and compliance requirements.
- Engage with platform leads to align data sources with agency AI/ML and office standards.
- Develop tools to assist data science team members in building and optimizing models.
Requirements
- BS degree in Computer Science, Data Science, Engineering, or equivalent experience.
- 4+ years of experience with SQL, Snowflake, Databricks, and Spark.
- 4+ years of experience using Python, PySpark, or R for processing large data sets.
- 4+ years building and optimizing data pipelines and architectures.
- 2+ years supporting large-scale data processing using Azure Data Factory, Data Lake, Azure ML, and Cosmos DB.
- 2+ years addressing data privacy, compliance, and security within Agile environments.
- 2+ years with CI/CD methodologies, MLOps, and automation tools such as Terraform, Ansible, Azure DevOps, and GitHub Actions.
- 2+ years of experience with Salesforce FSC and Salesforce Data Cloud.