Description
Workstate is hiring a Senior Backend Developer! In this pivotal role, you will be responsible for building, optimizing and maintaining data pipelines using distributed computing on Cloud. The ideal candidate is an experienced data wrangler who can understand and optimize data systems from the ground up. The Data Engineer will support software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture that is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
Residents of Colombia or Argentina with the right to work in that country are eligible for this role.
Responsibilities
- Develop and operationalize scalable and reliable data pipelines.
- Assemble large, complex data sets that meet functional and non-functional business requirements.
- Experience in database management techniques including logical data modeling, physical database optimization and security.
- Keep improving the integrity of data pipelines by setting up Data Quality checks to provide a comprehensive data service.
- Work with Data and Analytics experts to strive for greater functionality in our data systems.
- Experience with On-Call support and unblock users based on severity of the issue.
Requirements
The ideal candidate will typically have 5-7 years of professional experience and have demonstrated many of the following skills:
- 5+ years of experience in engineering and operationalizing data pipelines with large and complex datasets.
- 3+ years of experience working with unstructured data (JSON).
- Extensive experience in advanced SQL.
- 3+ years of experience in Python/PySpark.
- 3+ years of experience with transforming data using Databricks.
- 3+ years of experience with AWS.
- Experience with Git (CI/CD).
- Power BI or similar visualization tools.