Big Data Engineer
This job has been filled or expired, so you can no longer apply for it.
You can browse our current jobs in this category here or view the old job below.
Accentuate Staffing is working with a client who is a leader in the life science/pharmaceutical space and is looking for someone who is a North Carolina resident to work a fully remote, 6-month contract. In this position, you’ll work with big data technologies (e.g., Spark and Scala), write Spark jobs in Scala, support production, and design data pipelines.
This is an excellent opportunity to use big data technologies for high-volume transaction applications. If you have experience with object-oriented development and want to join a team responsible for designing and developing new products, please apply by submitting your resume!
Responsibilities:
- Collaborate with team members on a single scrum team to lead the solution design for a diverse range of complex problems.
- Provide technical leadership to agile teams onshore and offshore and mentor other team members, from junior engineers to new team members.
- Implement data pipelines on a scrum team to deliver new data sources and features for machine learning and implement data quality checks, classification, and data lineage.
- Write and validate test cases for other team members’ code, and implement unit tests to cover the new features being created.
- Augment the CI/CD pipeline to deliver new features to production and approve pull requests after a thorough code review or require changes to solve the problem better or adhere to standards.
- Provide engineering support for escalations from the 24/7 Technical Assistance Center during production downtime.
Requirements:
- Experience in data engineering positions or roles
- Strong programming skills in Scala, Python, or other object-oriented programming languages.
- Experience with distributed/scalable systems and high-volume transaction applications.
- Experience in data profiling, management, and ETL methodology.
- Experience in creating architecture diagrams and models.
