Data Engineer II (6333)

Data Engineer II

itD is seeking a Data Engineer to build and optimize high-complexity data pipelines and monitoring systems supporting critical legal and eDiscovery infrastructure. This role will focus on developing scalable ETL workflows, enabling alerting systems, and partnering cross-functionally with legal, data science, and engineering teams to deliver secure and reliable data solutions. The ideal candidate will bring strong expertise in data engineering and pipeline development and a proven track record of delivering scalable data solutions in complex, cross-functional environments.

Location: Remote (California preferred; Bay Area candidates strongly preferred, occasional onsite in San Francisco may be required)

Duration: 6months

We provide comprehensive medical benefits, a 401k plan, paid holidays, and more.

Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities

• Design, build, and maintain scalable ETL pipelines for processing large and complex datasets
• Develop monitoring and alerting systems to ensure data accuracy, reliability, and availability
• Collaborate with attorneys, data scientists, and cross-functional teams to gather requirements and deliver data solutions
• Lead or contribute to end-to-end data engineering initiatives across multiple stakeholders
• Optimize query performance and data workflows across large-scale data environments
• Create documentation, system design plans, and deployment strategies
• Ensure adherence to data privacy, security, and compliance standards

Internal Responsibilities

• Attend regular internal practice community meetings
• Collaborate with your itD practice team on industry thought leadership
• Complete client case studies and learning material (blogs, media material)
• Build out material to contribute to the Digital Transformation practice
• Attend internal itD networking events (in person and virtual)
• Work with leadership on career fast-track opportunities

Required Qualifications and Skills

• 3+ years of experience in data engineering
• Strong proficiency in SQL (Presto, Postgres, MySQL, or equivalent)
• Strong proficiency in Python
• Experience building and maintaining ETL pipelines
• Hands-on experience with workflow orchestration tools (e.g., Airflow or equivalent)
• Experience working in cross-functional environments with multiple stakeholders
• Strong communication skills with ability to work across technical and non-technical teams

Preferred Qualifications and Skills

• Experience leveraging AI tools to improve data workflows or automate processes
• Background in regulated environments (legal, compliance, privacy, security)
• Experience in startup or high-ambiguity environments
• Experience mentoring or supporting junior team members
• Exposure to data loss prevention or remediation workflows

Education

• Bachelor’s degree in Computer Science or a related field, or equivalent work experience required