Data Engineer, Security
Twilio
Responsibilities
In this role, you’ll:
Integrate data from multiple sources including databases, APIs, logs, and Security tools, ensuring data quality and consistency.
Design, develop, and optimize Extract, Load, Transform (ELT) processes to move and transform data from source systems to target systems efficiently.
Implement and maintain data warehouses or data lakes, optimizing for storage, query performance, and accessibility for analytics and reporting.
Establish and enforce data governance policies and best practices to ensure data security, privacy, quality, and compliance with regulatory requirements.
Monitor and optimize the performance of data pipelines, databases, and data processing frameworks to meet SLAs and handle growing data volumes.
Collaborate with cross-functional teams and business stakeholders to understand data requirements and deliver solutions.
Document data engineering processes, architecture, and best practices.
Troubleshoot data-related issues, providing timely resolution and support to maintain data availability and reliability.
Implement automation and orchestration tools to streamline data engineering workflows, reduce manual intervention, and improve efficiency.