Data Engineer

This is a dynamic opportunity to join a leading organization at the forefront of innovation, where data engineering is pivotal to unlocking critical insights and driving technological advancements. We are seeking a highly skilled and passionate Senior Data Engineer to play a crucial role in building the robust data infrastructure that powers our next generation of solutions. Your expertise will directly impact our ability to process, analyze, and leverage complex data, enabling smarter decisions and accelerating progress in a fast-evolving industry.

**About the Opportunity**

As a Senior Data Engineer, you will be instrumental in designing, building, and optimizing production-grade data pipelines that handle vast amounts of critical data. You will architect scalable ETL/ELT workflows, primarily within Databricks, leveraging Delta Lake and cloud-native storage solutions. This role offers the chance to work with complex time-series data formats, ensuring high performance and reliability for large-scale, high-frequency datasets. Beyond technical contributions, you will mentor junior engineers, contribute to technical design reviews, and help shape the future of our data architecture, directly influencing our ability to innovate and deliver cutting-edge solutions.

**What You'll Do**

* Design and build robust data pipelines using Python to extract, transform, and load data from specialized time-series files (e.g., automotive telemetry, sensor logs).

* Architect scalable ETL/ELT workflows in Databricks, leveraging Delta Lake and cloud-native storage to manage and process large datasets.

* Optimize performance and ensure the reliability of pipelines handling large-scale, high-frequency time-series datasets.

* Mentor junior engineers, contributing to technical design reviews, architecture discussions, and maintaining high code quality standards.

* Stay ahead of industry trends in data lakehouse architecture and data workflows, continuously seeking opportunities for improvement and innovation.

* Contribute to the end-to-end delivery of data solutions, from conceptualization to deployment and ongoing optimization.

**Must-Have Qualifications**

* 5+ years of experience in data engineering and software development.

* Advanced proficiency in Python, with at least 5 years of experience in performance tuning and large-scale data processing.

* Strong experience with Databricks, Delta Lake, and Spark (PySpark or Scala).

* Demonstrated ability to design and implement high-throughput, fault-tolerant pipelines in production environments.

* Familiarity with major cloud platforms (AWS, Azure, or GCP), including data storage, compute, and security best practices.

* Bachelor's Degree (Computer Science degree is highly valued).

**Nice-to-Have Qualifications**

* Experience in industries dealing with high-volume telemetry data, such as automotive or IoT.

* Hands-on experience parsing and processing specialized time-series data files.

* Prior exposure to Databricks Unity Catalog and Delta Live Tables.

* Understanding of GitOps and CI/CD principles in software engineering.

All candidates must be eligible to work in the US without a sponsorship. Hybrid n Austin, TX - non negotiable.

**About Aquent Talent:**

Aquent Talent connects the best talent in marketing, creative, and design with the world's biggest brands.

Our eligible talent get access to amazing benefits like subsidized health, vision, and dental plans, paid sick leave, and retirement plans with a match. More information on our awesome benefits!

Aquent is an equal-opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics. We're about creating an inclusive environment-one where different backgrounds, experiences, and perspectives are valued, and everyone can contribute, grow their careers, and thrive.