Data Engineer (Databricks & Spark Specialist)

Harmonia Holdings Group LLC
medical insurance, life insurance, vision insurance, parental leave, paid time off, paid holidays, 401(k)
United States, Virginia, McLean
8180 Greensboro Drive (Show on map)
Mar 06, 2025
Harmonia Holdings Group, LLC is an award-winning, rapidly growing federal government contractor committed to providing innovative, high-performing solutions to our government clients and focused on fostering a workplace that encourages growth, initiative, creativity, and employee satisfaction. This role involves designing, building, and maintaining scalable data pipelines using Apache Spark and Databricks. The Data Engineer will work with cloud platforms like Azure or AWS, handling data ingestion, transformation, and storage. Strong programming skills in Python, Scala, and SQL and expertise in ETL processes and data integration are essential. Additional responsibilities include ensuring data security, implementing DevOps practices, and understanding machine learning concepts. A Databricks Certified Data Engineer Professional certification is required. Technical Skills: Apache Spark: In-depth knowledge of Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib. Databricks: Hands-on experience with Databricks, including Databricks Runtime, Databricks Notebooks, and Databricks Jobs. Cloud Computing: Familiarity with cloud platforms such as Azure or AWS, and experience with cloud-based data services like Azure Data Lake Storage (ADLS) or Amazon S3. Data Engineering: Knowledge of data engineering principles, including data ingestion, processing, and storage, as well as experience with data pipelines and workflows. Programming Languages: Proficiency in programming languages such as Python, Scala, and experience with SQL and data querying languages like Hive or Spark SQL. Data Integration: Experience with data integration tools and techniques, including data ingestion, transformation, and loading (ETL). Data Analysis: Familiarity with data analysis techniques, including data visualization, reporting, and statistical analysis. Data Security: Knowledge of data security principles, including data encryption, access control, and authentication. Additional Skills: DevOps: Familiarity with DevOps practices, including continuous integration and continuous deployment (CI/CD). Machine Learning: Knowledge of machine learning concepts and techniques, including model development, training, and deployment. Data Governance: Understanding of data governance principles, including data quality, data security, and data compliance. Cloud Security: Familiarity with cloud security principles, including identity and access management, network security, and data encryption. Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Required Certification:Databricks Certified Data Engineer Professional \| Databricks ___________________________________________________________________________________________________________ Here at Harmonia we are pleased to have been repeatedly recognized for our outstanding work culture, the innovative work we do, and the employees on our team who make a difference each day. Some of these recognitions include: Recognized as a Top 20 "Best Place to Work in Virginia" Recipient of Department of Labor's HireVets Gold Medallion Great Place to Work Certification for five years running A Virginia Chamber of Commerce Fantastic 50 company A Northern Virginia Technology Council Tech 100 company Inc. 5000 list of fastest growing companies for eleven years Two-time SBA SBIR Tibbett's Award winner Virginia Values Veterans (V3) Certification We recognize that every bit of our success is the result of our teams of hard-working, motivated, and innovative professionals who are proud to call themselves part of the Harmonia family! In addition to competitive compensation, a family-focused culture, and a dynamic, productive work environment, we offer all full-time employees a variety of benefits including, but not limited to Traditional and HSA- eligible medical insurance plans w/ Wellness Incentives for employees and family 100% employer-paid dental and vision insurance options 100% employer-sponsored STD, LTD, and life insurance Veterans Cohort Gym membership reimbursement 401(k) matching Dollar-for-dollar 501(c)(3) donation matching Flexible-schedules and teleworking options Paid holidays and Flexible Paid Time Off Adoption Expense Reimbursement Paid Parental Leave Professional development and career growth opportunities and paid training days Employer-sponsored Employee Assistance Program for employee and family Team and company-wide events, recognition, and appreciation-- and so much more! Check out ourLinkedIn,Facebook, andInstagramto find out a little more about who we are and if we are the right next step for your career! Harmonia is an Equal Opportunity Employer providing equal employment opportunity to all employees and applicants for employment without regard to race, color, religion, national origin, age, gender, gender identity, sexual orientation, disability, or genetics.Harmonia does and will take affirmative action to employ and advance in employment individuals with disabilities and protected veterans.To perform the above job successfully, an individual must possess the knowledge, skills, and abilities listed; meet the education and work experience required; and must be able to perform each essential duty and responsibility satisfactorily. Other duties in addition to those listed may be assigned as necessary to meet business needs. Reasonable accommodation will be made to enable an applicant with a disability to successfully apply for and/or perform the essential duties of the job. If you are in need of an accommodation, please contactHR@harmonia.com.