Databricks Data Engineer

Job ID
135395
Job Type
Contract
Industry
Manufacturing
Location
Washington, DC, United States

Talascend is currently seeking a Databricks Data Engineer for a contract opportunity with our client in Washington, District of Columbia.

Overview

We are looking for a Databricks Data Engineer to develop and support data pipelines and analytics environments in a cloud-based data lake, primarily focused on Azure. The role involves translating business requirements into scalable data engineering solutions and ensuring data quality and management across enterprise-scale platforms.

Responsibilities

  • Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture
  • Manage ingestion routines for processing large datasets efficiently across multiple projects
  • Integrate data from structured and unstructured sources to enable business insights
  • Proficiency in data analysis techniques for deriving insights from large data sets
  • Implement data management strategies to maintain data integrity, availability, and security
  • Identify opportunities for cost optimization in storage, processing, and analytics operations
  • Monitor platform performance, address user requests, and support cluster stability and Spark optimization
  • Collaborate with cross-functional teams to enable AI-driven analytics and workflows
  • Integrate with Azure services such as Azure Functions, Storage, Data Factory, and Log Analytics
  • Provision and manage infrastructure utilizing Infrastructure-as-Code (IaC)
  • Ensure compliance with data security, governance, and federal regulation standards
  • Gather requirements and translate business needs into technical data solutions

Qualifications

  • Bachelor’s degree in Computer Science or related field with 3+ years of experience, or Master’s degree with 2+ years of experience
  • 3+ years of experience designing and developing data ingestion flows using cloud platform services with a focus on data quality
  • Databricks Data Engineer certification
  • 2+ years of experience maintaining Databricks platform and developing in Spark
  • Proficiency in Python, Spark, and R; .NET experience is a plus
  • Knowledge of data governance, metadata management, enterprise data catalog, and data security
  • Experience with Agile methodology, CI/CD automation, and cloud-based development in Azure or AWS
  • U.S. citizen required

Preferred Qualifications

  • Azure cloud certifications
  • Knowledge of FinOps principles and cost management
  • Experience working with federal regulatory standards and public trust environments

We thank all applicants for their interest. However, only those qualified individuals who closely meet the qualifications of the position will be contacted. The details of the position are only a summary, other duties may be assigned as necessary.

Background Check and Drug Screen may be required.

Apply Now

Talascend is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

Start a new job search