Databricks Data Engineer

Job ID
134584
Job Type
Contract
Industry
Manufacturing
Pay Rate
$60 - $66 an hour
Location
Work from home

Talascend is currently seeking an Databricks Data Engineer for a remote, contract opportunity with our client.

Overview

The role involves developing and supporting data pipelines and analytics environments in an Azure cloud-based data lake, supporting enterprise-scale data solutions and ensuring data quality and management.

Responsibilities

  • Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture
  • Manage ingestion routines for processing large datasets across multiple projects and Databricks workspaces
  • Integrate data from various structured and unstructured sources to enable business insights
  • Apply data analysis techniques to derive insights from large datasets
  • Implement data management strategies to ensure data integrity, availability, and accessibility
  • Identify opportunities for cost optimization in data storage and processing
  • Monitor and support platform performance, cluster stability, and Spark optimization
  • Collaborate to enable AI-driven analytics and data science workflows
  • Integrate with Azure services such as Azure Functions, Storage Services, Data Factory, Log Analytics, and User Management
  • Provision and manage infrastructure using Infrastructure-as-Code (IaC)
  • Apply best practices for data security, governance, and compliance
  • Collaborate with technical and non-technical teams to gather requirements and develop data solutions

Qualifications

  • BS degree in Computer Science or related field with 3+ years of experience, or Master’s degree with 2+ years of experience
  • 3+ years of experience developing and designing ingestion flows (structured, streaming, unstructured data) using cloud platform services including data quality
  • Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and Spark development
  • Proficiency in Python, Spark, and R; .NET knowledge is a plus
  • Experience with data governance, metadata management, data security, and enterprise data cataloging
  • Experience with Agile methodologies, CI/CD automation, and cloud-based development (Azure, AWS)
  • Must be a U.S. citizen and willing to support periodic on-site activities in the Washington, DC or Indianapolis, IN area

 

  • Additional certifications in Azure cloud and knowledge of FinOps principles

We thank all applicants for their interest. However, only those qualified individuals who closely meet the qualifications of the position will be contacted. The details of the position are only a summary, other duties may be assigned as necessary.

Background Check and Drug Screen may be required.

Apply Now

Pay range is not a guarantee of compensation or salary, as final offer amount may vary based on factors including but not limited to experience and geographic location. Talascend also offers a variety of benefits including: health and disability insurance, 401(k), EAP, paid time off, and company-paid holidays. The specific programs and options available to an employee may vary depending on date of hire, plan requirements, schedule type, and client work site mandates.

Talascend is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

Start a new job search