Generative AI Data Engineer
Talascend is currently seeking a Generative AI Data Engineer for a remote, contract opportunity with our client.
Overview
This role involves designing and implementing innovative, AI-driven automation solutions across cloud environments, building intelligent data pipelines, and integrating Generative AI technologies to support analytics and reporting platforms. The candidate will work remotely with quarterly travel to Washington, D.C.
Responsibilities
- Design and maintain data pipelines in AWS using services such as S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB, and Step Functions
- Develop ETL/ELT processes to transfer data between multiple systems including DynamoDB, SQL Server (AWS), and Azure SQL
- Integrate AWS Connect CRM data into enterprise data pipelines for analytics and operational reporting
- Engineer ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing
- Leverage Generative AI services (AWS Bedrock, Amazon Q, Azure OpenAI, Hugging Face, LangChain) to automate vector generation, data quality checks, and enhance ingestion processes
- Build conversational BI interfaces for natural language access to data
- Develop AI-powered copilots for pipeline monitoring and troubleshooting
- Implement SQL Server stored procedures, indexing, query optimization, and performance tuning
- Apply CI/CD practices using GitHub, Jenkins, or Azure DevOps for data pipelines and AI model integration
- Maintain security and compliance using IAM, KMS encryption, VPC, RBAC, and firewalls
- Support Agile DevOps through sprint-based delivery of data and AI features
Qualifications
- BS in Computer Science or related field
- 2+ years of data engineering and automation experience
- Hands-on experience with SQL, SSIS, Python, Spark, Bash, PowerShell, AWS/Azure CLIs
- Experience with AWS services such as S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB
- Familiarity with Apache Flume, Kafka, Solr for data ingestion and search
- Knowledge of LLM, Generative AI frameworks with AWS Bedrock, Azure OpenAI, or open source tools
- Experience integrating REST APIs in data workflows
- Proficiency with SDLC tools like JIRA, GitHub, Azure DevOps, Jenkins
- Strong troubleshooting and performance optimization skills
- Experience operationalizing Generative AI pipelines including deployment and lifecycle management
- Ability to obtain Federal Public Trust clearance
Preferred Qualifications
- Certifications such as AWS Data Engineer, AWS AI/ML Specialty, Azure AI Engineer, Databricks Data Engineer
- Experience implementing RAG pipelines, embeddings, and vector search technologies
- Knowledge of multi-cloud data integration (AWS and Azure SQL)
- Experience with coding tools for GenAI, such as Claude Code, OpenAI Codex, VS Code
- Familiarity with data lineage and governance tools (e.g., Purview, Unity Catalog, AWS Glue Catalog)
- Experience with Infrastructure-as-Code tools like Terraform, CloudFormation, or Bicep
- Knowledge of compliance frameworks such as FedRAMP, PCI-DSS, HIPAA
We thank all applicants for their interest. However, only those qualified individuals who closely meet the qualifications of the position will be contacted. The details of the position are only a summary, other duties may be assigned as necessary.
Background Check and Drug Screen may be required.
Pay range is not a guarantee of compensation or salary, as final offer amount may vary based on factors including but not limited to experience and geographic location. Talascend also offers a variety of benefits including: health and disability insurance, 401(k), EAP, paid time off, and company-paid holidays. The specific programs and options available to an employee may vary depending on date of hire, plan requirements, schedule type, and client work site mandates.
Talascend is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.