Data Engineer, Sr. (Remote - US)

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Engineer, Sr. in the United States. This senior-level data engineering role focuses on building and optimizing data pipelines that power AI-driven applications and intelligent assistants. You will work with large-scale data ingestion, transformation, and storage processes while ensuring compliance with data governance and privacy standards. The position emphasizes innovation in data engineering, including embedding generation for text, image, and voice data, and optimizing GPU/CPU workloads. You will collaborate closely with cross-functional teams to improve operational efficiency and enhance AI/ML capabilities. This role is remote but requires alignment with Eastern Time Zone operations. Ideal candidates are technically proficient, experienced in streaming and batch data processing, and passionate about scalable, high-quality data solutions. Accountabilities: • Design, develop, and maintain streaming and batch ETL/ELT pipelines for ingesting structured and unstructured data into analytics, vector, and graph stores. • Automate embedding generation processes and refresh pipelines using change-data capture and cost-aware routing strategies. • Define and enforce data contracts, schema evolution strategies, and tiered storage policies for secure and efficient data management. • Monitor pipelines with OpenTelemetry metrics, tracking lineage, data freshness, and performance dashboards. • Collaborate with enterprise architects and technical leads to improve data retrieval, storage optimization, and governance standards. • Ensure compliance with data privacy regulations and maintain audit-ready, high-quality pipelines. • Provide guidance on scalable architecture and best practices for AI/ML data solutions. Requirements • 7+ years of experience in data engineering, with a proven record in designing and managing large-scale data pipelines. • 2+ years of experience working with embeddings or vector databases. • Hands-on expertise with Spark, Flink, Kafka, Kinesis, and ELT tools like DBT, Airflow, or Dagster. • Strong understanding of CDC, schema evolution, and compliance with GDPR/CCPA data retention policies. • Proficiency in Python and TypeScript for production-grade development. • Experience with Infrastructure as Code (IaC) tools such as Terraform or CDK. • Ability to optimize storage costs and GPU inference workloads effectively. • Excellent problem-solving, communication, and collaboration skills across technical teams. Benefits • Competitive hourly pay ranging from $47.35 to $86.00. • Medical, dental, and vision insurance coverage. • Flexible spending accounts for healthcare and dependent care. • Life, disability, and accident insurance. • Paid parental leave and adoption expense reimbursement. • 401(k) retirement plan and stock purchase options. • Employee discounts at properties worldwide. • Commuter benefits and employee assistance programs. • Childcare discounts and flexible work arrangements, including hybrid options. Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching. When you apply, your profile goes through our AI-powered screening process designed to identify top talent efficiently and fairly. Our AI evaluates your CV and LinkedIn profile thoroughly, analyzing your skills, experience, and achievements. It compares your profile to the job’s core requirements and past success factors to determine your match score. Based on this analysis, we automatically shortlist the three candidates with the highest match to the role. When necessary, our human team may perform an additional manual review to ensure no strong profile is missed. The process is transparent, skills-based, and free of bias — focusing solely on your fit for the role. Once the shortlist is completed, we share it directly with the company that owns the job opening. The final decision and next steps (such as interviews or additional assessments) are then made by their internal hiring team. Thank you for your interest! #LI-CL1 Apply tot his job