Lead Data Engineer Jobs

Lead Data Engineer

Summary The Lead Data Engineer will design, build, and maintain the organization’s enterprise data platform, leading the technical implementation of data pipelines, warehouses, and analytics infrastructure that powers business intelligence, reporting, and advanced analytics across the PBM and Pharmacy organization. This hands-on technical leadership role sets data engineering standards, mentors team members, and partners with business and technology stakeholders to deliver trusted, well-governed, and timely data products. * Essential Duties and Responsibilities * Data Platform Engineering: * Design and build scalable, reliable data pipelines that ingest, transform, and load data from operational systems, clinical platforms, claims, and third-party sources. * Develop and maintain the enterprise data warehouse, data lake, and analytical data models that serve reporting and analytics use cases. * Design data services and event-driven integration patterns that enable scalable downstream consumption by analytics platforms, operational systems, APIs, and AI-enabled applications. Technical Leadership * Serve as the senior technical authority for data engineering, setting standards for code quality, pipeline design, data modeling, and testing across the team. * Lead technical planning for data engineering initiatives, breaking work into well-scoped tasks and coordinating delivery across team members. * Mentorship and Collaboration: * Provide technical direction and code review for data engineers, ensuring consistency, quality, and adherence to standards. * Participate in hiring and onboarding of data engineering team members, including technical interviews and skills assessments. * Mentor data engineers across all levels, fostering a culture of technical excellence, knowledge sharing, and continuous improvement. Data Architecture And Modeling * Partner with the Architecture team to define and implement data architecture, including data warehouse models, data lake structures, and integration patterns. * Apply dimensional modeling, normalization, and modern data modeling techniques (e.g., Kimball, Data Vault) to support analytics and reporting requirements. Performance And Reliability * Optimize query performance, storage costs, and pipeline runtime across the data platform. * Implement observability, monitoring, and alerting for production data pipelines, and partner with operations to ensure timely incident response. * Identify reliability, data quality, and performance risks and develop mitigation strategies to ensure platform stability and data trustworthiness. Data Governance And Compliance * Implement controls to ensure compliance with HIPAA, PHI/PII handling, and other regulatory requirements applicable to the healthcare and pharmacy sectors. * Partner with security and compliance teams on access control, encryption, audit logging, and data lineage for sensitive data assets. * Design and enable scalable, governed data access patterns that support AI/ML systems, intelligent automation, and emerging agentic workflows, including structured, semantic, and real-time data consumption patterns. Business Partnership * Partner with analytics, business intelligence, and product teams to understand data needs and deliver fit-for-purpose datasets, models, and pipelines. * Translate business and reporting requirements into well-designed technical data engineering solutions. Tooling And Innovation * Evaluate and recommend new data engineering tools, frameworks, and cloud services that improve productivity, scalability, or cost-efficiency. * Stay current on advances in cloud data platforms, lakehouse architectures, streaming technologies, and AI/ML data infrastructure. Support And Troubleshooting * Provide production support for critical data pipelines, participating in on-call rotations as needed. * Diagnose and resolve complex data quality, performance, and integration issues spanning multiple systems and platforms. Operational Oversight * Implement data quality validation, backup and recovery, and pipeline monitoring to ensure continuous data delivery. * Recommend tooling and infrastructure needed to support the enterprise data platform. * Prepare and review data platform health metrics, pipeline performance reports, and project status updates. Documentation * Implement and maintain metadata, lineage, cataloging, and semantic data definitions that improve discoverability, trust, and machine usability of enterprise data assets. Education And Experience * Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field or relevant experience. Master’s degree in a relevant discipline preferred. * 8+ years of professional data engineering experience, with at least 2 years in a senior or technical lead capacity preferred. * Hands-on experience designing and operating enterprise data platforms in a healthcare, pharmaceutical, or Pharmacy Benefit Management environment preferred. * Prior experience implementing real-time data streaming pipelines that power reporting, dashboards, and operational visibility preferred. Knowledge, Skills, And Abilities * Expert-level proficiency in SQL, Python, and modern data engineering frameworks (e.g., Spark, dbt, Airflow). * Deep experience with cloud data platforms (Snowflake, Databricks, Redshift, or BigQuery) and storage layers (S3, ADLS). * Strong understanding of data modeling, warehousing patterns (Kimball, Data Vault), and lakehouse architectures. * Strong understanding of regulatory standards affecting the healthcare and pharmacy sectors, including HIPAA. * Proficient in modern cloud platforms (AWS, Azure), CI/CD for data, and infrastructure-as-code tools (Terraform, CloudFormation). * Experience building data foundations for AI agents and RAG-based applications, including semantic modeling, metadata enrichment, vector-search integration, governed APIs/tools, and secure access patterns for machine-consumable enterprise data. * Familiarity with Microsoft Power BI, including semantic models, datasets, and enablement of self-service reporting and dashboards. * Familiarity with real-time and streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming, Flink) supporting reporting and operational visibility. * Excellent communication skills, capable of explaining technical concepts to both engineering and business stakeholders. * Ability to lead technical initiatives end-to-end while mentoring engineers and driving quality and reliability. Work Environment / Physical Demands This position is in a typical office environment which requires prolonged sitting in front of a computer. Requires hand-eye coordination and manual dexterity sufficient to operate standard office equipment including operation of standard computer and phone equipment. May have occasional high stress when dealing with customers/clients. Some travel may be required. EOE M/F/D/V

IT Lead Data Engineer

From $138,000/yr

Job Summary JOB DESCRIPTION The Lead Data Engineer is expected to be an expert at effectively working with business partners to understand their data needs and develop technical designs and requirements to meet those needs. This role is the team leader in helping extract, transform, and store the Firm’s valuable data assets to achieve better operational efficiencies and provide better services to its clients through modern data movement pipelines. This role, in collaboration with other data engineers, data architects, and other IT teams, will operationalize and document data extraction and ingestion platforms. This role is the team’s leader for developing strategies, policies, and governance models to ensure the Firm’s data remains accurate, timely and relevant to the Firm’s goals. This role will provide guidance and mentorship to junior data engineers, as well as helping delegate work items and tickets across the Data Engineering team. Job Duties * Works with stakeholders and data architects to define and design data solutions to support the Firm’s data initiatives * Understands and locates where data assets exist within the Firm’s systems and design solutions integrating disparate data sources to solve problems and provide business value * Collaborates with project managers to provide effort estimates and provides technical leadership in solution design and requirements * Works closely with data governance to ensure principles are followed through the course of day-to-day data usage and solution design * Prepares mock-up solution designs, visualizations and reports to effectively demonstrate proposed solutions and deliverables * Acts as a subject matter expert, evangelist and catalyst to educate on the Firm’s data platforms and best practices as they relate to the usage and hygiene of the Firm’s data assets * Meets regularly with business line customers to gain a better understanding of their business processes and of the customer's evolving data needs to help identify potential data-related projects * Works with data scientists and developers to use emerging and advanced technologies such as artificial intelligence and machine learning to identify and extrapolate hidden patterns and trends, increasing the value of the Firm’s data * Builds and maintains constructive working relationships with project team members, vendors and other departments involved with projects, systems, and IT strategies * Serves as a technical expert and lead to other team members, reviewing proposed solution designs, conducting code reviews, and troubleshooting advanced technical issues * Identifies and executes continuous improvement efforts to ensure the Firm’s data remains accurate and timely * Works closely with the Information Security and Compliance teams to ensure the firm’s data strategy and technologies meet or exceed both internal policies and external regulatory requirements * Collaborates with BDO Global and other BDO member firms to ensure standards between organizations are followed in support of reusable models and rapid deployment of shared technology * Understands and follows Project Management basics and Project Management Office policies and procedures * Other duties as required Supervisory Responsibilities * N/A Education Qualifications, Knowledge, Skills, and Abilities: * High School Diploma or GED, required * Bachelor’s Degree in Computer Science, Information Management, Mathematics, or Statistics, preferred Experience * Eight (8) or more years working as a data engineer, data analyst or similar analyst/engineer roles, required * Eight (8) or more years working with PowerBI, Tableau or similar data visualization products, required * Five (5) or more years working within commercial cloud platforms such as Microsoft Azure, AWS, or GCP, required * Three (3) or more years using version control tools (Azure DevOps, GitHub), required * Demonstrable proficiency in developing and understanding custom and ad-hoc SQL queries, required * Experience working within a large, complex enterprise with significant regulatory and compliance requirements, preferred * Experience using a modern scripting language such as Python, Scala, R, or Java, preferred * Professional service firm experience, preferred Software * Strong proficiency in the use of Microsoft Office suite, specifically Excel, required * Strong proficiency in the use of SQL Server Management Studio (SSMS), or similar, required * Strong proficiency in the use of PowerBI, Tableau, Looker, Qlik, or similar, required Other Knowledge, Skills \& Abilities * Strong analytical, organizational and problem-solving skills * Excellent written communication skills, maintaining accurate documentation and technical authorship of complex documents * Ability to facilitate meetings efficiently and effectively * Ability to follow an issue through to its logical conclusion, and escalate as necessary * Ability to work independently as well as part of a team, including providing technical leadership to less experienced colleagues * Excellent interpersonal and customer relationship skills * Capable of working in a deadline-driven environment, while handling multiple complex projects/tasks simultaneously with a focus on details * Capable of working well under pressure while dealing with unexpected issues in a professional manner * Ability to work after hours and weekends as needed * Capacity to travel as needed Individual salaries that are offered to a candidate are determined after consideration of numerous factors including but not limited to the candidate’s qualifications, experience, skills, and geography. National Range: $138,000 - $170,000 Maryland Range: $138,000 - $170,000 NYC/Long Island/Westchester Range: $138,000 - $170,000 #Remote About Us Join us at BDO, where you will find more than a career, you’ll find a place where your work is impactful, and you are valued for your individuality. We offer flexibility and opportunities for advancement. Our culture is centered around making meaningful connections, approaching interactions with curiosity, and being true to yourself, all while making a positive difference in the world. At BDO, our purpose of helping people thrive every day is at the heart of everything we do. Together, we are focused on delivering exceptional and sustainable outcomes and value for our people, our clients, and our communities. BDO is proud to be an ESOP company, reflecting a culture that puts people first, by sharing financially in our growth in value with our U.S. team. BDO professionals provide assurance, tax and advisory services for a diverse range of clients across the U.S. and in over 160 countries through our global organization. BDO is the first large accounting and advisory organization to implement an Employee Stock Ownership Plan (ESOP). A qualified retirement plan, the ESOP offers participants a stake in the firm’s success through beneficial ownership and a unique opportunity to enhance their financial well-being. The ESOP stands as a compelling addition to our comprehensive compensation and Total Rewards benefits* offerings. The annual allocation to the ESOP is fully funded by BDO through investments in company stock and grants employees the chance to grow their wealth over time as their shares vest and grow in value with the firm’s success, with no employee contributions. We Are Committed To Delivering Exceptional Experiences To Middle Market Leaders By Sharing Insight-driven Perspectives, Helping Companies Take Business As Usual To Better Than Usual. With Industry Knowledge And Experience, a Breadth And Depth Of Resources, And Unwavering Commitment To Quality, We Pride Ourselves On * Welcoming diverse perspectives and understanding the experience of our professionals and clients * Empowering team members to explore their full potential * Our talented team who brings varying skills, knowledge and experience to proactively help our clients navigate an expanding array of complex challenges and opportunities * Celebrating ingenuity and innovation to transform our business and help our clients transform theirs * Focus on resilience and sustainability to positively impact our people, clients, and communities * BDO Total Rewards that encompass so much more than traditional “benefits.” Click here to find out more! * Benefits may be subject to eligibility requirements. Equal Opportunity Employer, including disability/vets Click here to find out more! All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status. "BDO USA, P.A. is an EO employer M/F/Veteran/Disability"

Lead Data Engineer - Data Platform Engineering (Hybrid)

From $174/yr

174891 Job Description We're looking for a hands-on Lead Data Engineer to architect and build the data pipelines and infrastructure that power our analytics, ML, and business intelligence capabilities. You'll design greenfield data solutions while modernizing our existing systems to create a scalable, reliable, and performant data platform. Leads the implementation of information systems to manage financial functions for Patient Financial Services/Accounts. Oversees projects and initiatives to meet user requirements. Serves as a liaison between department (user) and vendors. Ensures systems compliance to applicable laws, regulatory standards and policies. This is a unique opportunity to own critical data infrastructure from the ground up. You'll spend your time building robust ETL/ELT pipelines, optimizing data models, building reusable and extensible frameworks, and mentoring the team all while solving complex challenges around data ingestion, transformation, and orchestration at scale. Job Responsibility * Coordinates implementation of information system initiatives to meet user requirements. * Communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility. * Develops system specifications that appropriately meet department requirements. * Develops systems to track data in comprehensive and innovative ways. * Collaborates with hospital departments and outside vendors to facilitate managed care contract implementation. * Coordinates and maintains communication between the hospital and vendor(s) regarding system applications. * Performs periodic post-installation reviews of system initiatives. * Conducts system-wide in-services with managers and staff, as necessary. * Ensures systems compliance to applicable laws, regulatory standards and policies. * Uses knowledge and skills to contribute to the development of functional objectives and principles to achieve goals in innovative ways. Problems addressed are of diverse scope and complexity ranging from moderate to substantial. * Performs related duties as required. All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act. Duties not mentioned here, but considered related are not essential functions. Job Qualification * Bachelor's Degree required, or equivalent combination of education and related experience. * 5-7 years of relevant experience including technical experience with Apache Hadoop, NoSQL, setting up cloud clusters, Apache Spark, and other advanced data science and big data technologies, required. Highly Preferred * Extensive Google Cloud Platform (GCP) experience * Previous experience as a Data Platform Engineer/ Data Engineer/ Analytics Engineer for a large organization * Experience in/ with Python (FastAPI, Pandas, Polars, etc.) * Experience with infrastructure as code, specifically Terraform * Extensive experience with Airflow, DBT, and/ or Dataform * Experience with OpenLineage, OpenMetadata and data contracts * Extensive experience with BigQuery, CloudSQL, Pub/ Sub, Dataflow, Cloud Storage, etc. * Experience with the Cloud Healthcare API/ FHIR/ HL7 * Additional Salary Detail The salary range and/or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future.When determining a team member's base salary and/or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).

Technical Lead – Data Engineering

From $12/yr

Technical Lead – Data Engineering Hybrid – Charlotte, NC 12mo+ Contract Role Overview We are seeking a Technical Lead – Data Engineering to provide hands-on technical leadership across our data engineering platform . This role combines deep technical expertise with collaborative leadership, architectural stewardship, and delivery accountability. In this role, you will partner closely with existing technical leadership within the Data \& Analytics organization, including other technical leads, architects, and senior engineers, to design and evolve scalable data solutions . You will help drive consistency, share best practices, and collectively shape the technical direction of the platform . The role remains highly hands-on , with significant contribution in AWS Glue (PySpark), Python, Kafka, AWS DMS, AWS Lambda, AWS Redshift, and Aurora PostgreSQL , while acting as a key technical voice within the broader data engineering leadership group. Key Responsibilities Technical Leadership \& Collaboration * Act as a hands-on technical leader for the Data Engineering area, collaborating with existing technical leads and architects to define and align on platform standards and architectural direction. * Partner with peer technical leaders to ensure consistency across data ingestion, transformation, streaming, and consumption patterns. * Contribute to shared technical roadmaps, design reviews, and architecture forums. * Provide technical guidance and escalation support while respecting shared ownership and collective decision-making. Architecture \& Engineering Standards * Help design, evolve, \& maintain scalable, fault-tolerant architectures for batch \& streaming data pipelines. * Establish and reinforce engineering standards for: * Pipeline design and reliability * Code quality and testing * Performance and cost optimization * Security and operational best practices * Drive alignment on ingestion strategies, CDC patterns, streaming vs. batch tradeoffs, and data modeling approaches. Hands-On Data Engineering * Lead development of complex ETL/ELT pipelines using AWS Glue (PySpark) and Python. * Build, optimize, and support Kafka-based streaming pipelines, including topic design, partitioning strategies, and consumer patterns. * Implement and tune AWS DMS pipelines for full-load and CDC ingestion. * Develop AWS Lambda functions for orchestration, automation, monitoring, and event-driven workflows. * Design and optimize schemas, queries, and performance for Amazon Aurora PostgreSQL. Platform Reliability, Performance \& Cost * Share ownership of platform reliability, scalability, and performance with other technical leaders. * Identify and resolve bottlenecks in Spark jobs, streaming consumers, and database workloads. * Ensure robust error handling, retries, idempotency, and recovery strategies. * Partner with cloud/platform teams on cost optimization, capacity planning, and infrastructure improvements. Data Quality \& Trust * Partner closely with Data Quality Engineers and peer technical leaders to ensure quality validations are embedded throughout pipelines. * Ensure pipelines support reconciliation, auditability, and observability. * Enforce data freshness, completeness, and accuracy SLAs for downstream consumers, including Qlik. Mentorship \& Team Enablement * Mentor data engineers through code reviews, design sessions, and technical coaching. * Collaborate with other technical leaders to raise the overall engineering maturity of the team. * Contribute to hiring, onboarding, and skills development efforts. * Promote knowledge sharing through documentation, demos, and internal forums. Stakeholder \& Cross-Team Engagement * Work closely with analytics, BI, \& business partners to translate requirements into scalable data solutions. * Partner with BI teams to ensure curated datasets are analytics-ready for Qlik. * Communicate technical decisions, risks, and tradeoffs clearly and collaboratively. Required Qualifications * 8+ years of experience in data engineering or backend data platform development . * 3+ years in a senior or technical leadership role with shared architectural ownership . * Expert-level experience with AWS Glue (PySpark) , Python , and distributed data processing . * Experience with Kafka and streaming architectures . * Hands-on experience implementing and supporting AWS DMS Batch and CDC pipelines . * Advanced SQL skills and experience with Amazon Aurora PostgreSQL . * Experience with AWS Lambda and serverless/event-driven architectures . * Strong understanding of data modeling and batch vs. streaming design patterns . * Demonstrated ability to collaborate effectively with peer technical leaders. * Excellent communication and documentation skills. Preferred Qualifications * Familiarity with orchestration tools ( Step Functions, Airflow ). * Knowledge of data governance , lineage , and cataloging practices . * Experience optimizing Spark workloads for performance and cost. * Experience in enterprise or regulated environments. What Success Looks Like * Strong partnership and alignment with existing technical leadership. * Data engineering standards are well-defined, shared, and consistently applied. * Pipelines are scalable, reliable, and meet performance and quality SLAs. * Engineers are well-supported, mentored, and productive. * Ramp up on product development and implementation within a 30-45 day timeframe. Disclaimer: Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment. EEO: We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws. Benefits \& Perks: Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc. Pay Disclaimer: The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

Lead Data Engineer - Primary Care

$142,300 - $195,700/yr

Become a part of our caring community ========================================= The Lead Data Engineer oversees data processing architectures and solutions ensuring the efficient conversion of structured and unstructured data to insights at enterprise scale. You will work on problems of diverse scope and complexity ranging from moderate to substantial. You will report to the Director, Business Intelligence. * You will ingest data from internal and external sources using cloud native platforms and software development best practices and patterns. * You will develop software tools using artificial intelligence, machine learning, and big data to turn data into insights that improve member outcomes. * You will exercise decision-making on complex issues regarding job responsibilities and related tasks, requiring analysis of variable factors and determining the best course of action. * You will lead the development of PCO Analytics' data warehouse using Medallion architecture and Kimball modeling to deliver optimized, business-ready data marts and star schemas for analytics. * You will lead the Information Architecture of PCO Analytics, establishing well-governed processes to ensure holistic metadata, reference data management, ontologies, and semantic layers. * You will collaborate with partners to develop data governance frameworks and standards. Required Qualifications * Bachelor's degree and 8+ years of technical experience in data engineering OR Master's degree and 4+ years of experience. * Expertise in Medallion architecture and Kimball dimensional modeling. * Experience integrating semantic and organizational data assets with leading AI platforms. * 2+ years of project leadership experience. * Advanced experience working with big and complex data sets within large organizations. * Advanced in SQL, Snowflake, Databricks, or other data systems. * 2+ years' experience in dbt. * Proficiency in understanding Healthcare related data. * Ability to work within the EST time zone. Use your skills to make an impact ===================================== Preferred Qualifications * Advanced Degree in a quantitative discipline, such as Mathematics, Economics, Finance, Statistics, Computer Science, Engineering or related field. * Experience creating analytics solutions for several healthcare sectors. * Cloud certification in leading cloud or AI platform such as Snowflake, Azure, Databricks, AWS, or GCP. Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required.Scheduled Weekly Hours 40Pay Range The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc. $142,300 - $195,700 per year This job is eligible for a bonus incentive plan. This incentive opportunity is based upon company and/or individual performance.Description of Benefits Humana, Inc. and its affiliated subsidiaries (collectively, “Humana”) offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities. Application Deadline: 07-03-2026About us ============ About CenterWell Senior Primary Care: CenterWell Senior Primary Care provides proactive, preventive care to seniors, including wellness visits, physical exams, chronic condition management, screenings, minor injury treatment and more. Our unique care model focuses on personalized experiences, taking time to listen, learn and address the factors that impact patient well-being. Our integrated care teams, which include physicians, nurses, behavioral health specialists and more, spend up to 50 percent more time with patients, providing compassionate, personalized care that brings better health outcomes. We go beyond physical health by also addressing other factors that can impact a patient’s well-being. About CenterWell, a Humana company: CenterWell is a leading healthcare services business focused on creating integrated and differentiated experiences that put our patients at the center of everything we do. The result is high-quality healthcare that is accessible, comprehensive and, most of all, personalized. As the largest provider of senior-focused primary care, a leading provider of home healthcare and a leading integrated home delivery, specialty, hospice and retail pharmacy, CenterWell is focused on whole health and addressing the physical, emotional and social wellness of our patients. CenterWell is part of Humana Inc. (NYSE: HUM). Learn more about what we offer at CenterWell.com. Equal Opportunity Employer It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment.

Unit Lead - Data Engineer (m/w/d)

Im Zuge unseres weiteren Wachstums möchten wir unser Team verstärken und suchen eine erfahrene Persönlichkeit als Unit Lead Data Engineering (m/w/d) . In dieser Rolle übernimmst du die fachliche und disziplinarische Führung unseres Data-Engineering-Teams, treibst innovative Datenprojekte voran und entwickelst gemeinsam mit uns zukunftsweisende technologische Lösungen. Dich erwartet ein spannender Mix aus Greenfield-Projekten und der Weiterentwicklung bestehender Plattformen mit Fokus auf moderne Data-Lakehouse-Architekturen. Neben deiner technischen und fachlichen Verantwortung gestaltest du aktiv den weiteren Ausbau der Unit – von Strategie und Portfolioentwicklung bis hin zur Unterstützung im Pre-Sales und Business Development. Wenn du den Anspruch hast, Strukturen aktiv zu gestalten, Verantwortung zu übernehmen und deine Erfahrung in anspruchsvollen Kundenprojekten wirkungsvoll einzubringen, freuen wir uns auf deine Bewerbung. Aufgaben Fachliche und disziplinarische Führung des Data-Engineering-Teams Aufbau, Konzeption und Weiterentwicklung moderner Datenplattformen und Data-Lakehouse-Architekturen (z. B. auf Basis von Databricks) Strategische Beratung unserer Kunden bei der Einführung und Skalierung datengetriebener Plattformen in unterschiedlichen Branchen Entwicklung und Optimierung von ETL-/ELT-Pipelines zur Verarbeitung großer Datenmengen in Batch- und Streaming-Szenarien Sicherstellung von Qualität, Best Practices und technischer Exzellenz im Team – von Code Reviews über Architekturentscheidungen bis hin zu Standards für DataOps und CI/CD Aktive Mitgestaltung der Unit-Strategie, des Portfolios sowie Unterstützung bei Go-to-Market- und Pre-Sales-Aktivitäten Qualifikation Du verfügst über Berufserfahrung, Studium oder Ausbildung im Bereich der IT Mehrjährige (5+ Jahre) Erfahrung im Data Engineering Fundierte Erfahrung mit Databricks (z. B. Delta Lake, Spark, Workflows) Erfahrung in der fachlichen oder disziplinarischen Führung von Teams oder der Leitung komplexer Projekte Kenntnisse moderner Datenarchitekturen (z. B. Data Lakehouse, Data Mesh) Sicherer Umgang mit Python, SQL und/oder Scala Erfahrung mit Cloud-Plattformen (Azure, AWS oder GCP) und DevOps-/DataOps-Praktiken (z. B. CI/CD, Git, Terraform) Strukturierte und selbständige Arbeitsweise Gute Kommunikationsfähigkeit sowie eine schnelle Auffassungsgabe Deutsch in Wort und Schrift (C2) / Englisch mind. B2 Benefits Wir bieten dir u.a.: Altersvorsorge Teamorientierte Unternehmenskultur und Teamevents Fachliche Weiterbildung Jobrad und Corporate Benefits Programm Flexible Arbeitszeiten, moderner Arbeitsplatz, Mobile Office Wir freuen uns auf deine Online-Bewerbung – werde Teil unseres Teams und profitiere von unseren länderspezifischen Unternehmens Benefits. Find more English Speaking Jobs in Germany on Arbeitnow

Lead Data Engineer

$125,000 - $150,000/yr

Overview: We're looking for a Lead Data Engineer to own the reliability and operational excellence of our data platform. You'll work hands-on across Snowflake, Airflow, AWS, Python, and SQL, building and operating systems that support analytics, machine learning, and business decisions. This is a technical leadership role, but it is also deeply hands-on. You'll write code, debug pipelines, tune performance, and operate production systems. You’ll also set standards, lead incidents, drive cost optimization, and remove technical blockers across teams. The expectation is simple: you do the work, and you set up the bar for how the work gets done. Responsibilities:* Build, maintain, and operate data pipelines and curated data products across Snowflake, Airflow (MWAA), AWS, Python, and SQL. * Optimize Snowflake architecture at scale. Design warehouse strategies, implement clustering and materialized views, enforce resource monitors, control costs, and tune performance across large datasets. * Implement observability and data quality controls. Build monitoring for freshness, volume, schema, distribution, and lineage. Define data quality SLOs and ensure teams can see issues before users do. * Support and operate production data systems. Troubleshoot failures, respond to alerts, debug pipeline issues, and improve system behavior based on real incidents. * Own SLAs, uptime, and service commitments for data platforms and critical services. Monitor performance, track reliability metrics, and make sure availability and freshness targets are met. * Lead major incident responses and postmortems. Coordinate resolution during critical outages, drive root cause analysis, and implement corrective actions that prevent recurrence. * Architect data platforms across dev, test, and production. Design for disaster recovery, upgrades without downtime, automation that recovers from failure, and availability that supports business continuity. * Define and enforce data platform standards. Establish orchestration patterns, DAG anti-patterns, deployment practices, observability standards, data quality patterns, and operational runbooks used across the organization. * Lead cost optimization programs. Identify savings across Snowflake (compute/storage) and AWS resources, forecast capacity needs, and balance cost against reliability and performance goals. * Lead AI and LLM adoption and governance. Build and validate AI-assisted pipelines, define approved use cases and guardrails, and ensure AI-generated output meets reliability and quality expectations. * Make architectural decisions with an organization-wide impact. Evaluate build versus buy, set migration strategies for legacy systems, define data contracts and API standards, and balance innovation with operational stability. * Lead technical planning and remove blockers. Coordinate with Cloud, Security, Analytics, Data Science, and Product teams to resolve dependencies and keep delivery moving. * Prevent knowledge silos. Write documentation, maintain runbooks, record architectural decisions, and create shared practices that let engineers operate independently and onboard quickly. * Design and enforce data governance controls for regulated environments. Implement PII handling, access controls, audit logging, data retention policies, and compliance validation for SOC 2, GDPR, HIPAA, or similar frameworks. Qualifications: * Deep hands-on experience with Snowflake, Airflow (MWAA), AWS, Python, and SQL in production environments. * Strong ability to design, build, debug, and operate data pipelines at scale. * Experience owning production systems with uptime and reliability expectations. * Proven ability to lead incident response and drive postmortems that result in real system improvements. * Solid data architecture and system design skills, including disaster recovery, high availability, and upgrades without downtime. * Experience implementing observability and data quality controls across complex data systems. * Demonstrated success defining and enforcing engineering standards adopted by other teams. * Strong cost management experience, including running optimization efforts and forecasting capacity. * Experience leading technical initiatives across teams without direct authority. * Experience implementing governance and compliance controls in regulated or high-risk environments. * Ability to mentor through standards, examples, and shared practices rather than formal people management. * 8+ years of data engineering experience, with several years owning critical platforms or services. Preferred qualifications * Experience leading AI and LLM adoption in data platforms, including validation of AI-generated pipelines and guardrail design. * Advanced Airflow experience, including reusable DAG patterns, scheduler tuning, and failure prevention. * Experience with dbt at scale, including testing standards, macros, and deployment practices. * Experience with OpenLineage, schemachange, or similar tools for lineage and schema management. * Experience leading platform migrations or modernization efforts with minimal disruption. * Experience streaming or near-real-time data systems such as Kafka, Kinesis, or Flink. * Experience running resilience testing such as failure injection or disaster recovery drills. * Cloud certifications such as AWS Certified Solutions Architect, AWS Data Analytics Specialty, or Snowflake SnowPro. * Bachelor's or master's degree in computer science, Data Engineering, or equivalent practical experience Base Salary: $125,000 -$150,000 USD The base salary range represents the low and high end of the anticipated salary range for this position based on the U.S. average. The actual base salary offered for this full-time position will be determined by various factors, including but not limited to, location, skills, knowledge, competencies, and experience. All full-time salaried employees are eligible for the following benefits, starting on day one: Flexible Paid Time Off Program, Medical, Dental, Vision, Life Insurance, Disability, and other voluntary coverages. You will also be eligible to participate in our 401k program, starting on the first of the month following 30 days of employment with a company match. This employer participates in E-Verify for US-based hires. #AttainFinance EEO Statement: Attain Finance Supports Equal Employment Opportunity. CURO (dba Cash Money®, LendDirect®, Heights Finance, Southern Finance, Covington Credit, Quick Credit, and First Heritage Credit) is committed to a policy of providing equal employment opportunity to all qualified employees and applicants. This commitment is reflected in all aspects of our daily operations. We do not discriminate on the basis of race, color, sex, religion, national origin, marital status, age, disability, veteran status, or genetic information in any personnel practice, including recruitment, hiring, training, compensation, promotion, and discipline. Additionally, we do not discriminate based on any other characteristic protected by applicable state/provincial or local law where a particular employee works. In addition, it is the policy of Attain Finance to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by federal law and any state/provincial law where a particular employee works. Notice to Attain Finance job applicants: Attain Finance will never ask for your personal banking information, transfer of funds, a credit card, or for you to purchase any equipment to process a job application or for training. Authorized Attain Finance representatives' email addresses will end in @attainfinace.com, @curo.com, @first-heritage.com, @heightsfinance.com, and @cashmoney.ca.

Lead Data Engineer

From $215,200/yr

Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. About the Team: The Transaction Core team, a key part of the PINT (Payments Intelligence) organization, is dedicated to building and maintaining the foundational data platforms that empower Capital One to understand and act on customer spend. Our mission is to provide an actionable understanding of purchase transactions to enrich our customer's financial lives through real-time, intelligent, and resilient platform-based services. What You’ll Do: * Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies * Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems * Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake * Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal \& external technology communities, and mentoring other members of the engineering community * Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment * Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: * Bachelor’s Degree * At least 4 years of experience in application development (Internship experience does not apply) * At least 2 years of experience in big data technologies * At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications: * 7+ years of experience in application development including Python, SQL, Scala, or Java * 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) * 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) * 4+ year experience working on real-time data and streaming applications * 4+ years of experience with NoSQL implementation (Mongo, Cassandra) * 4+ years of data warehousing experience (Redshift or Snowflake) * 4+ years of experience with UNIX/Linux including basic commands and shell scripting * 2+ years of experience with Agile engineering practices * Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer). The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked. San Francisco, CA: $215,200 - $245,600 for Lead Data Engineer Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter. This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Lead Data Engineer

From $10/yr

Sr./ Lead Data Engineer About The Role We are seeking an experienced Data Engineer (Lead / Sr) to drive engineering excellence within our team. In this role, you will be responsible for defining the technical vision of our invoicing platform, mentoring engineers, and collaborating closely with Product, Finance, and Operations to deliver scalable and reliable solutions. You will balance hands-on development with strategic oversight, ensuring high-quality delivery while fostering team growth. Key Responsibilities * Lead the design, development, and optimization of scalable invoicing systems, including invoice generation and reconciliation processes * Establish and enforce technical standards, architectural principles, and coding best practices * Serve as the primary technical liaison for cross-functional stakeholders across Finance, Product, and Operations * Perform comprehensive code reviews to ensure quality, maintainability, and security * Drive incident management, root cause analysis, and continuous improvement initiatives * Break down complex requirements into well-defined engineering tasks and delivery milestones * Proactively identify and address technical debt, balancing immediate delivery needs with long-term system sustainability Required Qualifications * 10+ years of software engineering experience, including at least 2 years in a technical leadership role * Strong expertise in backend system design, preferably within the healthcare domain * Proficiency in SQL, Snowflake, DBT, and Dagster * Solid understanding of relational databases, data modeling, and query performance optimization * Experience with cloud platforms and CI/CD pipelines * Proven ability to deliver high-quality solutions in agile environments * Excellent communication skills, with the ability to engage both technical and non-technical stakeholders * Collaborative mindset with a strong focus on mentoring and team development

Lead Data Engineer

$100,000 - $200,000/yr

Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress in finance and artificial intelligence. We believe that blockchain and digital asset innovation will transform how value moves through the world – and we're building the products and services to make that future a reality. Our institutional digital assets platform spans trading, investment banking, asset management, staking, self-custody, and tokenization technology. We also invest in and operate cutting-edge data center infrastructure to power AI and high-performance computing, addressing the growing demand for scalable energy and compute in the U.S. We work at the intersection of finance and technology, helping institutions, startups, and developers navigate a digitally native economy. Led by CEO and Founder Michael Novogratz, our team blends deep crypto expertise with institutional experience and a shared commitment to shaping the future of Web3 and AI. Galaxy is headquartered in New York City, with offices across North America, Europe, the Middle East, and Asia. To learn more about our businesses and products, visit www.galaxy.com. What We Value: We are a diverse team of free thinkers, and fast movers united to help investors and creators energize the global economy. We are looking for individuals who thrive in a culture of builders and overachievers and embrace high performance, transparent feedback, and a mission-first approach. Our culture shapes our way of working and gets us where we want to be. Seek Excellence.* Be Selective To Be Effective.* Be Highly Aligned, Loosely Coupled.* Disagree Transparently.* Encourage Independent Decision-Making.* Build Dream Teams.* Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production data platforms at scale — and you're ready to lead. You set the technical direction for data infrastructure, mentor other engineers, and raise the bar for engineering quality across the team. You're fluent in Python or Java and deeply experienced across the modern data stack — AWS, Databricks/Spark, dbt, and Airflow. You care about data quality, write clean and well-tested code, and own systems end-to-end from architecture through production. You're curious about crypto and energized by working at the intersection of finance and emerging technology. What You'll Do: * Set the technical vision and roadmap for Galaxy's data platform, partnering across business lines (Trading, Custody, Asset Management, Mining) to deliver reliable, scalable infrastructure * Architect, build, and operate scalable batch and streaming data pipelines, owning them from design through production * Develop and operate high-throughput, low-latency data processing systems * Work within the Databricks and Spark ecosystem to support large-scale data workloads * Build and maintain cloud-native data solutions on AWS * Leverage dbt for transformation, data modeling, testing, and documentation * Use Airflow (or similar orchestration tools) to manage and schedule data workflows * Write clean, efficient, and well-tested code, following best practices in software engineering * Mentor and develop other engineers, lead code reviews, and raise the bar for engineering quality across the team * Drive technical design discussions and decisions across teams, and continuously improve system performance, scalability, and reliability * Own production reliability — lead incident response, root-cause analysis, and long-term remediation * Partner with product, analytics, and infrastructure teams to deliver impactful data solutions aligned to business priorities What We're Looking For: * Bachelor's or Master's degree in Computer Science, Engineering, or related field * 8+ years of professional experience in data engineering or distributed systems, including time spent in a technical leadership or staff-level role * Expert hands-on coding experience in Python, Java, or similar languages * Proven track record of leading the design and delivery of large-scale data platforms in production * Experience building and operating both batch and streaming data pipelines * Deep experience with AWS, Databricks/Spark, and modern data architectures (lakehouse, streaming, real-time analytics) * Hands-on experience with dbt for transformations and Airflow (or similar) for orchestration * Solid understanding of data modeling, data quality, and production data systems * Experience working with relational and non-relational databases (e.g., Postgres, SQL Server) * Strong working knowledge of CI/CD, testing frameworks, and monitoring/observability tools * Experience mentoring engineers and influencing technical direction across teams Bonus Points: * Experience with dependency injections frameworks, ideally: Spring, Guice, HK2 * Experience with Docker * Full lifecycle development of a commercial system, including: requirements definition, agile planning, releasing, and production support * Experience in Crypto What We Offer: * Competitive base salary and discretionary bonus * Hybrid/Flexible Working Arrangements * Flexible Time Off (paid) * 3% 401(k) company contribution * Company-paid health and protective benefits for employees, partners, and other dependents * Generous paid Parental Leave * Competitive family planning benefits for US employees * Opportunities to learn about the Crypto industry * Smart, entrepreneurial, and fun colleagues * Free daily snacks and weekly breakfasts/lunches * Employee Resource Groups * Free coaching and counseling sessions through Headspace Apply now and join us on our mission to engineer a new economic paradigm. Galaxy respects diversity and seeks to provide equal employment opportunities to all employees and job applicants for employment without regard to actual or perceived age, race, color, creed, religion, sex or gender (including pregnancy, childbirth, lactation and related medical conditions), gender identity or gender expression (including transgender status), sexual orientation, marital or partnership or caregiver status, ancestry, national origin, citizenship status, disability, military or veteran status, protected medical condition as defined by applicable state or local law, genetic information or predisposing genetic characteristic, or other characteristic protected by applicable federal, state, or local laws and ordinances. We will endeavor to make a reasonable accommodation to the known limitations of a qualified applicant with a disability unless the accommodation would impose an undue hardship on the operation of our business. If you believe you require such assistance to complete the application process or to participate in an interview, please contact careers@galaxy.com.

Lead Data Center Engineer

From $127/yr

<h2>About Nubank</h2> <p>Nu is one of the largest digital financial platforms in the world, with more than 127 million customers across Brazil, Mexico, and Colombia. Guided by our mission to fight complexity and empower people, we are redefining financial services in Latin America – and this is still just the beginning of the purple future we're building. Listed on the New York Stock Exchange (NYSE: NU), we combine proprietary technology, data intelligence, and an efficient operating model to deliver financial products that are simple, accessible, and human. Our impact has been recognized by global rankings such as Time 100 Companies, Fast Company’s Most Innovative Companies, and Forbes World’s Best Bank. <br>Learn more at our careers page: https://international.nubank.com.br/careers/.</p> <h2><strong>About the role</strong></h2> <p>We are looking for a Lead Data Center Engineer to be the technical anchor for Nubank’s physical infrastructure and data center operations, ensuring reliability, scalability, and standardization across our global colocation footprint. The Data Center Eng team owns the physical layer of our infrastructure – from power, cooling, fire protection, security systems to structured cabling and operations – in data centers and technical rooms that host Nubank’s platforms.<br><br>As a key lead you will be a main point of contact for solving complex infrastructure inquiries, connecting multiple projects and stakeholders, and guiding the standardization of contracts, technical requirements, equipment, and documentation across all our data centers. </p> <h3><strong>As a Lead Data Center Engineer, </strong><strong>You'll be Responsible For</strong></h3> <ul> <li>Leading the technical direction of Nubank’s physical infrastructure and data center operations, acting as the main technical reference for the team on all infrastructure-related questions (power, cooling, space, cabling, safety, standards).</li> <li>Owning standardization across all data centers in terms of contracts, technical and operational requirements, equipment, and processes, ensuring a consistent, high-maturity setup in every site.</li> <li>Designing and maintaining robust, senior-level documentation (standards, procedures, runbooks, capacity, topology), making sure it is clear, up to date, and usable by different stakeholders across Nubank.</li> <li>Acting as the primary interface between Nubank teams and external data center providers, translating business needs into infrastructure requirements, work orders, change requests, and negotiations with vendors.</li> <li>Coordinating the design and deployment of infrastructure in third‑party data centers (space, racks, cages, power, cooling, cabling), ensuring compliance with Nubank’s safety, redundancy, and performance requirements – always focused on managing our space in colocation sites, not building our own data centers from scratch.</li> <li>Ensuring alignment between physical infrastructure and IT operations, including service installation, cabling changes, capacity planning, and estimating provider hours needed to deploy or modify environments.</li> <li>Supporting the manager in leading the team technically, helping to decompose work, review solutions, mentor engineers, and be the first escalation point for complex technical decisions so the manager can focus on strategy and broader topics.</li> <li>Interconnecting projects and maintaining standards across multiple data centers, making sure that, over time, all sites converge to the same level of standardization and quality in terms of infrastructure, contracts, and documentation.</li> <li>Driving continuous improvements in availability, resilience, and efficiency of our physical infrastructure (power systems, generators, UPS, cooling, fire protection, structured cabling, and more), in close collaboration with providers and internal stakeholders.</li> <li>Contributing to training and knowledge sharing within the team, helping to design and follow up on technical training, and creating clarity on expectations and standards for the broader group.</li> </ul> <h3><strong>We Are Looking for a Person Who Has</strong><strong><br></strong></h3> <ul> <li>Bachelor’s degree in Engineering (Mechanical, Electrical, Control/Automation, or related fields).</li> <li>8–10 years of experience in data center and technical room environments, including deployment and operations of physical infrastructure and IT infrastructure in colocation or enterprise data centers.</li> <li>Solid, hands-on experience with physical infrastructure systems such as power distribution, generators, UPS, cooling/HVAC, fire detection and suppression, and structured cabling in data centers.</li> <li>Proven experience working closely with data center IT operations (service installation, cabling changes, capacity planning, provider work orders and hours, and environment deployment activities).</li> <li>Demonstrated ability to act as a technical lead / anchor for a team, being the person others go to first for infrastructure questions and decisions, and ensuring consistent technical standards across multiple sites or projects.</li> <li>Strong track record of creating and maintaining clear, robust, senior-level technical documentation for infrastructure standards, procedures, and designs.</li> <li>Availability and interest to work based in São Paulo, Brazil, in a hybrid set‑up, with close proximity to the manager and most of the team.</li> </ul> <h4><strong><br></strong><strong>Nice to have</strong><strong><br></strong></h4> <ul> <li>Experience in large-scale technology or cloud companies and/or major data center providers, where you developed knowledge about power, cooling, equipment installation, structured cabling and vendor management.</li> <li>Experience supporting global, multi-site operations and collaborating with teams distributed across different countries.</li> <li>Previous experience mentoring or technically leading small engineering teams, especially in infrastructure or facilities-related contexts.</li> <li>Familiarity with financial services or other highly regulated industries and their expectations for reliability, resilience, and risk management.</li> </ul> <h2><strong>Location</strong></h2> <p>São Paulo, Brazil</p> <h2><strong>Our</strong><strong> </strong><strong>Benefits</strong></h2> <ul> <li>Chance of earning equity at Nubank</li> <li>Food/ Meal Card (Vale-Refeição and/or Vale Alimentação)</li> <li>Public Transportation Commuting Benefit (Vale-Transporte)</li> <li>NuCare – Psychological, Financial and Legal Assistance Program</li> <li>Life Insurance</li> <li>Medical Plan</li> <li>Dental Plan</li> <li>NuLanguage – Language Course Program</li> <li>Nucleo - Our learning platform of courses</li> <li>Extended Parental Leave</li> <li>Daycare Allowance</li> <li>Parental Consultancy</li> <li>Work-from-home Allowance</li> <li>Gym Partnerships</li> <li>30 days of paid vacation</li> <li>Relocation Assistance Package, if applicable</li> </ul> <h3><br><strong>Work Model for this Role</strong></h3> <p><strong>Hybrid 2-3 times/week</strong>: Our hybrid work model brings us to the office at least twice a week, on strategic days designed to maximize team connection and collaboration. For more details, visit&nbsp;<a href="https://building.nubank.com/nu-hybrid-work-model/">https://building.nubank.com/nu-hybrid-work-model/</a></p> <p><br><br></p>

Senior Lead Data Engineer (Bank Tech)

From $229,900/yr

Senior Lead Data Engineer (Bank Tech) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Senior LeadData Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. About the team: The Bank Tech Data, Decisioning, \& Market Services Domain serves as the analytical engine of the bank, building the infrastructure that turns data into smart, fast decisions. We integrate data and AI capabilities into a single, cohesive platform that supports our business and capital market teams. Our focus is on creating a modern data architecture that allows us to leverage information responsibly, providing the predictive insights needed to deliver better outcomes for our clients. Looking ahead, our imperatives are centered on evolving our predictive insights and scaling our AI-driven decisioning models. What You’ll Do: * Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies * Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems * Utilize programming languages like Python and Java and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake * Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal \& external technology communities, and mentoring other members of the engineering community * Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment * Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: * Bachelor’s Degree * At least 6 years of experience in application development (Internship experience does not apply) * At least 2 years of experience in big data technologies * At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications: * Master's Degree * 9+ years of experience in application development including Python, SQL, or Java * 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) * 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) * 4+ year experience working on real-time data and streaming applications * 4+ years of experience with NoSQL implementation (Mongo, Cassandra) * 4+ years of data warehousing experience (Redshift or Snowflake) * 4+ years of experience with UNIX/Linux including basic commands and shell scripting * 2+ years of experience with Agile engineering practices * Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked. McLean, VA: $229,900 - $262,400 for Sr. Lead Data Engineer Wilmington, DE: $209,000 - $238,500 for Sr. Lead Data Engineer Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate’s offer letter. This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City’s Fair Chance Act; Philadelphia’s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Lead Data Engineer – Modernization & Reliability

From $142,300/yr

Become a part of our caring community The Lead Data Engineer is responsible for leading the modernization, optimization, and stabilization of the Wisconsin Medicaid Market's data platform ecosystem across two independent health plan technology stacks. This role owns the market's Data Warehouse and ODS, drives ETL/data movement strategy (including SSIS modernization), and improves the reliability, observability, and security posture of data pipelines supporting critical Medicaid operations. The Lead Data Engineer partners closely with the Market BI team as their IT counterpart to improve data access and flow, including establishing and managing Databricks pipeline patterns and platform enablement as the BI environment evolves. The Lead Data Engineer owns and evolves the Wisconsin Medicaid Market's data stores and data movement ecosystem, including the Data Warehouse and ODS, and the ETL processes that connect vendor and internal systems. This role is accountable for modernizing and optimizing the market's data platform to improve reliability, reduce technical debt, strengthen observability/fault tolerance, and increase engineering efficiency in a complex dual-stack environment. The Lead Data Engineer is also the Market BI team's primary IT partner for data platform enablement — improving data access patterns, strengthening pipeline governance, and helping establish a maintainable approach to Databricks pipelines and workflows as the market matures its analytics capabilities. This is a Lead-level individual contributor role where work requires higher autonomy and complexity and includes directing the work of a small number of contract resources while remaining hands-on in delivery. Team Culture \& Expectations On the Wisconsin Medicaid Market IT team, how you show up is as important as what you accomplish. We value a positive attitude, curiosity, ownership, and a desire to learn and make a meaningful difference. This role requires collaboration, high accountability, and comfort operating in ambiguity while continuously improving data reliability, security, and outcomes for associates, members, providers, and other stakeholders. Skills \& Capabilities Use your skills to make an impact The ideal candidate blends deep data engineering fundamentals with the ability to lead through influence — setting direction, improving reliability, and guiding others' work (including contract resources) while staying hands-on. Required Skills * SQL, ETL/ELT \& Data Platform Depth - Proven production experience with SQL Server data engineering, including warehousing patterns, operational support, performance tuning, and ETL/ELT design. Strong experience with SSIS/SSRS and Azure Data Factory (or similar orchestration) in real operating environments. * Integration \& Interoperability Tooling (WI Market Reality) - Experience working across integration engines and healthcare data movement patterns, including tools such as Rhapsody / CorePoint * Modernization, Optimization \& Stabilization Mindset - Demonstrated ability to modernize and optimize fragile pipelines and legacy patterns, reduce technical debt, and improve reliability, observability, and fault tolerance. * Databricks / UDAP Growth Path (directional, not gatekeeping) - Experience with Databricks and/or enterprise data platforms (e.g., UDAP), or strong aptitude and desire to grow into these platforms as part of market modernization and enterprise alignment. * Execution Leadership - Highly organized, self-directed, and able to drive work to outcomes in an ambiguous, rapidly changing environment including planning, sequencing, and communicating progress/risk. Experience creating detailed technical documentation to gain buy-in and drive decisions. Team operates in SAFe Agile practices. * Vendor / Contract Resource Direction - Ability to direct and review contract resource work (clarify requirements, establish standards, review deliverables, ensure maintainability). Preferred Skills * Own the market's data stores (Data Warehouse + ODS) and ensure stability, security, and performance * AI Integration * Lead modernization and optimization of the ETL ecosystem, including SSIS modernization and improved reliability/observability * Drive reduction of legacy report patterns and support transition aligned to enterprise SSRS footprint reduction efforts * Partner with Market BI as their IT counterpart to improve data access and establish/manage Databricks pipeline patterns * Define and enforce data engineering standards aligned with enterprise direction. * Reduce technical debt and streamline workflows to lower operational burden on engineers and increase delivery capacity Additional Information Work-At-Home Requirements * WAH requirements: Must have the ability to provide a high speed DSL or cable modem for a home office. Associates or contractors who live and work from home in the state of California will be provided payment for their internet expense. * A minimum standard speed for optimal performance of 25x10 (25mpbs download x 10mpbs upload) is required. * Satellite and Wireless Internet service is NOT allowed for this role. * A dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required. Scheduled Weekly Hours 40 Pay Range The compensation range below reflects a good faith estimate of starting base pay for full time (40 hours per week) employment at the time of posting. The pay range may be higher or lower based on geographic location and individual pay will vary based on demonstrated job related skills, knowledge, experience, education, certifications, etc. $142,300 - $195,700 per year This job is eligible for a bonus incentive plan. This incentive opportunity is based upon company and/or individual performance. Description Of Benefits Humana, Inc. and its affiliated subsidiaries (collectively, “Humana”) offers competitive benefits that support whole-person well-being. Associate benefits are designed to encourage personal wellness and smart healthcare decisions for you and your family while also knowing your life extends outside of work. Among our benefits, Humana provides medical, dental and vision benefits, 401(k) retirement savings plan, time off (including paid time off, company and personal holidays, volunteer time off, paid parental and caregiver leave), short-term and long-term disability, life insurance and many other opportunities. About Us About Inclusa: Inclusa manages the provision of a person-centered and community-focused approach to long-term care services and support to Family Care members across the state of Wisconsin. As a values-based organization devoted to building vibrant and inclusive communities, Inclusa deploys a unique approach to managed care with a trademarked model of support named Commonunity® which focuses on the belief in everyone, and from that belief, the common good for all is achieved. In 2022, Inclusa was acquired by Humana. This partnership will allow us to create a model of care that provides industry-leading support for members across the health care continuum. About Humana: Humana Inc. (NYSE: HUM) is a leading U.S. healthcare company. Through our Humana insurance services and our CenterWell healthcare services, we make it easier for the millions of people we serve to achieve their best health – delivering the care and service they need, when they need it. These efforts are leading to a better quality of life for people with Medicare and Medicaid, families, individuals, military service personnel, and communities at large. Learn more about what we offer at Humana.com and at CenterWell.com. Equal Opportunity Employer It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment.

Lead Data Engineer

From $68,000/yr

Lead Data Engineer London Bridge £68,000 - £80,400 We’re looking for a Lead Data Engineer to play a pivotal role in shaping how Hyde uses data to make better decisions, improve services for residents and operate more effectively. This is an exciting opportunity for an experienced data professional to lead the development of modern, secure and scalable data solutions that support meaningful outcomes across the organisation. In this role, you’ll provide technical leadership across Hyde’s data platforms and pipelines, helping to ensure our systems are reliable, efficient and ready to meet the needs of a data-led organisation. You’ll work at the forefront of our cloud and data engineering capability, supporting better insight, stronger governance and more joined-up services. You’ll also lead and support a team of data engineers, driving high standards in delivery, security and continuous improvement. Working closely with colleagues across technology and the wider business, you’ll help turn complex data needs into practical solutions that improve customer outcomes and strengthen decision-making across Hyde. What you’ll be doing * Lead the design, build and delivery of Hyde’s data platform, including data pipelines, cloud infrastructure and integration solutions. * Ensure data solutions are scalable, secure and reliable, supporting real-time access to high-quality information across the business. * Drive engineering standards, governance and continuous improvement across data architecture, automation and deployment practices. * Work closely with stakeholders, analysts and technical teams to translate business needs into practical, value-driven data solutions. * Lead, coach and develop Data Engineers, creating a collaborative team culture focused on performance, learning and delivery. About you * You have strong experience leading data engineering work in a complex or enterprise environment. * You bring deep technical expertise in modern data platforms, cloud infrastructure and data pipeline development. * You understand data architecture, integration, security and governance, and can apply this knowledge in a practical way. * You can translate complex technical concepts into clear, accessible language for a range of stakeholders. * You’re a collaborative leader who can develop others, build strong working relationships and drive continuous improvement. Why join us? At Hyde, we’re committed to creating great homes and communities where people can thrive. If you’re looking for a leadership role where you can shape our data capability, influence strategic decisions and help deliver better outcomes for customers and colleagues, we’d love to hear from you. Diversity, inclusion and accessibility Equity, diversity and inclusion are central to life at Hyde. We’re committed to creating a truly inclusive workplace where everyone feels respected, valued and able to be themselves. Our aim is to have a workforce that reflects the diversity of the customers and communities we serve, ensuring that different perspectives are represented in decision-making, service delivery, and the way we shape our organisation. As a Disability Confident Employer, we’re happy to provide reasonable adjustments throughout the recruitment process and in the workplace.

Senior Lead Data Engineer

$37 - $61/yr

Department Name: IT ClinApps Insurance DivisionWork Shift: DayJob Category: Information Technology Banner Health was named to Fortune’s Most Innovative Companies in America 2025 list for the third consecutive year and named to Newsweek's list of Most Trustworthy Companies in America for the second year in a row. We’re proud to be recognized for our commitment to the latest health care advancements and excellent patient care. The Enterprise Population Health Management Analytics team is responsible for providing vital information that enhances the consumer, patient, provider, and employee experience across Banner Health. The team takes pride in delivering information that is used to provide insight and support key decision-making processes across the organization and with our business partners. This unit supports the critical data analytics needs for Banner Health and delivering the right information in a timely manner supports Banner Health’s mission of making health care easier, so life can be better. As the data engineering lead, you will partner with the business in gathering requirements, evaluating, developing, and implementing solutions that meets the needs of our customers. You will partner with various IT teams and subject matter experts in prioritizing projects and monitoring progress to ensure that deliverables are implemented on time. You will ensure appropriate resourcing is available to support these projects. This is a Monday through Friday position 8am - 5pm AZ Time zone. Your pay and benefits (Total Rewards) are important components of your Journey at Banner Health. Banner Health offers a variety of benefit plans to help you and your family. We provide health and financial security options, so you can focus on being the best at what you do and enjoying your life. Within Banner Health Corporate, you will have the opportunity to apply your unique experience and expertise in support of a nationally-recognized healthcare leader. We offer stimulating and rewarding careers in a wide array of disciplines. Whether your background is in Human Resources, Finance, Information Technology, Legal, Managed Care Programs or Public Relations, you'll find many options for contributing to our award-winning patient care. POSITION SUMMARY This position is a high-level individual contributor with expertise in selected business or healthcare processes and participates in formulating system scope and objectives relative to the company’s requirements. The incumbent participates in meetings, presentations, visioning sessions, planning sessions, implementation activities, and supports functions system wide. Acts independently or as a leader of a team to provide knowledge, guidance, research and fact- finding expertise to define, design and modify specifications and processes of complex information systems. Responsible for establishing system documentation standards and quality assurance methodologies for systems and applications. Maintains current professional and technical knowledge. CORE FUNCTIONS 1. Business Outcomes: Relentless focus on delivering outcomes and value to our business. Partners across organization and related functional areas to understand internal customer needs related to service excellence, including but not limited to analytical, technology and reporting needs; determine the appropriate course of action; make recommendations in an actionable format including to senior management, to achieve desired business results. Facilitates cross-functional teams and/or leads projects with departmental or company-wide scope to implement system changes. This may also include providing oversight, change management, general work direction or leadership to individuals on team; conducts regular meetings with stake holders and uploads necessary documents to the shared information repositories, such as SharePoint or Teams. 2. Technology Standards: Establishes and defines processes, documentation and standards for quality, and provides expert advice to ensure adherence to critical operating standards; mentors junior members of the team; Provides leadership for customers, information technology staff and various committees guiding the design, implementation and maintenance of complex application and system specifications and processes. Participates and may lead task forces to plan, implement, and coordinate facility activities to maximize information technology service quality, effectiveness and efficiency. 3. Innovation and Futures: Analyzes and reports on complex customer needs. Manages and supports the identification and research of new developments and uses of current systems and applications, as well as upgraded systems and applications. 4. Advisor \& Partner: Develops strong relationships with internal and business partners; collaborate in appropriate areas, including application design, system optimization, programming complex models, transferring large data feeds, and staying current on emerging technology related to all systems. 5. Communication: Presents information or ideas to the interests, level and needs of the audience. Actively engages participants and encourages input. Uses group process skills to ensure that the agenda is met. Promotes and facilitates free and open communication. Adapts choice of language and presentation of ideas to fit various needs and perspectives of audiences. 6. Measurements: Ensures Key Performance Indicators are developed and tracked in all levels of work effort. Clearly defines success and implements the measurements to understand when success is achieved. 7. Strategic: Designs and administers complex standards and policies regarding application and end user customer documentation. Ensures that department and company standards are implemented. 8. This position has responsibility for selected area of responsibility. Work is performed in a fast-paced multi-tasked environment where there may be conflicting priorities or tight deadlines. The incumbent must have significant knowledge about cross functional departments in order to serve as a liaison and provide relevant guidance or leadership. The incumbent has collaborative decision-making authority for projects and applications and works at peer and leader levels. The incumbent may also be expected to troubleshoot issues at a complex level and appropriately escalate issues to other resources, as needed. The incumbent participates in meetings, presentations, visioning sessions, planning sessions, implementation activities, and supports functions system wide. May be responsible for leading cross functional teams using project management skills to achieve desired results. MINIMUM QUALIFICATIONS Must possess strong technical and business knowledge as typically obtained through the completion of Bachelor’s degree in Statistics, Epidemiology, Computer Sciences, Process Engineering, Business, Healthcare, Information systems or related field. A minimum of four to seven years of experience or equivalent as typically obtained in one or multiple areas: reporting and/or analytics in clinical, financial, insurance, utilization, patient satisfaction, supply chain, HR, clinical application configuration, or related field. Must possess significant knowledge of cross functional departments in order to serve as a liaison and provide relevant guidance or leadership. Must possess strong project management skills and ability to work independently, manage large, multiple projects, complex reports, while organizing priorities. Excellent communication, interpersonal and critical thinking skills are required. Strong technical skills as appropriate for position (SQL/Ansi SQL, SAS, Tableau, Excel, clinical software applications, etc.). PREFERRED QUALIFICATIONS Experience with system implementation and project management. Additional experience with specialized applications in related area also preferred. Experience with department specific software (Cerner, NextGen, Centricity, TSI, and Quality Advisor, SAS or SSRS), including advanced integrated or independent report writing applications. Master’s degree or higher in relevant field. Advanced knowledge in area of expertise. Additional related education and/or experience preferred. Estimated Pay Range: $37.14 - $61.90 / hour Banner Health is committed to pay equity and transparency. The posted compensation range is a reasonable estimate that extends from the lowest to the highest pay Banner Health in good faith believes it might pay for this particular job, based on the circumstances at the time of posting. This range is based on possible base salaries and does not include the value of our total rewards package. Actual pay determined at offer will be based on years of relevant work experience, education, certifications, skills, and geographic location, along with a review of current employees in similar roles to ensure pay equity is achieved and maintained. EEO Statement: EEO/Disabled/Veterans Our organization supports a drug-free work environment. Privacy Policy: Privacy Policy

Lead Data Engineer

TransUnion's Job Applicant Privacy Notice What We'll Bring: What You'll Bring: We are looking for a Lead Data Engineer to join our growing Data Engineering and Analytics Practice who will drive building next generation suite of products and platform by designing, coding, building, and deploying highly scalable and robust solutions. You will be based both from our offices in Pune and working remotely as part of our ‘flex together’ approach. In this fast-paced role you will work with Business Stakeholders to achieve business goals. This exciting role will offer a host of development opportunities as part of a growing global business. What You'll Bring: Key Responsibilities: Design, build, test, and deploy innovative Big Data solutions at scale, including data lakes, data warehouses, and real-time analytics. Extract, clean, transform, and analyze vast amounts of raw data from various data sources. Build robust data pipelines and API integrations with various internal systems. Work across all stages of the data lifecycle, including data ingestion, storage, processing, and visualization. Implement best practices in data governance, security, and compliance across all data analytics processes. Estimate effort, identify risks, and plan execution effectively. Proactively monitor, identify, and escalate issues or root causes of systemic issues. Enable data scientists, business, and product partners to fully leverage our platform. Engage with business stakeholders to understand client requirements and build technical solutions and delivery plans. Evaluate and communicate technical risks effectively and ensure assignments are delivered on schedule with desired quality. Provide end-to-end big data solutions and design details to data engineering teams. Demonstrate excellent analytical and problem-solving skills. Exhibit excellent communication skills, with experience communicating with senior business stakeholders. Lead technical delivery on use cases, plan and delegate tasks to junior team members, and oversee work from inception to final product. Skills \& Experience: Essential: Bachelor’s degree in Computer Science, Engineering, Statistics or a related field 8+ years of data engineering experience, with at least 3 years in senior roles. 5+ years of experience in Big Data technologies (e.g., Spark, Hive, Hadoop, Databricks). Strong experience designing and implementing data pipelines. Excellent knowledge of data engineering concepts and best practices. Proven ability to lead, mentor, inspire, and support junior team members. Ability to lead technical deliverables autonomously and guide junior data engineers. Strong attention to detail and adherence to best practices. Experience in designing solutions using batch data processing methods, real-time streams, ETL processes, and business intelligence tools. Experience designing logical data models and physical data models, including data warehouse and data mart designs. Strong SQL knowledge and experience (T-SQL, working with SQL Server, SSMS). Advanced proficiency with Apache Spark, including PySpark and SparkSQL, for distributed data processing. Working knowledge of Apache Hive. Proficiency in Python, Pandas, PySpark (Scala/Java knowledge is desirable). Knowledge of Delta Lake concepts and common data formats, Lakehouse architecture. Source control with Git. Expertise in designing and implementing scalable data pipelines and ETL processes using the GCP data stack, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer, Cloud Functions, Dataproc (Spark). Expertise in building and managing ETL workflows using Apache Airflow, including DAG creation, scheduling, and error handling. Knowledge of CI/CD concepts and experience designing CI/CD for data pipelines. Software engineering principles, including: + Object-oriented programming (OOP) principles. + Design patterns and their application in data engineering. + Software development lifecycle (SDLC). + Agile methodologies and practices. + Unit testing, integration testing, and test-driven development (TDD). Performance optimization and scalability considerations. + Desirable : Experience with streaming services such as Kafka is a plus. R \& Sparklyr experience is a plus. Knowledge of MLOps concepts, AI/ML lifecycle management, and MLflow. Expertise in writing complex, highly optimized queries across large data sets to write data pipelines and data processing layers. * Jenkins experience is a plus. Relevant certifications (e.g., Google Cloud Professional Data Engineer). Impact You'll Make: TransUnion – a place to grow: We know that it is unrealistic to expect candidates to have each and every aspect of the essential and/or desirable skills listed above – if there is something you can’t tick off right now – good, you can learn here! Impact you will make: Enable Decision Making across the organization using data driven culture. This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week. TransUnion Job Title Specialist IV, Data Science and Analytics

Lead Engineer - Data

We are M\&G Global Services Private Limited (formerly known as 10FA India Private Limited, and prior to that Prudential Global Services Private Limited). We are a fully owned subsidiary of the M\&G group of companies, operating as a Global Capability Centre providing a range of value adding services to the Group since 2003. Our purpose is to give everyone real confidence to put their money to work. With a heritage dating back more than 175 years, we have a long history of innovation in savings and investments, combining asset management and insurance expertise to offer a wide range of solutions. Our two distinct operating segments, Asset Management and Life, work together to provide access to balanced, long-term investment and savings solutions. M\&G Global Services has rapidly transformed itself into a powerhouse of capability that is playing an important role in M\&G’s ambition to be the best loved and most successful savings and investments company in the world. Our diversified service offerings extending from Digital Services (Digital Engineering, AI, Advanced Analytics, RPA, and BI \& Insights), Business Transformation, Management Consulting \& Strategy, Finance, Actuarial, Quants, Research, Information Technology, Customer Service, Risk \& Compliance and Audit provide our people with exciting career growth opportunities. Through our behaviours of telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent. At M\&G our purpose is to give everyone real confidence to put their money to work. As an international savings and investments business with roots stretching back more than 170 years, we offer a range of financial products and services through Asset Management, Life and Wealth. All three operating segments work together to deliver attractive financial outcomes for our clients, and superior shareholder returns. Through our behaviours of telling it like it is, owning it now, and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent. We are looking to expand the in-house expertise in Data Technology and we need talented and skilled colleagues to implement data engineering solutions using latest technologies available in Azure Cloud space conforming to the best in class design standard \& agreed requirements Accountabilities/Responsibilities Lead data engineering projects to build and operationalize data solutions for business using Azure services in combination with custom solutions – Azure Data Factory, Azure Data Flows, Azure Databricks, Azure Data Lake Gen 2, Azure SQL etc Proven experience on leading a team of data engineers providing technical guidance and ensuring alignment with agreed architectural principles Experience in migrating on-premise data warehouses to data platforms on AZURE cloud Designing and implementing data engineering, ingestion and transformation functions using ADF, Databricks Proficient in Py-Spark Experience in building Python based APIs on Azure Function Apps Experience on Azure Logic apps Experience in Lakehouse/Datawarehouse implementation using modern data platform architecture Capacity Planning and Performance Tuning on ADF \& Databricks pipelines Support data visualization development using Power BI Exposure across all the SDLC process, including testing and deployment Experience in relational and dimensional modelling, including big data technologies Experience in Azure DevOps – Build CI/CD pipelines for ADF, ADLS, Databricks, Azure SQL DB etc Experience of working in secured Azure environments using Azure KeyVaults, Service Principals, and Managed Identities Good to have knowledge on Apigee (Googles API Management) Understanding of data masking, encryption and other practices used in handling sensitive data Ability to interact with Business for requirement gathering and query resolutions Working on off shore office based development teams, collaborating within a team environment and participating in typical project lifecycle activities such as requirement analysis, testing and release Develop Azure Data skills within the team through knowledge sharing sessions, articles, etc. Adherence to organisations Risk \& Controls requirements Should have skills for Stakeholder management, process adherence, planning \& documentationss Key Stakeholder Management Internal Business Teams Project Manager Architects Data Scientists Team members External Knowledge, Skills, Experience \& Educational Qualification Knowledge \& Skills: Azure Data Factory, Azure Data Lake Storage V2 Azure SQL Azure DataBricks Pyspark Azure DevOps Power BI Report Technical leadership Confidence \& excellent communication Experience: Overall 9+ years of experience 5 + Experience on Azure data engineering 5 + experience of managing data deliveries Educational Qualification: Graduate/Post-graduate. Preferably with specialisation in Computer Science, Statistics, Mathematics, Data Science, Engineering or related discipline Microsoft Azure certification (good to have) M\&G Behaviours relevant to all roles: Tell it Like it is Own it Now Move it Forward together with care and integrity We have a diverse workforce and an inclusive culture at M\&G Global Services, regardless of gender, ethnicity, age, sexual orientation, nationality, disability or long term condition, we are looking to attract, promote and retain exceptional people. We also welcome those who take part in military service and those returning from career breaks.

AI Delivery Lead, Associate Director - Insurance, Engineering AI & Data, AI&D

Basic information LocationLondon Business LineTechnology \& Transformation Job TypePermanent / FTC Date published02-Feb-2026 Req #22076 Job description Connect to your Industry At Deloitte, you will have the opportunity to work with leading global companies and help them tackle complex business challenges. As a senior AI Delivery Lead, you will be responsible for creating and delivering innovative solutions that drive long-term value for our leading Insurance clients. We are looking for talented individuals who share our passion for excellence and are committed to delivering exceptional results. At Deloitte, you will have access to unparalleled training and development opportunities, as well as the chance to work alongside some of the brightest minds in the industry. With a focus on next-generation technology-enabled projects, you will be at the forefront of innovation and have the chance to make a real impact. Join us and be part of a dynamic, collaborative, and supportive team that is dedicated to delivering exceptional results. Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients' become leaders wherever they choose to compete. To do this, we invest in outstanding people. We build teams of future thinkers, with diverse talents and backgrounds, and empower them all to reach for and achieve more. What brings us all together at Deloitte? It’s how we approach the thousands of decisions we make every day. How we behave, our beliefs and our attitudes. In other words: our values. Whatever we do, wherever we are in the world, we lead the way, serve with integrity, take care of each other, foster inclusion, and collaborate for measurable impact. These five shared values lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity You will play a critical role in both developing and delivering AI-enabled solutions for our clients. You will work closely with our most strategic clients to better understand their business needs and develop solutions that leverage the latest technology in the space of traditional AI, generative AI and data science. Our projects vary greatly and your responsibility will differ based on the focus of the client engagement and your skillset, but could include and may require you to: Collaborate with clients to understand their business needs and develop AI-enabled solutions that align with their goals and objectives. Lead on sales and business development activities, such as building client relationships, conducting bid processes, and driving out strategic partnerships. Build, lead and manage a team of AI professionals, including data scientists, engineers, developers and business analysts to ensure successful project delivery. Manage the entire project lifecycle, from inception to completion, including timelines, budgets, and scope. Stay up-to-date with the latest advancements in AI technology and identify opportunities to incorporate new tools and techniques into client solutions. Communicate project progress, risks, and issues to clients and stakeholders, and provide recommendations for addressing any challenges that arise. Oversee the implementation of data privacy and security guardrails throughout project lifecycles – including the implementation of ethical AI guardrails. Connect to your skills and professional experience You are a strategic thinker and problem solver, able to identify opportunities for innovation and growth while maintaining a focus on delivering high-quality solutions that meet or exceed client expectations. You are an exceptional communicator, able to articulate complex technical concepts to both technical and non-technical stakeholders with ease. You also have a strong ability to collaborate and work effectively in a team environment, leveraging the strengths of others to achieve common goals. In addition to this, we are looking for candidates who are able to demonstrate skills and experience in some of the following: Essential Skills: Deep Insurance industry experience with a proven track record within sub-market domains. Extensive experience in developing and delivering AI-enabled, production grade solutions at scale. Ability to identify AI opportunities and independently lead go-to-market propositions, providing a link between the business problem and technical solutions. Strong project management skills, including the ability to manage timelines, budgets, scope. Deep understanding of AI technologies, including Generative AI. Strong leadership skills, including the ability to enable a diverse technical and non-technical team. Knowledge of agile methodologies and experience working in an agile environment Desirable Skills: Knowledge of emerging AI technologies and their potential applications and risks. The ability to tell a compelling story by structuring thoughts in a way that is engaging and easy to follow. Experience in developing and delivering AI solutions using cloud-based platforms. Experience in agile project management methodologies, such as Scrum or Kanban. Experience in data visualization and storytelling, with the ability to communicate complex data insights to non-technical stakeholders Proficiency in programming languages such as Python, Java, C#. Connect to your business - Technology and Transformation Distinctive thinking, deep expertise, innovation and collaborative working. That’s what connects us. That’s what makes us Deloitte. If you want to help solve some of the biggest tech and transformational challenges around, join us. Together, we’ll make an impact that matters. Engineering, AI and Data We lead transformation at the heart of our clients; re-engineering the core of our clients’ organisations, helping to unleash growth, and creating better futures for their customers, citizens and employees. Personal independence Regulation and controls are standard practice in our industry and Deloitte is no exception. These controls provide important legal protection for both you and the firm. We are subject to a number of audit regulations, one of which requires that certain colleagues abide by specific personal independence constraints (e.g., in relation to any financial interests and employment relationships). This can mean that you and your "Immediate Family Members" are not permitted to hold certain financial interests (shares, funds, bonds etc.) with audit clients of the firm, and also prohibitions on certain employment relationships (e.g., you are not permitted to hold a secondary employment role with SEC audit clients of the firm whilst being employed by the firm). The recruitment team will provide further detail as you progress through the recruitment process or you can contact the Independence team upon request. Connect with your colleagues “What attracted me to Deloitte were the endless opportunities and the collective experience of other like-minded individuals. Deloitte’s clients include many of the world’s largest organisations; I wanted to be part of a team that made a difference that I could be proud of.” – Dan, Technology and Transformation "I get to work on projects that help clients in a sector I feel truly passionate about.” – Rhiannon, Technology and Transformation “Everyone always says “it’s the people,” and that’s true. Working for a brand you feel proud of feels pretty good too. And you don’t have any stress about fitting into a particular stereotype, because there are so many different types of people in Deloitte Digital.” – Gillian, Technology and Transformation Our hybrid working policy You’ll be based in London with hybrid working. At Deloitte we understand the importance of balancing your career alongside your home life. That’s why we’ll support you to work flexibly through our hybrid working policy. Depending on the requirements of your role, you’ll have the opportunity to work in your local office, virtual collaboration spaces, client sites and remotely. You’ll get the chance to meet face to face when needed, while you collaborate and learn from colleagues, share your experiences, and build the relationships that will fuel your career and prioritise your wellbeing. Please check with your recruiter for the specific working requirements that may apply for your role. Our commitment to you Making an impact is more than just what we do: it’s why we’re here. So we work hard to create an environment where you can experience a purpose you believe in, the freedom to be you, and the capacity to go further than ever before. We want you. The true you. Your own strengths, perspective and personality. So we’re nurturing a culture where everyone belongs, feels supported and heard, and is empowered to make a valuable, personal contribution. You can be sure we’ll take your wellbeing seriously, too. Because it’s only when you’re comfortable and at your best that you can make the kind of impact you, and we, live for. Your expertise is our capability, so we’ll make sure it never stops growing. Whether it’s from the complex work you do, or the people you collaborate with, you’ll learn every day. Through world-class development, you’ll gain invaluable technical and personal skills. Whatever your level, you’ll learn how to lead. Connect to your next step A career at Deloitte is an opportunity to develop in any direction you choose. Join us and you’ll experience a purpose you can believe in and an impact you can see. You’ll be free to bring your true self to work every day. And you’ll never stop growing, whatever your level. Discover more reasons to connect with us, our people and purpose-driven culture at deloitte.co.uk/careers WPFULL SLTTECH BAENGAI BAAIDAT

Lead Data Engineer

About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. </stron

Databricks Enterprise Lead Security Architect - Principal IT Software Engineer

$276,600 - $380,400/yr

GAQ426R246 We are looking for a highly skilled, technology and business-savvy Lead Security Architect to join our team within Databricks IT. In this dynamic, fast-paced environment, you will be responsible for designing and implementing a secure and scalable architecture to protect our corporate assets. You'll focus on key areas of IT security, including Identity and Access Management, Zero Trust architecture, and endpoint security, while also working to secure critical business applic

Senior Data Engineer (potentially a Lead role)

Subsets is an agentic lifecycle growth platform for subscription media businesses. We help leading businesses, such as The Atlantic, Daily Mail, and Matas, increase subscription growth through AI-driven retention and engagement initiatives. By analyzing subscriber behavior, Subsets automatically generates audiences and measures the incremental revenue lift in lifetime value, all within a no-code platform designed for Lifecycle Marketing and Growth teams. We are looking for a driven Senior Data Engineer (potentially a Lead role) to join our early team at Subsets as we build the future of AI-driven Subscription growth for CRM and Lifecycle teams. As one of the early team members, you will play a crucial role in the company, developing key infrastructure and directly contributing to the shaping of our product. You will collaborate with our software engineers and data scientists to build a scalable data infrastructure that powers our AI-driven platform. As a Data Engineer at Subsets, you w

Lead Data Engineer

$190,000 - $220,000/yr

Full Time - Remote, United States Join the Future of Healthcare Recruitment at Vivian Health Vivian Health empowers every healthcare professional to find their perfect job faster and easier than ever before. As the largest healthcare jobs marketplace, we support over 2 million clinicians in finding their next career opportunities. Our AI-driven platform also enhances process efficiencies for staffing agencies and healthcare employers, significantly reducing time to hire. Vivian Health is backed by world-class investors, including Thoma Bravo and IAC, with over $75 million in capital raised. Our accolades include BuiltIn’s awards for “Fully Remote Best Startup,” “Fully Remote Best Places to Work,” and “U.S. Best Startups to Work For” in 2024. About the team: Vivian Health is a remote-first company at the forefront of transforming the healthcare staffing landscape. The Data Team plays a critical role in providing insights that drive business strategy and empower data-driven decision maki

Senior Data Engineer (potentially in a Lead role)

AI-driven Retention Automation for subscription media businesses. About We are seeking a driven Senior Data Engineer (potentially in a Lead role) to join our early team at Subsets as we build the future of AI-driven Subscription growth for CRM and Lifecycle teams. As one of the early team members, you will play a crucial role in the company, developing key infrastructure and directly contributing to the shaping of our product. You will collaborate with our software engineers and data scientists to build a scalable data infrastructure that powers our AI-driven platform. As a Data Engineer at Subsets, you will work directly with our customers' data and have the opportunity to shape and impact the product experience for millions of subscribers (our customers’ customers). In this role, you will You may be a good fit if you have This is neither an exhaustive nor a necessary list of capabilities. If none of these apply to you, but you believe you can contribute to Subsets, please reach out.

Lead Data Engineer

From $100/yr

About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. </stron

Datadog for Startups Engineering Lead

The Datadog for Startups (DDFS) program helps the next generation of fast-scaling companies adopt best-in-class observability and security from day one. As the DDFS Engineering Lead, you’ll combine technical sales engineering expertise with ecosystem growth leadership to attract top startups into the program, showcase Datadog’s value early, and position Datadog as an essential platform for scaling. This role is ideal for someone who thrives at the intersection of startups, business dev

Databricks Enterprise Lead Security Architect - Principal IT Software Engineer

GAQ426R246 We are looking for a highly skilled, technology and business-savvy Lead Security Architect to join our team within Databricks IT. In this dynamic, fast-paced environment, you will be responsible for designing and implementing a secure and scalable architecture to protect our corporate assets. You'll focus on key areas of IT security, including Identity and Access Management, Zero Trust architecture, and endpoint security, while also working to secure critical business applic

Senior or Lead or Principal Data Engineer

Location type All On-site Hybrid Remote Location All Auckland Melbourne New Zealand Team All ClearPoint Australia ClearPoint New Zealand Work type All Contract Permanent Uncategorized ClearPoint Australia Apply Senior Software Engineer (.NET & ReactJS Full-Stack) Hybrid — Contract Melbourne ClearPoint New Zealand Apply Contract Senior Java Developer Hybrid — Contract Auckland Apply Contract Senior Software Engineer (.NET, GraphQL, Azure) Hybrid — Contract Auckland Apply Contract Senior Software Engineer (Language Agnostic) Hybrid — Contract Auckland Apply Senior or Lead or Principal Data Engineer Hybrid — Permanent Auckland Apply Senior Software Engineer (.NET & React Full-Stack) Hybrid — Permanent Auckland Apply Senior Software Engineer (React/Node.js) Hybrid — Permanent Auckland Apply Share your details Hybrid — New Zealand

Databricks Enterprise Lead Security Architect - Principal IT Software Engineer

GAQ426R246 We are looking for a highly skilled, technology and business-savvy Lead Security Architect to join our team within Databricks IT. In this dynamic, fast-paced environment, you will be responsible for designing and implementing a secure and scalable architecture to protect our corporate assets. You'll focus on key areas of IT security, including Identity and Access Management, Zero Trust architecture, and endpoint security, while also working to secure critical business applic

Tech Lead Databricks Data Engineer

$160,000 - $180,000/yr

About Mitre Media Mitre Media is redefining FinTech with AI-driven tools that empower millions of investors. Our portfolio, including Dividend.com and MutualFunds.com, leverages LLMs to deliver novel data insights and visually rich user experiences. For over a decade, we’ve served individual investors, financial advisors, and top asset managers like BlackRock and Vanguard through our premium data, tools, and advertising solutions. If you’re excited by the intersection of big data, AI, and investing, join our lean, entrepreneurial team from anywhere within ±3 hours of Eastern Time. About the Role As Tech Lead Data Engineer, you’ll architect and maintain the data backbone powering every feature across our product suite. Reporting to the CTO, you will design Databricks-based ETL pipelines, model complex investment data, and surface low-latency, high-quality datasets for both user-facing features and internal AI/analytics workloads. You’ll collaborate in a remote-first hybrid culture that values in-person “bursts” of collaboration, follow ShapeUp for project planning, and ship pragmatic solutions that favor de-scoping over delays. Responsibilities Design, implement, and optimize large-scale ETL workflows in Databricks (Apache Spark, Delta Lake, DBT). Develop algorithms that transform raw market data into actionable insights. Own data quality and lineage, instituting tests, monitoring, and alerting for mission-critical pipelines. Evolve our cloud data platform (AWS & GCP) for scale, performance, and cost efficiency. Mentor engineers, championing best practices in code reviews, documentation, and DevOps for data. Required Technical Skills Data Engineering Programming: Expert in Python plus working knowledge of Scala or Java. Databricks & Spark: Hands-on with cluster tuning, job orchestration, and Delta Tables. SQL & DBT: Strong analytical SQL, modular data-model design, and CI/CD for transformations. Cloud: Production experience on AWS or GCP data services (e.g., S3/GCS, EMR/Dataproc, Glue/Dataflow). ETL & Orchestration: Solid grasp of EL(T) patterns, workflow scheduling, and incremental processing. Data Modeling: Dimensional and schema-on-read designs for analytics and AI. AI & Analytics Enablement Building feature stores or inference-ready tables for ML/LLM workflows. Familiarity with vector databases or embedding pipelines Nice-to-Have Technical Skills Apache Airflow, Luigi, or Dagster for DAG orchestration. Experience with Looker, Tableau, or Stripe’s Vizier-style visualization stacks. Financial-markets domain knowledge (equities, ETFs, mutual funds). Machine-learning engineering or statistical-analysis background. Required Soft Skills Entrepreneurial mindset with a passion for AI and FinTech innovation. Self-starter who diagnoses problems, proposes trade-offs, and delivers. Clear communicator who thrives in distributed, cross-functional teams. Mentorship attitude—uplifts peers through code reviews and knowledge-sharing. Detail-oriented and disciplined about data accuracy and documentation. Why Join Us? Impactful Work – Your pipelines feed every insight we deliver to millions of investors. Cutting-Edge Tech – Databricks, Delta Lake, LLMs, Hotwire, and xAI’s API, all in a modern microservices stack. Autonomy & Influence – Work directly with the CEO & CTO to shape our data and AI strategy. Competitive Compensation – $150k – $185k CAD/USD plus benefits and performance bonuses. Remote Flexibility – Remote-first within ±3 hrs ET; optional collaboration hubs in Toronto and NYC. Growth Opportunities – Budget for conferences (e.g., Data+AI Summit, NeurIPS) and continuous learning. About Mitre Media’s AI-Driven Platform Mitre Media powers premium financial brands like Dividend.com and MutualFunds.com with the Mitre Platform. This platform integrates traditional content management, financial data, first-party data, ad revenue, and subscription tools, all enhanced by LLMs for rich, user-focused experiences. Our data-derived insights delight users, while our advertising solutions deliver unmatched performance for partners like BlackRock and Vanguard, leveraging advanced targeting and first-party data. How to Apply Submit your resume, GitHub profile, and a brief note on why you’re excited about building AI-driven FinTech to jobs@mitremedia.com.

Data Engineering Manager — Blockchain & Analytics Leader

A leading global financial technology company is looking for a Data Engineering Manager in Toronto. This role involves leading and mentoring a team of data engineers, driving execution in data warehousing and blockchain analytics. Candidates should have extensive experience in SQL, data architecture, and managing teams. A solid background in financial data and proficiency in programming languages like Python are essential. The position offers a competitive salary range of $195,000 to $257,500, reflecting its significance in driving company growth. #J-18808-Ljbffr