Senior Data Engineer Job
Job Description Job Attributes+
Data & Analytics
What Data Engineering contributes to Cardinal Health
The Data & Analytics Function oversees the analytics life-cycle in order to identify, analyze and present relevant insights that drive business decisions and anticipate opportunities to achieve a competitive advantage. This function manages analytic data platforms, the access, design and implementation of reporting/business intelligence solutions, and the application of advanced quantitative modeling.
Data Engineering ensures raw data is usable and accessible for the organization. Data Engineering encompasses numerous specialties of data acquisition, integration, and provisioning.
Responsibilities:Designing and implementing data transformation, ingestion, and curation functions on GCP cloud using GCP native or custom programming Designing and building production data pipelines from ingestion to consumption within a hybrid big data architecture, using Java, dataflow, Python, airflow etc.Optimizing data pipelines for performance and cost for large scale data lakes.Ensure technical specifications are aligned with both business needs and technical design standards Partner with external consultants, solution providers, and managed services organizations to enable product/solution development as well as meeting documented standards Interact with multiple organizations to track project progress, identify risks, communicate risks and status to leadership, and to assess potential impacts to the business. Generate ideas and suggestions for process and technical improvements for platforms and processes supported by the team Ensure platforms and tools meet or exceed data security standards, including internal and external audits performed Willingness to become a techno-functional expert in the solutions being implemented. Use strong verbal and written communication skills that non-technical business and end-users can understand. Develop best practices for solution and tool frameworks, leveraging standard naming conventions, scripting, and coding practices to ensure consistency of data solution. Mentor and guide junior data engineers.Lead and architect data solutions.
Qualifications:Bachelor's degree preferred or equivalent work experience preferred 10+ years of architecture and engineering experience in Big Data systems, Data Analytics and Data Integration related fields preferred2+ years of hands-on GCP experience in Data Engineering, Cloud Analytics solutions and experience with operationalizing Enterprise scale solutions preferredHands-on experience architecting and designing data lakes on GCP cloud serving analytics and BI application integrationsHands-on experience with Data Ingestion technologies like GCP DataFlow, Fusion, and AirFlow5+ years of experience writing complex SQL queries, stored procedures, etc preferred Experience in designing and optimizing data models on GCP cloud using GCP data stores such as BigQuery.Experience integrating GCP or 3rd party KMS, HSM with GCP data services for building secure data solutions5+ years of Experience in Programming language Java, and frameworks- Spring Boot, Spring MVC, REST API development expertise preferredExperience architecting and implementing metadata management on GCPArchitecting and implementing data governance and security for data platforms on GCP. Preferred to have prior experience in Collibra and Atscale. Agile development skills and experience.Experience with CI/CD pipelines such as Concourse, Jenkins. Knowledge of Terraform is a plus.Knowledge to MLops platform like AI Vertex is preferred.Google Cloud Platform certification is a plus
What is expected of you and others at this levelApplies advanced knowledge and understanding of concepts, principles, and technical capabilities to manage a wide variety of projectsParticipates in the development of policies and procedures to achieve specific goalsRecommends new practices, processes, metrics, or modelsWorks on or may lead complex projects of large scopeProjects may have significant and long-term impactProvides solutions which may set precedentIndependently determines method for completion of new projectsReceives guidance on overall project objectivesActs as a mentor to less experienced colleagues
Cardinal Health is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, ancestry, age, physical or mental disability, sex, sexual orientation, gender identity/expression, pregnancy, veteran status, marital status, creed, status with regard to public assistance, genetic status or any other status protected by federal, state or local law.