jobholds
Associate Director - Data Engineering
الهند , Hyderabad
•
تاريخ النشر: 2022-05-23
•
29 مشاهدة
تفاصيل ومتطلبات الوظيفة
Auto req ID: 270348BR Job Description Position Overview Provide leadership and management to a team of data engineers, managing processes and their flow of work, vetting their designs, and mentoring them to realize their full potential. Engages with team members, uses informal and structured approaches to career development to focus on individual improvement/capabilities, and to provide balanced feedback. Provide a thorough review of applications architecture, labor costs and optimal cloud hosting costs. Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners. Establish and manage architecture councils, forums, and other related thought-leadership innovation activities Oversee work with internal clients and external partners to structure and store data into unified taxonomies and link them together with standard identifiers. Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products. Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance. Responsible for implementing best practices around systems integration, security, performance and data management. Create project deliverables: such as data requirements for D+A global data products, track plans and resource allocation Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape. Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions. Partner with the business, IT, and technical subject matter experts to ensure execution of enterprise-wide data engineering products & platform development. Implement DevOps, DataOps and Agile methodologies to improve KPIs like cycle times, consistency, and quality. Partner with enterprise data governance to establish master data management strategy for shared data domains Develop and optimize procedures to “production Alize” data science models. Define and manage SLA’s for data products and processes running in production. Manage & support large-scale experimentation done by data scientists. Design and prototype new approaches and build solutions at scale. Research and cultivate in state-of-the-art data engineering methodologies. Establish practices of documentation for learnings and knowledge transfer. Design and audit reusable packages or libraries. Checklist of Experience Required for this Position: We'll be upfront with you: We will only consider candidates with the following experience. For a candidate to be considered for this role, she or he will absolutely need to have: 16+ years of overall technology experience that includes at least 8+ years of hands-on software development, data engineering, and systems architecture. 8+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. 8+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.). 5+ years in cloud data engineering experience in at least one cloud (Azure, AWS, GCP). Fluent with Azure cloud services. Azure Certification is a plus. Experience scaling and managing a team of 5+ engineers. Experience with integration of multi cloud services with on-premises technologies. Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines. Experience with data quality and data profiling tools like Apache Griffin, Deequ, and Great Expectations. Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. Experience with at least one MPP database technology such as Redshift, Synapse or Snowflake. Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes. Experience in cost estimation for cloud hosting. Experience with version control systems like Github and deployment & CI tools. Experience with Azure Data Factory, Databricks and Mlflow is a plus. Experience with Statistical/ML techniques is a plus. Experience with building solutions in the retail or in the supply chain space is a plus Understanding of metadata management, data lineage, and data glossaries is a plus. Working knowledge of agile development, including DevOps and Data Ops concepts. Familiarity with business intelligence tools (such as Power BI). BA/BS in Computer Science, Math, Physics, or other technical fields. Skills and Experience Required: As well as the above mandatory requirements, we are also looking for candidates with below differentiating skills, let us know if you have them, to put your profile on top: Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management. The Role Proven track record of leading, mentoring, hiring and scaling data teams. Strong change manager. Comfortable with change, especially that which arises through company growth. Able to lead a team effectively through times of change. Ability to understand and translate business requirements into data and technical requirements. High degree of organization and ability to manage multiple, competing projects and priorities simultaneously. Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment. Strong leadership, organizational and interpersonal skills; comfortable managing trade-offs. Foster a team culture of accountability, communication, and self-management. Proactively drives impact and engagement while bringing others along. Consistently attain/exceed individual and team goals Ability to lead others without direct authority in a matrixed environment. Qualifications/Requirements 16+ years of overall technology experience that includes at least 8+ years of hands-on software development, data engineering, and systems architecture. 8+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools. 8+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.). 5+ years in cloud data engineering experience in at least one cloud (Azure, AWS, GCP). Fluent with Azure cloud services. Azure Certification is a plus. Experience scaling and managing a team of 5+ engineers. Experience with integration of multi cloud services with on-premises technologies. Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines. Experience with data quality and data profiling tools like Apache Griffin, Deequ, and Great Expectations. Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets. Experience with at least one MPP database technology such as Redshift, Synapse or Snowflake. Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes. Experience in cost estimation for cloud hosting. Experience with version control systems like Github and deployment & CI tools. Experience with Azure Data Factory, Databricks and Mlflow is a plus. Experience with Statistical/ML techniques is a plus. Experience with building solutions in the retail or in the supply chain space is a plus Understanding of metadata management, data lineage, and data glossaries is a plus. Working knowledge of agile development, including DevOps and Data Ops concepts. Familiarity with business intelligence tools (such as Power BI). BA/BS in Computer Science, Math, Physics, or other technical fields. Relocation Eligible: Eligible for Standard Relocation Job Type: Regular
وظائف مشابهة قد تهمك
Director - Market Access Payer & Provider Strategic Contract Analytics
الولايات المتحدة
عرض →
Direct-to-Consumer Lead Poland
بولندا
عرض →
阿克苏高级区域拓展主任Sr.TDS
الصين
عرض →
Territory Sales Manager Rahim Yar Khan
باكستان
عرض →
Study Manager
بولندا
عرض →
Director, Oncology Clinical Biomarkers
الولايات المتحدة
عرض →
Maintenance Associate Leader
الولايات المتحدة
عرض →
Director Global Clinical Development Ops Process Management
المملكة المتحدة
عرض →
Director, ABPI Governance & Medical Signatory Excellence
المملكة المتحدة
عرض →
Regional Sales Director - Los Angeles, CA
الولايات المتحدة
عرض →
ملخص الوظيفة
المجال / التصنيف
إدارة و سكرتارية
الدولة
الهند
المدينة
Hyderabad
نوع الدوام
دوام كامل
إعلان وظيفة موثوق ومعتمد
تم التحقق من بيانات الإعلان لضمان تجربة تقديم آمنة ومباشرة للباحثين عن عمل.