Intermediate Data Engineer

<b>Intermediate Data Engineer</b><br> We are actively seeking a talented <b>Intermediate Data Engineer</b> who is passionate about designing scalable data architectures and optimizing complex data workflows. This role is ideal for someone with hands-on experience in cloud environments, robust data pipeline development, and modern data engineering frameworks. You'll be joining a forward-thinking team committed to innovation, collaboration, and the delivery of high-quality data solutions.<br><br> <b>Key Responsibilities:</b><br><br><ul><li>Develop, optimize, and maintain scalable data pipelines using <b>PySpark</b> and big data ecosystems.<br><br></li><li>Design, implement, and manage <b>serverless ETL/ELT workflows</b> using <b>AWS Glue</b> and associated AWS services.<br><br></li><li>Collaborate with teams to integrate <b>Microsoft Fabric</b> (unified analytics and lakehouse architecture) where applicable.<br><br></li><li>Create reusable data transformation scripts and applications using <b>Python</b>.<br><br></li><li>Write and maintain complex <b>SQL queries</b> for data analysis and transformation across various relational databases.<br><br></li><li>Partner with stakeholders to understand requirements and design efficient <b>data models</b> and end-to-end data integration solutions.<br><br></li><li>Ensure best practices in version control, data quality, and workflow automation.<br><br></li></ul><b>Must-Have Skills & Experience:</b><br><br><ul><li><b>PySpark:</b> 1-3 years of hands-on experience.<br><br></li><li><b>AWS Glue:</b> 1-3 years with serverless data processing.<br><br></li><li><b>Python:</b> 3+ years with strong scripting and automation capabilities.<br><br></li><li><b>SQL:</b> 3+ years of writing and optimizing complex queries.<br><br></li><li><b>Data Pipeline Development:</b> 2-4 years of experience.<br><br></li><li><b>Cloud Platforms:</b> 2+ years working within <b>AWS</b> and/or <b>Azure</b> ecosystems.<br><br></li><li><b>Data Modeling:</b> 1-2 years designing scalable and efficient schemas.<br><br></li><li><b>ETL/ELT Workflow Design:</b> 2-3 years with orchestration and automation.<br><br></li><li><b>Version Control (Git):</b> 1-2 years using Git in collaborative projects.<br><br></li><li><b>Big Data Tools (e.g., Hadoop, Spark):</b> 1-2 years with distributed data systems.<br><br></li><li><b>Analytical Thinking:</b> Strong skills in debugging, performance tuning, and workflow optimization.<br><br></li></ul><b>Bonus Points:</b><br><br><ul><li>Exposure to or foundational knowledge of <b>Microsoft Fabric</b> is a strong asset.<br><br></li></ul><br /><br />With over 90 years' combined experience, NES Fircroft (NES) is proud to be the world's leading engineering staffing provider spanning the Oil &amp; Gas, Power &amp; Renewables, Chemicals, Construction &amp; Infrastructure, Life Sciences, Mining and&nbsp;Manufacturing&nbsp;sectors worldwide. With more than 80 offices in 45 countries, we are able to provide our clients with the engineering and technical expertise they need, wherever and whenever it is needed. We offer contractors far more than a traditional recruitment service, supporting with everything from securing visas and work permits, to providing market-leading benefits packages and accommodation, ensuring they are safely and compliantly able to support our clients.