Senior Spark/Pyspark (databricks)

Descrição da Empresa

A Irium é uma empresa líder na implementação de Soluções e Sistemas de Tecnologia da Informação há mais de dezoito anos. Durante esse período, desenvolvemos e lançamos uma ampla gama de serviços de Suporte de TI flexíveis, de rápida implementação e totalmente adaptados às exigências e particularidades dos nossos clientes. O nosso objetivo é acompanhar as empresas no desenvolvimento de projetos, ajudando-as a otimizar seus recursos tecnológicos e de gestão. Para isso, os mais de setecentos de cinquenta profissionais que compõem hoje a IRIUM, assumem o compromisso e o desafio de superar cada projeto que empreendemos e com o qual construímos uma experiência que nos tornou líderes de um mercado complexo e em constante evolução.

Descrição da Função

At IRIUM we want you to always chase your dreams. Here, prepare yourself to conquer your goals, while enjoying the journey. We are currently looking for Senior Spark/Pyspark (databricks) for an Oil Company Requirements: The data engineering team is asking for engineers to join the Data Engineering analytics team

• To focus on reworking and modernizing our python and pyspark ETL library and Delta tables. o possibly leaning more toward software engineer than strict data engineer. o if they have Databricks experience that would be great.
• To focus on data engineering to bring in new tables and curate them for end users. o Candidate needs to have strong python/pyspark and SQL knowledge.
• To focus on building out our Data Quality framework with the Great Expectation spark library. Location: Lisbon, Braga or Coimbra and the working model will be hybrid What do we offer? An innovative and growing company, with a lot of opportunities for professional development. Retribution according to your experience and performance. Access to flexible pay and medical insurance as a social benefit. Unlimited access to technological training in free mode. IRIUM is a company with dynamic and proactive professionals. Our values are responsibility and commitment to work quality. This is the spirit we are looking for at IRIUM, whatever your age is. If you recognize yourself in this, this is your company! We can build the future together. Let’s talk! At IRIUM we defend a world without stereotypes or limitations and we believe in equality for all, principles that we subscribe to in our Equality Plan and Code of Ethics, guaranteeing equal treatment and opportunities regardless of any personal, physical or social condition. Localização
• Braga, Coimbra, Lisboa, Portugal, Portugal