Data Engineer (Cloudera)

With Just Over 7 Years Of Experience In The Portuguese Market, We Share Our DNA With More Than 200 Workers And Position Our Offer According To 3 Lines Of Service

Strategy (Outsourcing, NeXel, Team as a Service, Tech Academies);

R&D (Bootcamps, POC, Tech Lab);

Nearshore.In ADENTIS, wefocus on PEOPLE.

This Is Our Emotional Salary

Great Work-Life balance;

Very flexible organizational routine;

Health benefits (for youand your family);

Team Building activities;

Over 300 protocolsto offer you great discounts in different areas;

Continuous professional development sponsored by our Training and Certification Department;

Regular feedback on yourperformance through a personalized plan;

Comprehensive Career Plan And Progression Involving Assertive Performance Reviews.Responsibilities

• Distributed Data Processing:
  
  

Develop and optimize distributed data pipelines using Apache Spark, ensuring efficient processing of large datasets- Caching & Computation Optimization:

Implement Advanced Caching Techniques And Optimize Distributed Computation Workflows To Improve Data Retrieval Times And Resource Utilization- Partition Key Join Optimization

Optimize partition keys joins to speed up query processing and enhance overall system performance in distributed environments- SQL Query Optimization:

Optimize SQL queries for better performance and scalability, particularly in large-scale, distributed database systems- Cloudera Ecosystem:

Responsibilities

If applicable, leverage the Cloudera platform to manage and scale data workflows in big data ecosystems, ensuring reliability and efficiency - Wants to learn more about DevOps to be autonomous, with the following DevOps responsibilities (5-10% of the time)Requirements:

• Expertise in Apache Spark and distributed computation techniques- Experience with advanced SQL optimization and caching strategies- Knowledge of the Cloudera ecosystem is a valuable asset for managing big data platforms- Ability to work independently and take initiative to solve technical problems- Excellent communication skills to effectively collaborate with technical and non-technical teams.
• CI/CD Pipeline Automation- Version Control & Branching- Deployment Automation- Artifact Management- Containerization & Orchestration- Automation & Monitoring- Available to go to the office twice per weekIf you want to be part of a real People First organization, join us!
  
  

Send your CV to ******