You will be responsible for designing, implementing, and optimizing Databricks-based data architectures, ensuring scalable, secure, and efficient solutions.
Your main responsibilities will include:
Design and implement Lakehouse and Delta Lake architectures across cloud and multi-cloud environments.
Develop and optimize ETL/ELT pipelines using Apache Spark, Structured Streaming, and Lakeflow Declarative Pipelines.
Implement data governance, security, and lineage frameworks using Unity Catalog.
Define AI governance mechanisms using Unity Gateway.
Design environments supporting Machine Learning, Generative AI, and advanced analytics using MLflow and Databricks Genie.
Optimize Databricks platform performance and costs, applying FinOps best practices.
Participate in data platform modernization and migration projects towards Lakehouse architectures.
Advise clients on Databricks best practices and collaborate with technical and business teams.
WHAT ARE WE LOOKING FOR?
Strong experience in data architecture and designing Databricks-based solutions.
Deep knowledge of Apache Spark, Delta Lake, Unity Catalog, and Photon.
Experience with cloud platforms such as Azure, AWS, or GCP.
Knowledge of cloud infrastructure, networking, storage, and IAM security.
Experience designing ETL/ELT pipelines and data processing solutions.
Knowledge of data governance, performance optimization, and Lakehouse architectures.
Strong communication skills, autonomy, and a customer-oriented mindset.
Fluent English and Spanish, both written and spoken.
Degree in Computer Science, Information Systems, or equivalent professional experience.
Nice to have:
Experience with Lakeflow, MLflow, Genie, or Unity Gateway.
Knowledge of Generative AI and Machine Learning.
Experience migrating legacy data platforms to Databricks.
Knowledge of FinOps and cloud cost optimization.
Databricks Data Engineer Professional certification or Platform Architect accreditations.
WHAT CAN YOU EXPECT FROM DEVOTEAM?
At Devoteam, we believe technology creates greater impact when combined with talented people. We offer:
Competitive salary based on your experience.
Annual performance bonus, linked to individual, team, and company objectives.
Flexible compensation package, including transport, childcare, training, health insurance, and meal benefits.
Employee benefits, including discounts, physiotherapy, and free English classes.
Career development opportunities, with access to training, certifications, and annual performance reviews.
100% remote working model.
If you enjoy designing modern data architectures and leveraging Databricks to help organizations unlock the full potential of their data, we'd love to hear from you!