I will help to build pyspark notebooks and optimize jobs

Algumas informações são exibidas no idioma inglês.
Soham Das

Índia

Eu falo Inglês

4 pedidos finalizados

Databricks, Unity Catalog, ADF, DLT

Tools I work with - Databricks, Unity Catalog, DLT, Azure, SQL What I help with: - Design and build ETL pipelines using Azure Data Factory and Databricks - Optimize slow or failing Spark and PySpark ...
Saiba mais
Sobre este Serviço

Is your PySpark job taking hours? Is your SQL query timing out?

I will find exactly what's slowing it down and fix it.

I have optimized PySpark jobs processing billions of records in production environments. I know exactly where to look.


What I fix:

  • Slow PySpark transformations and actions
  • Partition skew and memory issues
  • Inefficient SQL queries on large datasets
  • Spark configuration tuning
  • DataFrame optimization and caching strategy


You share your code. I analyse, fix and explain exactly what was wrong and why.

Message me first with your problem. I will tell you honestly if I can help.

Saiba mais
help to build pyspark notebooks and optimize jobs
Tela Inteira
help to build pyspark notebooks and optimize jobs
Tela Inteira
help to build pyspark notebooks and optimize jobshelp to build pyspark notebooks and optimize jobs

Idioma:

Inglês

Experiência técnica:

apache spark

•

Databricks

•

Outros

Especialidade:

Pipelines de dados

•

Desenvolvimento de ETL

+ 2

Setor:

Data analytics

Tags relacionadas