Job Description


Job Overview

  • Job ID:

    J55690

  • Job Title:

    Databricks Developer

  • Location:

    Louisville, KY

  • Duration:

    11 Months + Extension

  • Domain Exposure:

    Consumer Discretionary

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2, 1099, C2C

  • Work Authorization:

    US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Databricks Developer

Location:  Louisville, KY

Duration:11 months 

Bill Rate: $71/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Position Summary:
We are seeking an experienced Databricks Developer to design, develop, and optimize scalable data processing solutions using the Databricks Lakehouse Platform. The ideal candidate will have strong expertise in Apache Spark, PySpark, Spark SQL, and Delta Lake, along with experience building high-performance data pipelines and supporting enterprise-scale data modernization and analytics initiatives.

Key Responsibilities:
Data Engineering & Development

  • Design, develop, and maintain scalable batch and real-time data pipelines using Databricks.
  • Build robust data processing solutions using PySpark, Spark SQL, and Delta Lake.
  • Implement data validation, data quality checks, and performance-tuning strategies.

Data Lakehouse Management

  • Design and manage data architecture within the Databricks Lakehouse Platform.
  • Implement and manage Delta Lake tables, partitioning, optimization, and schema evolution.
  • Develop data models to support analytics and reporting requirements.
  • Ensure data reliability, scalability, and governance.

Performance Optimization

  • Analyze and optimize Spark jobs for improved performance and cost efficiency.
  • Monitor cluster utilization and apply resource management best practices.
  • Identify and troubleshoot bottlenecks in data processing workflows.
  • Improve processing times through caching, partitioning, and query optimization.

Data Governance & Security

  • Implement role-based access controls and data security standards.
  • Support data governance initiatives, data lineage tracking, and compliance requirements.
  • Ensure adherence to enterprise data management policies.

Collaboration & Delivery

  • Collaborate with Data Architects, Data Scientists, Business Analysts, and Application Teams.
  • Participate in Agile development processes and sprint ceremonies.
  • Prepare technical design documentation and support knowledge transfer activities.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 8+ years of hands-on Databricks development experience.
  • Strong expertise in Apache Spark and the Databricks Lakehouse Platform.
  • Hands-on experience developing data pipelines using PySpark and Spark SQL.
  • Experience with Delta Lake and its capabilities.

Experience Requirements

  • Overall Experience:10+ years.
  • Databricks Development Experience: 5+ years.

Required Skill

  • Databricks

Apply Now
Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.