Data Engineer Job at Robert Half, Morristown, NJ

TkE1RndhYkd6eUs3NmFianRIYnVCUS9zZmc9PQ==
  • Robert Half
  • Morristown, NJ

Job Description

Job Description

Job Description

We are seeking a skilled and motivated Data Engineer to join our team, with deep hands-on experience building and optimizing data pipelines and lakehouse solutions in Databricks. In this role, you will collaborate with cross-functional teams to design, develop, and operate scalable, reliable data products that drive business value.

Key Responsibilities

  • Design, build, and maintain batch and streaming data pipelines using Databricks (Spark, Delta Lake, Jobs/Workflows).
  • Partner with data scientists, analysts, and application teams to deliver trusted, well-modeled data sets and features in the Databricks Lakehouse.
  • Optimize Spark jobs (partitioning, caching, join strategies) and Databricks cluster configurations for performance, scalability, and cost.
  • Implement data quality checks, observability, governance, and security controls (e.g., Unity Catalog, access policies) within Databricks.
  • Troubleshoot and resolve pipeline failures, data issues, and production incidents; perform root-cause analysis and implement preventative improvements.

  • Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
  • Proven experience delivering production data engineering solutions in Databricks, including Apache Spark and Delta Lake on the Microsoft Azure cloud platform.
  • Strong proficiency in SQL and Python (or Scala), including building ETL/ELT pipelines and writing efficient Spark code.
  • Experience with data modeling and lakehouse/warehouse patterns (e.g., medallion architecture) and distributed data processing concepts.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and teamwork abilities.

Preferred Skills

  • Hands-on experience with Databricks ecosystem capabilities such as Unity Catalog, Delta Live Tables, MLflow, and/or Databricks SQL.
  • Experience implementing CI/CD and automated testing for Databricks notebooks/repos and deployment of Jobs/Workflows.
  • Knowledge of data security, privacy, and compliance controls in cloud lakehouse environments (including role-based access and auditing).

Job Tags

Similar Jobs

The Smile Mission Pllc

Dental Receptionist/Assistant Job at The Smile Mission Pllc

 ...Job Description Job Description Hiring a Hygienist/Sterilization/Dental Assistant No experience or license is necessary Training will be provided Great opportunity for anyone interested in working or learning more about the dental industry Opportunity... 

FocusGroupPanel

Remote Data Entry Clerk - Flexible Hours (Entry Level) Job at FocusGroupPanel

FocusGroupPanel is seeking a Remote Work From Home Data Entry Clerk for an entry-level position. This role allows you to work from virtually anywhere with a computer and internet access, making it ideal for anyone looking to earn income online. You can work flexibly, choosing... 

ICON Fabrication, LLC.

Steel Fitter/Fabricator Job at ICON Fabrication, LLC.

 ...Steel Fitters/Fabricators needed immediately for busy structural steel and miscellaneous metals fabrication shop located in the Charleston, SC area; which is under new management. We are presently seeking highly skilled and experienced personnel to work in our fast... 

Good Samaritan

Nursing Assistant, Certified Job at Good Samaritan

Good Samaritan Health Center is seeking a compassionate and dedicated Certified Nursing Assistant (CNA) to join our team. We serve underserved communities, ensuring holistic health and wellness outcomes. In this role, you will support our nursing staff by providing direct... 

Aerotek

Entry Level Welder Job at Aerotek

 ...paid vacation, ten major holidays, and annual reviews for raises. There is an opportunity for career advancement through proficiency levels, and permanent employees can travel internationally. Work Environment You will work in a smaller open-air shop with a very...