Senior Data Engineer (Azure/Databricks)

Overview
Tech Spot is seeking an experienced Senior Data Engineer to support a leading energy organization headquartered in Baltimore, MD. This role is responsible for designing, building, and optimizing enterprise-scale data platforms and cloud-based data solutions within the Microsoft Azure ecosystem. The ideal candidate will have deep expertise in Azure, Databricks, PySpark, SQL, and modern data warehousing practices, with a proven ability to deliver scalable, reliable, and high-performance data solutions that drive business value.
 
Required Qualifications
Core Technical Experience

• 5+ years of experience with Microsoft Azure Cloud Services
  • Databricks, Azure Data Factory (ADF), Azure Synapse Analytics, Azure SQL Database, Azure DevOps, Key Vault
• 3+ years of hands-on experience with Azure Databricks
• 5+ years of experience developing solutions using PySpark
• 8+ years of experience in data warehousing and data engineering, strong experience building and optimizing data pipelines independently.
• 8+ years of advanced SQL development – creating complex SQL queries from scratch
• Preferred: Experience with Delta Lake (Azure)

Primary Focus:

• Build new data pipelines and onboard new datasets.
• Understand business requirements and identify source tables.
• Develop and deploy data ingestion pipelines.
• Execute data quality validation.
• Move data through Bronze → Silver → Gold layers.
• Optimize pipeline performance and processing efficiency.
• Provide production support after implementation.

What’s the Job?

• Design, develop, and support scalable cloud-based data platforms and pipelines using Azure services and Databricks.
• Build and maintain efficient ETL/ELT processes for structured and unstructured data sources.
• Design and optimize enterprise data warehouses, data lakes, and modern analytics platforms.
• Create high-quality, secure, and maintainable data solutions following engineering best practices.
• Collaborate with stakeholders to translate business requirements into technical solutions and support cloud migration initiatives.

What’s in it for me?

• Opportunity to work on innovative cloud-based data solutions in a dynamic environment.
• Engagement with cutting-edge technologies within the Azure ecosystem.
• Chance to contribute to impactful projects supporting energy operations.
• Flexible remote work arrangement supporting work-life balance.
• Potential for contract extension based on project needs and performance.