Senior Data Architect

📍
Location: New York City, NY / Chicago, IL (Remote considered)

🔐
Public Security Clearance: Preferred

We are looking for an experienced Solution Data Architect with strong expertise in Databricks, Python, PySpark, and Scala to design and build scalable enterprise data platforms. This role will focus on architecting modern lakehouse solutions
, developing high-performance Spark data pipelines
, and supporting large-scale analytics initiatives in a cloud environment.

• Design and implement enterprise data architectures using Databricks and Apache Spark
• Develop scalable data pipelines using Python, PySpark, and Scala
• Build and optimize lakehouse architectures using Delta Lake
• Architect batch and real-time data processing frameworks
• Collaborate with engineering and business teams to deliver scalable data solutions
• Ensure best practices for data governance, performance optimization, and security

• 10+ years of experience in Data Engineering / Data Architecture
• Strong hands‑on experience with Databricks and Spark
• Advanced programming skills in Python, PySpark, and Scala
• Experience with cloud platforms (Azure, AWS, or GCP)
• Strong knowledge of ETL/ELT pipelines and large-scale distributed data processing

If you are interested or know someone who would be a great fit, feel free to reach out or share your resume.