Data Engineer – Databricks

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions.

This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. Candidate will perform requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products.

• Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment.
• Design scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL processes that transform raw data, flat files, and Excel spreadsheets into SQL databases.
• Understand the concept of data marts and data lakes and experience migrating legacy systems to data marts/lakes.
• Use additional cloud technologies (e.g., Azure SQL Server).
• Maintain comprehensive project documentation.
• Have an aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.
• Strong interpersonal and communication skills to work in a team environment with customers, contractors, end users, and management.
• Manage multiple projects, responsibilities and competing priorities.

• Programming languages, frameworks, and file formats such as:
  Python, SQL, PL/SQL, DBT
• Database platforms such as:
  Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks
• AWS and Azure cloud computing