Data Infrastructure Engineer

Job Title

Data Infrastructure Engineer

Kennesaw, Georgia

Regular

Full-Time

292336

Kennesaw State University is one of the 50 largest public institutions in the country. With growing enrollment and global reach, we continue to expand our institutional influence and prominence beyond the state of Georgia. We offer more than 190 undergraduate, graduate, and doctoral degrees to empower our 47,000 students to become thought leaders, lifelong learners, and informed global citizens. Our entrepreneurial spirit, high-impact research, and Division I athletics draw students from throughout the region and from more than 100 countries across the globe.

Focuses on building and maintaining the data infrastructure including the extraction, loading, and staging of data from various data sources, both on‑premises or in the cloud. Ensures the seamless and secure transfer of data, optimizing for performance, integration and reliability to enable subsequent data transformation and modeling processes for enterprise reporting and analytics.

• Develops, tests, and implements data pipelines to efficiently, securely, and reliably ingest data from various data sources into the enterprise data lake or data warehouse.
• Collaborates with data architects and data source SMEs to understand requirements and design data pipelines accordingly.
• Develops and maintains robust data integrity checks, ensuring data accuracy, timeliness, and consistency.
• Utilizes cloud tools and custom scripts for validation, sets up automated anomaly detection, and collaborates with stakeholders to align quality checks with data requirements.
• Enables integration of data from various data sources, such as databases, cloud services and APIs, to facilitate seamless data flow for enterprise and self‑service reporting and analytics.
• Monitors and optimizes data pipelines, identifies and troubleshoots issues using tools such as Azure Monitor or similar system.
• Implements automated alerts and collaborates with architects to adopt best practices in pipeline design for enhanced performance.
• Maintains compliance with data security policies and regulations in the data infrastructure.
• Implements encryption, manages access controls, conducts security audits, and stays updated with security best practices to safeguard data integrity and privacy.
• Manages the storage structure within the data lake or data warehouse, optimizing resource utilization and ensuring efficient integration with data transformation and modeling processes.
• Supports senior technical staff in project planning and the development of standard operating procedures.
• Contributes to the establishment of best practices, ensuring project alignment with technical standards and organizational goals.
• Creates and regularly updates technical documentation for data pipeline processes.
• Ensures clear, comprehensive, and accessible documentation is available, covering all aspects of pipeline design, operation, and maintenance.

Educational Requirements: High school diploma or equivalent.

Required Experience: Five (5) years of related IT experience.

Preferred Educational

Qualifications:

An undergraduate or advanced degree from an accredited institution of higher education in Computer Science, Information Systems, Business Administration or related field.

Preferred Experience: Experience working with reporting tools such as Power BI, Tableau, etc.; previous work experience in Higher Education.

Commitment to continuous learning and staying updated with the latest trends and best practices in data engineering. Able to handle multiple tasks or projects at one time meeting assigned deadlines.

• Familiarity with data protection and privacy laws and regulations (e.g., FERPA, HIPAA, etc.).

• Knowledge of various file formats used in data storage, like parquet, avro, csv, etc., and their implications on performance and storage.

• Understanding of cloud storage services, and data warehouse architecture patterns (e.g., Medallion Architecture, OBT, Materialized View Pattern, Star‑Schema, etc.).

• Knowledge of data warehousing principles,…