Big Data Developer Sr

Job Duties And Responsibilities

• Build processes that support data transformation, data structures, metadata, dependency and workload management.
• Build and implement data ingestion and curation processes using Big Data tools such as Spark (Scala/Python), Hive, HDFS, Sqoop, HBase, Kerberos, Sentry, and Impala.
• Handle ingestion of huge volumes of data from various platforms for analytics needs and write high‑performance, reliable and maintainable ETL code; strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
• Write shell scripts, complex SQL queries, Hadoop commands, and use Git.
• Create databases, schemas, and Hive tables (external and managed) with various file formats (ORC, Parquet, Avro, and text).
• Monitor performance of production jobs and advise any necessary infrastructure changes.
• Maintain code versioning using Bitbucket and CI/CD pipelines.

Bachelor’s degree in Computer Science, IT, Engineering, or related field with at least 60 months of experience.

Send resume to  including the JOB .

Travel and relocation to various unanticipated client locations throughout the United States may be required.

Equal Opportunity Employer.