Data Lake Architect Auburn Hills,MI Job Auburn Hills area,Michigan USA,IT/Tech

Data Lake Architect Auburn Hills, MI - Day 1 Onsite (Need local profiles only)

Duration: Long Term

Experience level: 12+ Years

Job Description:

Minimum of 10 years’ experience in advanced technologies including a minimum of 5+ years as data lake admin/architect

Manage and maintain Data Lake clusters infrastructure on premise and in cloud: installation, configuration, performance tuning and monitoring of Hadoop clusters

BS degree, preferably in Computer science or equivalent

Good communication skills with right attitude to blend in with team

Minimum 5 years work experience in Hadoop ecosystems (Horton HDP or Cloudera’s CDP)

Strong concepts in Unix/Linux, Windows OS, cloud platforms (AWS, GCP), Kubernetes, Open Shift & Docker

Good exposure to Cloudera manager, Cloudera Navigator or similar cluster management tool

Collaborate and assist developers in successful implementation of their code, monitor and fine tune their process for optimum resource utilization on cluster, ability to automate run time process

Good knowledge of HDFS, Ranger/Sentry, Hive, Impala, Spark, HBase, Kudu, Kafka, Kafka Connect, Schema Registry, Ni-Fi, Sqoop and other Hadoop related services

Exposure to Data Science collaborative tools such as data science workbench, CML, anaconda, etc.

Strong Networking concepts: topology, proxy, F5, firewall

Strong security concepts:
Active directory, Kerberos, LDAP, SAML, SSL, data encryption at rest

Programming language concepts:
Java, Perl, Python, PySpark and Unix shell scripting

Experience in cluster management, perform cluster upgrade, migration, and testing

Periodic updates to cluster and keeping the stack current

Ability to expand clusters by adding new nodes and rebalance cluster storage systems

Manage application databases, application integration, users, roles, permissions within cluster

Collaborate with Open Shift, Unix, network, database and security teams on cluster related matters

Monitor cluster for maximum uptime, ability to research on cluster issues via logs and collaborate with support in a proactive way

Technical

Experience:

Solid experience in Cloudera data lake environments both on prem and cloud

Solid experience in administration and set up including security topics related to a data lake

Strong experience architecting and designing solutions for new business needs

Thorough understanding and hands-on experience with implementing robust logging and tracing implementation for end to end systems traceability

Familiarity with Cloudera’s BDR tool to perform and monitor backups of critical data and able to restore data when in need

Willing and ready to get hands on code development with dev team for developing and troubleshooting, doing quick proof of concepts for exploring new solutions, products etc.

Experienced in working with technical teams to discuss, analyze, understand and negotiate business requirements, able to explain to architects about the technical considerations and associated implications on the user journey/experience/requirements.

Experience in tuning and optimizing Hadoop environment in keeping clusters healthy and available for end users and applications with maximum cluster uptime as defined in SLA

Deep knowledge and related experience with Hadoop and its ecosystem components i.e. HDFS, Yarn, Hive, Map Reduce, Pig, Sqoop, Oozie, Kafka, Spark, Presto and other Hadoop components

#J-18808-Ljbffr


Increase/decrease your Search Radius (miles)



Job Posting Language

Data Lake Architect Auburn Hills, MI