Big Data; Python​/Scala Engineer -Assistant Vice President

Position: Big Data (Python/Scala) Engineer -Assistant Vice President
For additional information, please review .As a bank with a brain and a soul, Citi creates economic value that is systemically responsible and in our clients’ best interests. As a financial institution that touches every region of the world and every sector that shapes your daily life, our Enterprise Operations & Technology teams are charged with a mission that rivals any large tech company.

Our technology solutions are the foundations of everything we do from keeping the bank safe, managing global resources, and providing the technical tools our workers need to be successful to designing our digital architecture and ensuring our platforms provide a first-class customer experience. We reimagine client and partner experiences to deliver excellence through secure, reliable, and efficient services.
** Responsibilities:
** Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas

Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement Has the ability to operate with a limited level of direct supervision.
*
* Qualifications:

** 5-8 years of relevant experience In-depth understanding of HDFS architecture, data storage, and fault tolerance mechanisms.

Experience with HDFS commands and administration. Fundamental understanding of Map Reduce programming paradigm, even if primary development is in Spark/Flink. Knowledge of Zookeeper for distributed coordination services.

Strong proficiency in . Expert-level programming skills in  

Experience with Spark performance optimization techniques (e.g., caching, partitioning, shuffle optimizations, memory management). Familiarity with deploying Spark applications on YARN, Mesos, or Kubernetes.

Advanced proficiency in writing complex HiveQL queries for data analysis and ETL processes. Understanding of Hive metastore, execution engines (Map Reduce, Tez, Spark), and storage formats (ORC, Parquet, Avro). Experience in optimizing Hive queries and table designs for performance.

Strong object-oriented and functional programming skills.

Experience with Scala build tools (SBT, Maven). Knowledge of common Scala libraries and frameworks.

Experience with PySpark for data processing. Familiarity with data manipulation libraries (Pandas, Num Py). Scripting for automation and data orchestration.

Complex query writing, subqueries, window functions, and performance tuning. HBase (for real-time access to large datasets within Hadoop). Cassandra, Mongo

DB, or similar. Familiarity with RDBMS concepts and SQL for data integration.

Experience with AWS (EMR, S3, Glue, Lambda), Azure (HDInsight, Data Lake, Databricks), or Google Cloud Platform (Dataproc, Big Query).CI/CD:

Experience with Jenkins, Git Lab CI, Azure Dev Ops, or similar tools.

Agile Development:
Familiarity with Agile/Scrum methodologies.

Shell Scripting:
For automation and system administration tasks.
*
* Education:

** Bachelor’s degree/University degree or equivalent experience
#J-18808-Ljbffr