Senior Backend Engineer

Title:
Senior Backend Engineer AWS Open Search (Vector & Index DB)

Location:
Mississauga, Canada

Client:
News Corp

Rate: 65/hr

Hire Type:
Contract

Job description

Senior Backend Engineer with AWS Open Search Vector Index DB

Experience 8-12 years

Location Mississauga, Canada

Role Summary

• Need a seasoned backend engineer to design implement and operate a semantic search platform on AWS Open Search focusing on vector search index designmanagement and highthroughput APIs The role requires strong backend development skills in TypeScript JavaScript andor Python
• AWS Open Search Detailed Requirements
• Cluster Design Management Expertise in setting up and scaling AWS Open Search clusters for high availability and performance shardreplica strategy cluster sizing and resource optimization
• Vector Search Implementation Handson experience with kNNHNSW algorithms for semantic search and managing vector indices for embeddingsbased retrieval
• Index Database Management Proficiency in creating and maintaining index templates analyzers tokenizers and custom mappings implement ILM policies for rollover and retention
• Query Relevance Tuning Deep knowledge of Open Search Query DSL boosting strategies hybrid search BM25 vector synonym handling and multilingual optimization
• Data Ingestion Pipelines Build scalable ingestion pipelines for structuredunstructured data and embeddings integrate with streamingbatch frameworks Kafka Kinesis
• Security Compliance Configure IAM roles VPC networking encryption atrestintransit and KMS for key management
• Monitoring Observability Implement metrics logs dashboards for cluster health and query performance set up s for anomalies and failures
• Backup Disaster Recovery Manage snapshot policies restore procedures and failover strategies

Key Responsibilities

• Design and implement vector search and index management in AWS Open Search
• Develop and maintain backend APIs and services using TypeScript JavaScript and Python
• Build scalable ingestion pipelines for documents and embeddings
• Ensure performance optimization observability and reliability of search services
• Implement security best practices and compliance measures
• Collaborate with crossfunctional teams and mentor junior engineers

Required Skills

• Strong expertise in AWS Open Search including vector search and index management
• Backend development experience in TypeScript JavaScript and Python
• Knowledge of distributed systems caching strategies and API design
• Experience with CICD pipelines and containerization Docker Kubernetes
• Familiarity with observability tools and performance tuning techniques
• Understanding of security practices and AWS ecosystem services

Skills

Mandatory Skills : Python, AWS Lambda