System Architect - Memory Solutions

Join Penguin Solutions as a System Architect – Memory Solutions. This role focuses on designing and developing a next‑generation optical‑based memory appliance for AI/ML workloads, leveraging silicon photonics, HBM, DDR5 memory, and ultra‑high‑speed interconnects.

As a Senior Member of Technical Staff, you will architect scalable, low‑latency memory systems optimized for large‑scale training and inference. Collaboration across hardware, firmware, and software teams will drive innovation in memory bandwidth, energy efficiency, and compute density.

• Opportunity to shape future AI infrastructure
• Work with world‑class engineers in a fast‑paced, innovation‑driven environment
• Competitive compensation and benefits
• Flexible work arrangements and career development support

• Lead system architecture design for an optical memory appliance, integrating silicon photonics interconnects, HBM/DDR5 memory subsystems, and Tbps‑class communication (PCIe Gen5/6, CXL, custom optical fabrics).
• Define and drive system‑level requirements, performance targets, and integration strategies for AI/ML workloads.
• Collaborate with photonics, packaging, and signal‑integrity teams to optimize physical‑layer design.
• Evaluate trade‑offs in latency, bandwidth, power, and scalability across memory and interconnect technologies.
• Guide hardware/software co‑design for memory management, data movement, and inference acceleration.
• Author architecture specifications, design documents, and technical roadmaps.
• Mentor junior engineers and contribute to technical leadership across the organization.

• Bachelor’s degree in Computer Science, Electrical Engineering, or related field (Master’s preferred).
• 10+ years of experience in system architecture or hardware design for high‑performance computing, memory systems, or networking.
• Deep expertise in data‑center and edge‑server systems, memory hierarchy design, silicon photonics, and high‑speed interconnects.
• Proven track record architecting systems for AI/ML training or inference at scale.
• Strong understanding of HBM, DDR5, CXL, PCIe, and optical signaling technologies.
• Experience with simulation, modeling, and performance analysis tools.
• Excellent communication and cross‑functional collaboration skills.
• Ability to identify key patentable ideas and work with patent attorneys on filing disclosures and patents.

• Familiarity with photonic IC design and packaging.
• Experience with accelerator architectures (GPU, TPU, custom ASICs).
• Knowledge of AI/ML frameworks and memory access patterns.
• Contributions to industry standards or academic publications in relevant domains.

• Remote – Newark, CA or Irvine, CA

• U.S. industry conferences, major customers, or partners: 1‑2 times per month.
• International travel may be required depending on partner/customer engagement levels.

The base pay range for this position is $160,000–$190,000, with potential bonus eligibility. Benefits include medical, dental, vision, 401(k) matching, paid time off, life insurance, and an Employee Assistance Plan.

We are committed to creating an inclusive environment that embraces differences and fosters belonging for all.

Penguin Solutions is an affirmative action/equal opportunity employer and is strongly committed to all policies which will afford equal opportunity employment to all qualified persons without regard to age, national origin, race, ethnicity, creed, gender, disability, veteran status, or any other characteristic protected by law.