AI Research Engineer (Pre-training - LLM & Multi-Modal)

About the job

As a member of the AI model team, you will drive innovation in architecture development for cutting‑edge models of various scales, including small, large, and multi‑modal systems. Your work will enhance intelligence, improve efficiency, and introduce new capabilities to advance the field.

You will have a deep expertise in Large Language Model (LLM) and Multi‑Modal architectures, a strong grasp of pre‑training optimization, and a hands‑on, research‑driven approach. Your mission is to explore and implement novel techniques and algorithms that lead to groundbreaking advancements: multi‑modal data curation and alignment, strengthening baselines, and identifying and resolving existing pre‑training bottlenecks to push the limits of cross‑modal AI performance.

Responsibilities

• Large‑Scale Pre‑Training: Conduct foundational pre‑training for LLMs and Multi‑Modal models on large, distributed servers equipped with thousands of ...