Machine Learning Engineer at Red Hat
Location
toronto, on
Job Type
Full-time
Category
Engineering
Posted
June 06, 2026
Drive innovations in AI with Red Hat as a Machine Learning Engineer focusing on open-source LLMs. Contribute to cutting-edge projects that enhance AI for enterprise applications.
As a key member of the AI Inference team, you will design and develop inference optimisation algorithms in projects like LLM-compressor and vLLM. Your role includes implementing model compression pipelines and maintaining decoding frameworks to boost inference speed. Work collaboratively with research scientists to transform ideas into robust systems while profiling LLM performance.
Key Responsibilities:
• Contribute to optimisation algorithms for AI projects
• Design and implement model compression techniques
• Develop frameworks to enhance inference accuracy
• Collaborate on translating research into production systems
• Benchmark LLM performance and optimise for hardware
Requirements:
• Strong knowledge of ML and deep learning fundamentals
• Experience with PyTorch and NumPy
As a key member of the AI Inference team, you will design and develop inference optimisation algorithms in projects like LLM-compressor and vLLM. Your role includes implementing model compression pipelines and maintaining decoding frameworks to boost inference speed. Work collaboratively with research scientists to transform ideas into robust systems while profiling LLM performance.
Key Responsibilities:
• Contribute to optimisation algorithms for AI projects
• Design and implement model compression techniques
• Develop frameworks to enhance inference accuracy
• Collaborate on translating research into production systems
• Benchmark LLM performance and optimise for hardware
Requirements:
• Strong knowledge of ML and deep learning fundamentals
• Experience with PyTorch and NumPy