At IBM Infrastructure & Technology, we design and operate the systems that keep the world running. From high-resiliency mainframes and hybrid cloud platforms to networking, automation, and site reliability. Our teams ensure the performance, security, and scalability that clients and industries depend on every day. Working in Infrastructure & Technology means tackling complex challenges with curiosity and collaboration.

Company: IBM

Role: AI Back End Engineer

Location: Bangalore, Karnataka, India

Role Focus: • Enable and optimize LLMs for training and inference on IBM Z, GPUs, and AI accelerators • Drive performance improvements (latency, throughput, memory efficiency) for production workloads • Implement LLM optimizations such as KV cache management, efficient attention, and optimized execution strategies • Evaluate and validate LLMs at model-level and ops-level to ensure functional correctness, numerical accuracy, and model quality • Analyze and optimize tensor shapes, strides, and memory layouts to ensure efficient and correct execution across PyTorch and accelerator backends • Build and scale distributed training and inference systems across multi-GPU and multi-node environments • Develop high-performance kernels for compute-intensive workloads • Profile and debug performance using PyTorch Profiler, TensorBoard, and system-level tools