Lightning AI Interview Question

How does a gpu work? How are operations carried out in pytorch?