I will talk about recent work towards a conjecture of Gonek regarding negative shifted moments of the Riemann zeta function. I will explain how to obtain asymptotic formulas when the shift in the Riemann zeta function is big enough, and how we can obtain non-trivial upper bounds for smaller shifts. Joint work with H. Bui.