I will discuss some recent ongoing work with Paul Skoufranis to create a non-microstates bi-free entropy. I will propose a definition of bi-free conjugate variables and bi-free Fisher information, which admit desirable properties such as additivity in the presence of bi-free independence and versions of Cramer-Rao and Stam inequalities. I will also discuss the analogue of the free difference quotient, and some of the quirks present in the bi-free setting.