That is precisely because the session does and will expire. This refresh is usually handle by the identity widget—but only when the page is active.
There a numerous posts regarding identity and token refresh such as