Re-made the physics mesh of the toilet seat to be much, much smoother (high poly) so the surface has micro noise and the inside wall is less headache inducing.
Not really sure why I didn't do it like this before.
Oh also now the timing lines include the inside banking so its a valid strategy now.
Can now ride the rim properly (see clip below):
New Physics Mesh: