The circuit only works when everyone is doing the same speed, and hanging on the stall horn is not somewhere you want to be.
I would probably break away from the runway and re-join at the same level at the beginning of that leg, e.g. turn away midfield and re-join at the start of downwind.
A Cirrus-owning acquaintance flies his downwinds at twice the normal distance from the runway so he can overtake most of the traffic and essentially join on base.
An American instructor told me to join direct on base when the pattern is busy, as you spend less time around other aircraft (this was late morning at the weekend at Crystal River). This also works in the UK, but the pocket dictator behind the A/G radio gets upset