Its fixed, I replaced the cam plate and also the shift forks with new rollers as the rollers had been welded on. Even on the bench it shifted better. Now I have fourth gear awesome! I was able to leave the gearbox in the bike and just remove the clutch and outer gear box covers. Thanks for the help guys hope it might help someone else.