Towards the end of the 2001-02 season the club had acquired the services of New Zealander Mike O’Donovan who held the post of joint first team coach with Andy Henderson. Their efforts were widely appreciated to the extent that Henderson was lured away to be head coach at Melrose in the summer of 2003. By this time future internationalist Rob Dewey had moved from Madras and he proved to be a real asset before he moved on to Heriots and then the professional ranks.

However the club had to dispense with the services of O’Donovan eventually through financial constraints and there followed a rapid downward spiral in playing fortunes. Relegation to the third tier inevitably ensued and there were four seasons at that level.

In the early 1990s Kirkcaldy became one of the first clubs in Scotland to create a women’s side and it continues to flourish. Several players have won international honours and a number of cups have adorned the trophy cabinet. Two matches in the 1994 Women's Rugby World Cup plate competition were also played at Beveridge Park and through its promotion of the women’s game has become a hub for girls’ rugby in Fife.

From the middle 1990s intake from the youth section declined with numbers falling. The 4th XV had gone and the thirds had an intermittent existence. Although the club appointed a full time development officer in the form of the aforementioned Quintan Sanft, support from local secondary schools was negligible and this was reflected in the youth teams.

Nevertheless, a good senior squad was assembled and after a close fight with Gala and Peebles in 2007-08 just missed out on both a second division return and a second National Shield at Murrayfield. This was only delayed for a year with the third division championship again won in 2009.

A positive first season in the second division preceded relegation the following year, despite a late rally. At the same time the seconds dropped out of the national reserve league set-up and now find themselves in a Midlands division where the opposition is more congenial.