In the Middle Ages the Rysensteen Estate belonged to the bishop of Ribe and was called "Castrum Bøfflingae" (Bøvling Castle), but after the Reformation in 1536 all church property was overtaken by the Crown. Bøvling Castle became an entailed estate. When the feudal overlord Jokum Bech took over the estate in1635, it was in such a bad condition that the king gave him permission to rebuild the manor completely. A fourwinged building in halftimber was erected on the site where the present manor is standing - it was painted red and had a red tiled roof. The former castle was located closer to the present farmbuildings. As the new manor was now sitting on top of a small hill, it was less endangered by the floods that devastated the lowlands on the west coast regularly.
During the "Torstenson" war the Swedes occupied the castle and remained there for quite a while. When they finally left, the buildings were a sorry sight, so Mogens Sehested, the feudal overlord, who took over in 1646, restored and improved the manor to its present appearance.
With the arrival of absolute monarchy the estates fate changed once more. It was now valued at 2.500 tønder "hartkorn", so when King Frederik 3, who was a powerful monarch with no money, was faced with a bill from Henrik Ruse (pronounced Ryse), a Dutch constructor who lead the modernization of the fortifications of Copenhagen . He gave the Dutchman the estate in payment. Henrik Ruse was thus the first private owner of Bøvling Castle.
He changed the castles name to "Rysensteen". In 1671 Ruse was raised to the peerage and in 1672 Rysensteen was made a barony - Ruse had bought more land and the estate was valued at 3.5oo tønder "hartkorn" and the same year Baron Ruse was made a knight of a very honourable Danish order. Ryse became the progenitor of the noble family Juel-Rysensteen who owned the estate until about 1800. Upon the death of the last Juel-Rysensteen, the castle was at an auction sold to a couple of "estate slaugtherers" who devided the estate up into many smaller units that were sold off, and hereby Rysensteens glorius era was brought to an end.
In 1917 the Rahbek family bought Rysensteen, (It had shrunk to a mere 140 hectares) and remained in the family for three generations. Anders Rahbek who took over from his father Christen, stood for a thorough restoration of the mansion with the assistance of an architect from Lemvig. A new roof was put on, new chimneys built, new windows put in and new rooms on the top floor with garrets on the main house, while the remains of the south wing, except the outer wall, were pulled down. All in all this cost d.kr.35.000,-. In 1965 Erik Rahbek took over from his father and it was in his time - the late 70.ies that farm produktion changed from mainly dairy farming to intensive pig-breeding.
On December 1.st 1993 the Schliemann family bought Rysensteen. The pig-produktion was up-dated and intensified to a modern pig-plant with an annual production of 20.000 pigs for slaughter. Further farmland was purchased so that the estate now comprises 320 hectares of agricultural land + 60 hectares in tenancy (leased land). The restoration of the manor itself, which is listed grade 1, started in the spring of 1994 - the family moved in in August 1994 but there is still more work to be done. In 1999 a permission to rebuild the south wing was granted by the preservation authorities . After some archaeological excavations had taken place, the rebuilding started, and the south wing was finished in December 2000 with four seperate apartments for the use of a new started bed & breakfast business.