Clayton's Restaurant opened around 1957 at 2900 South Texas Avenue, and from copies seem to be a family restaurant not particularly specializing in anything based on this 1960s ad copy.
In the early 1970s, Clayton's closed and Captain's Table opened in April 1973 in its place, which was a more upscale restaurant with steak and seafood options (among others), including a full bar on the premises. Captain's Table featured a hexagon-shaped road sign that would survive for many years.
In mid-1977 Captain's Table abruptly closed, from still scheduling events in its banquet rooms in April 1977 to a "complete liquidation" of the property by June of 1977. In November 1977, it reopened as First Federal Savings & Loan Association of Bryan, setting a precedent for banks in the building from then to the modern day. First Federal Savings & Loan Association survived the S&L crisis and by 1995 was called First Federal Savings Bank. In 2002 it was acquired by State Bank of La Grange and rebranded by 2003, which in turn was acquired and rebranded as Prosperity Bank in 2006 with other branches in the area.
If I recall, when I first started driving in the area around late 2010 (going to Blinn, of course), Prosperity Bank had recently closed its location here in favor of a nearby location, and The First Bank & Trust began renovations on it, altering and modernizing the facade (mostly adding a new overhang) and getting rid of the distinctive hexagon-shaped sign in favor of a traditional rectangle one. Like the previous bank and its successor companies, The Bank & Trust was acquired by another bank, this time First Financial Bank, causing it to be rebranded to the First Financial Bank name.
UPDATE 03-30-2025: Filled in history of how First Federal Savings & Loan Association became Prosperity.