As a fellow glorified weekend warrior, I can give you my take as someone who just did what you’re thinking of doing. For reference I’m an 11 hdcp and play 9 holes on Tuesday, practice once a week, and play 18 once a weekend.
I found it to be overwhelmingly beneficial for my swing and game because it turns out the shafts I was using for all my clubs were a terrible fit for me (I typically buy all my clubs used). From everything including length, weight, flex, and shaft characteristics, my fitter and I dialed in a setup that I swing so much better and effortlessly.
In short, it was worth it for me because I am now having a lot more fun on the golf course not fighting the clubs and shooting lower scores.