I tried different font settings in the font settings and it didn’t improve much (font hinting, anti aliasing, custom DPI settings, different font size)
The font is the default one which is Ubuntu Regular with font size set to 10
Sub pixel order is set properly to RGB Linux Mint xfce
Even when running windows in a virtual machine, the font rendering in it is miles ahead of what I got on my Linux setup!!!
Thanks! But I think I will stick with the open source drivers as LibreOffice now runs much faster! Opening and scrolling through the fonts list used to get the GPU utilization to go all the way to 80 to 100% and it was so slow it took the system to register my keyboard Inputs a few seconds but now the issue disappeared!