If you have no intention of using dynamically loaded modules (you probably don't if you're tuning your server for every last ounce of performance), you should add -DDYNAMIC_MODULE_LIMIT=0 when building the server. This will save RAM that's allocated only for supporting dynamically loaded modules.