Yep, if you know your ports, you’ve gone the vast majority of the way there. Everything else that can do additional low level inspection is gravy after that, from a home perspective.
If you’re a business, then by all means jump into the rabbit hole abyss of even more deep packet inspection firewalls and appliances, lol. 