Do I have to add the upper limit for investments under each section while enabling proof of investments submission?

No, Zoho Payroll displays the investment limit for each section in the Proof of Investments tab.