Public Sector Urged to Conduct Extensive Due Diligence Before Deploying AI Foundation Models