Each license which is suspended, or revoked, or has expired shall promptly be surrendered by the licensee to his immediate superior. Upon termination of the services of a licensed inspector, the licensee shall promptly surrender his license to his immediate superior.