Is a residence permit sufficient for verification?

No. For a positive verification, an ID card or passport is strictly required.

A residence permit primarily serves to document your legal stay in a specific country. It confirms that you are entitled to stay in Switzerland, but it does not necessarily verify your identity to the same extent as an ID card or passport.