Frankly I’m concerned about the idea that government devices would have any chat app that isn’t end-to-end encrypted and verifiably so, or alternatively built by the Australian Government itself.

Though it is worth noting the source of this recommendation is a parliamentary committee. Basically, politicians making political decisions. It may or may not be based in any actual concrete evidence.