You can connect to Azure storage with durable functions using the managed identity of the Function app instead of embedding secrets in the connection string. The identity is managed by the Azure platform and does not require you to provision or rotate any secrets.
Learn more information about managed identities within Functions here.