This feature is available on cloud instances, and expected in an upcoming self-hosted release.
While prompting from the Chat tab in the new app builder, you can now restore the app to a previous state. Each time the agent finishes making changes, it presents a summary of the changes and a Restore button. Click this button to return your app to the state it was in when the agent finished those changes.