The issue with the UI hasn't yet been fixed, @Lychee, but it is possible to do this. The trick is to temporarily change the column to be fully editable, configure the save handler, and then change the column settings back to be Editable in new rows only. It won't be visible, but the save handler will persist.
This is obviously unintended and something that we want to fix, so I'll bump the corresponding ticket internally!