Hi everyone, I am currently querying data from a databricks table which contains columns with strings that are containing German "Umlauts" (ä,ö,ü etc.), as well as other special characters (ß, Ø). They are displayed correctly in the table view in databricks. However, in Retool the special characters are turned into "��".
I assume it is an encoding issue, but unfortunately, I have not been able to fix it with the suggested solutions from the forum. Any "charset" configurations I am entering in the resource "connection option" are getting an error "HiveSQLException:Configuration charset is not available.".
My last idea would be to replace all characters in databricks with their "normal characters", e.g. "ö" --> "oe", but I would much prefer to display all strings correctly.
Did not find that old thread during my search for some reason. Happy to report that it did work using the provideed formula in the transformer as follows:
"
let length = data.ItemName.length
let decodedArray = []
for (let i = 0; i < length; i++){
let str = data.ItemName[i]
let decoded = decodeURIComponent('%' + str.match(/.{1,2}/g).join('%'))
decodedArray.push(decoded)
}
data.ItemName = decodedArray
return data
"
Tried it with a map function first but that did not work for me. If you do have any suggestions to improve the transformer syntax, feel free to do so, otherwise, this is solved
You are welcome! I'm happy to hear that it worked.
This reminded me of a character from my native tongue that led me to lose a video game account when I was a kid, because I thought using it in my password would make it extra secure (ñ, lesson learned).
Your implementation looks great, thank you for sharing it!
