I don't recall exactly when but i tried this same app at least a year or two ago. I was super excited but results it gave was kinda underwhelming. But again this was a while back. Hopefully it improved quite a bit because i really like this idea.
Last night we tried ChatGPT to see what we could change the “Welcome {MyFamily} Name” at our AirBnB to say.
ChatGPT 3.5 gave suggestions where most of the options needed letters we didn’t have.
ChatGPT 4 took a very long time and then apologized and said it was trying to loop over the letters but it couldn’t verify if they were real words because it didn’t have a dictionary.
Multiple tries returned the exact same results each time.
I’d hate to do this with Legos and then be missing parts part way through!
Counter intuitively, language models aren't good with letters and string manipulation. It probably has to do with tokens being a few letters and the lack of those tasks in their dataset.
