Turns out it is mostly useful for making an A.I. search of local documents that you wouldn't want to share remotely. Some people have made some Zork like word games or chatbots for themselves too.
I now only recommend using the latest online LLMs as they continue to grow in both ability, knowledge, and function. Just realize real privacy is not really a thing when you use them.