Hi Folks, here I will share my experience about using OpenAI embedding, its necessity and the scenarios where embedding are useful. I was tasked with creating an internal chat-bot for searching and summarizing content from our internal wiki and knowledge base. To achieve this, I initially built a web crawler to gather information from linked … Continue reading OpenAI Embeddings and tiktoken