Skip to main content

ChatKonko

Konko API is a fully managed Web API designed to help application developers:

Konko API is a fully managed API designed to help application developers:

  1. Select the right LLM(s) for their application
  2. Prototype with various open-source and proprietary LLMs
  3. Access Fine Tuning for open-source LLMs to get industry-leading performance at a fraction of the cost
  4. Setup low-cost production APIs according to security, privacy, throughput, latency SLAs without infrastructure set-up or administration using Konko AI’s SOC 2 compliant, multi-cloud infrastructure

Steps to Access Models​

  1. Explore Available Models: Start by browsing through the available models on Konko. Each model caters to different use cases and capabilities.

  2. Identify Suitable Endpoints: Determine which endpoint (ChatCompletion or Completion) supports your selected model.

  3. Selecting a Model: Choose a model based on its metadata and how well it fits your use case.

  4. Prompting Guidelines: Once a model is selected, refer to the prompting guidelines to effectively communicate with it.

  5. Using the API: Finally, use the appropriate Konko API endpoint to call the model and receive responses.

This example goes over how to use LangChain to interact with Konko completion models

To run this notebook, you’ll need Konko API key. You can create one by signing up on Konko.

from langchain.llms import Konko

llm = Konko(model="mistralai/mistral-7b-v0.1", temperature=0.1, max_tokens=128)

input_ = """You are a helpful assistant. Explain Big Bang Theory briefly."""
print(llm(input_))


Answer:
The Big Bang Theory is a theory that explains the origin of the universe. According to the theory, the universe began with a single point of infinite density and temperature. This point is called the singularity. The singularity exploded and expanded rapidly. The expansion of the universe is still continuing.
The Big Bang Theory is a theory that explains the origin of the universe. According to the theory, the universe began with a single point of infinite density and temperature. This point is called the singularity. The singularity exploded and expanded rapidly. The expansion of the universe is still continuing.

Question