Skip to main content

Using Groq With PostQode

Groq provides ultra-fast inference for various AI models through their high-performance infrastructure. PostQode supports accessing models through the Groq API.

Website: https://groq.com/

Getting an API Key

To use Groq with PostQode, you'll need an API key from the GroqCloud Console. After signing up or logging in, navigate to the API Keys section of your dashboard to create and copy your key.

Supported Models

PostQode supports the following models through Groq's high-speed LPU inference:

Model IDProviderContext WindowNotes
moonshotai/kimi-k2-instructMoonshot AI128K tokensKimi K2 high-efficiency instruct model
llama-3.3-70b-versatileMeta128K tokensFlagship open-weights model on LPU
deepseek-r1-distill-llama-70bDeepSeek128K tokensReasoning distilled model
llama-3.1-8b-instantMeta128K tokensUltra-low latency code generation
mixtral-8x7b-32768Mistral AI32K tokensFast mixture-of-experts model
note

Model availability may change dynamically. Refer to the Groq Model Documentation for the latest available endpoints.

Configuration in PostQode

  1. Open PostQode Settings: Click the gear icon () in the PostQode panel.
  2. Select Provider: Choose "Groq" from the API Provider dropdown.
  3. Enter API Key: Paste your Groq API key (gsk_...) into the API Key field.
  4. Select Model: Choose your desired model from the dropdown (e.g. llama-3.3-70b-versatile or moonshotai/kimi-k2-instruct).

Tips and Notes

  • Ultra-Fast LPU Inference: Groq's custom Language Processing Units provide hundreds of tokens per second, making it exceptional for fast iterative coding and subagent execution.
  • Token Limits: PostQode automatically optimizes max output tokens for models like Kimi K2 and Llama 3.3.
  • Cost Efficiency: Groq offers competitive pricing per million tokens.

Model-Specific Features

Kimi K2 Model

The moonshotai/kimi-k2-instruct model includes optimized configuration:

  • Max Tokens Limit: Automatically configured with appropriate limits for optimal performance
  • Context Understanding: Excellent for complex reasoning and long-context tasks
  • Multilingual Support: Strong performance across multiple languages

Tips and Notes

  • Ultra-Fast Inference: Groq's hardware acceleration provides exceptionally fast response times
  • Cost-Effective: Competitive pricing for high-performance inference
  • Rate Limits: Be aware of API rate limits based on your Groq plan
  • Model Selection: Choose models based on your specific use case:
    • Kimi K2: Best for complex reasoning and multilingual tasks
    • Llama 3.3 70B: Excellent general-purpose performance
    • Llama 3.1 8B Instant: Fastest responses for simple tasks
    • Mixtral: Good balance of performance and efficiency

Troubleshooting

  • "Invalid API Key": Verify your API key is correct and active in the Groq Console
  • "Model Not Available": Check if the selected model is available in your region
  • Rate Limit Errors: Monitor your usage in the Groq Console and consider upgrading your plan
  • Connection Issues: Ensure you have a stable internet connection and Groq services are operational

Pricing

Groq offers competitive pricing based on input and output tokens. Visit the Groq pricing page for current rates and plan options.