Back to Skills

genkit-infra-expert

jeremylongshore
Updated Today
28 views
712
74
712
View on GitHub
Otheraiautomation

About

This skill helps developers deploy Genkit AI applications to production using Terraform. It provisions infrastructure like Firebase Functions, Cloud Run services, and GKE clusters, along with monitoring and CI/CD pipelines. Use it when you need to automate the deployment of your Genkit workflows to Google Cloud.

Quick Install

Claude Code

Recommended
Plugin CommandRecommended
/plugin add https://github.com/jeremylongshore/claude-code-plugins-plus
Git CloneAlternative
git clone https://github.com/jeremylongshore/claude-code-plugins-plus.git ~/.claude/skills/genkit-infra-expert

Copy and paste this command in Claude Code to install this skill

Documentation

Prerequisites

Before using this skill, ensure:

  • Google Cloud project with Firebase enabled
  • Terraform 1.0+ installed
  • gcloud and firebase CLI authenticated
  • Genkit application built and containerized
  • API keys for Gemini or other AI models
  • Understanding of Genkit flows and deployment options

Instructions

  1. Choose Deployment Target: Firebase Functions, Cloud Run, or GKE
  2. Configure Terraform Backend: Set up remote state in GCS
  3. Define Variables: Project ID, region, Genkit app configuration
  4. Provision Compute: Deploy functions or containers
  5. Configure Secrets: Store API keys in Secret Manager
  6. Set Up Monitoring: Create dashboards for token usage and latency
  7. Enable Auto-scaling: Configure min/max instances
  8. Validate Deployment: Test Genkit flows via HTTP endpoints

Output

Firebase Functions:

# {baseDir}/terraform/functions.tf
resource "google_cloudfunctions2_function" "genkit_function" {
  name     = "genkit-ai-flow"
  location = var.region

  build_config {
    runtime     = "nodejs20"
    entry_point = "genkitFlow"
  }

  service_config {
    max_instance_count = 100
    available_memory   = "512Mi"
    timeout_seconds    = 300
  }
}

Cloud Run Service:

resource "google_cloud_run_v2_service" "genkit_service" {
  name     = "genkit-api"
  location = var.region

  template {
    scaling {
      min_instance_count = 1
      max_instance_count = 10
    }
    containers {
      image = "gcr.io/${var.project_id}/genkit-app:latest"
      resources {
        limits = {
          cpu = "2"
          memory = "1Gi"
        }
      }
    }
  }
}

Error Handling

Build Failures

  • Error: "Cloud Function build failed"
  • Solution: Check package.json dependencies and Node.js runtime version

Cold Start Latency

  • Warning: "High latency on first request"
  • Solution: Set min_instance_count >= 1 to keep warm instances

Secret Access Denied

  • Error: "Permission denied accessing secret"
  • Solution: Grant secretAccessor role to Cloud Run/Functions service account

Memory Exceeded

  • Error: "Container killed: out of memory"
  • Solution: Increase available_memory or optimize Genkit flow memory usage

Resources

GitHub Repository

jeremylongshore/claude-code-plugins-plus
Path: plugins/devops/jeremy-genkit-terraform/skills/genkit-infra-expert
aiautomationclaude-codedevopsmarketplacemcp

Related Skills

sglang

Meta

SGLang is a high-performance LLM serving framework that specializes in fast, structured generation for JSON, regex, and agentic workflows using its RadixAttention prefix caching. It delivers significantly faster inference, especially for tasks with repeated prefixes, making it ideal for complex, structured outputs and multi-turn conversations. Choose SGLang over alternatives like vLLM when you need constrained decoding or are building applications with extensive prefix sharing.

View skill

evaluating-llms-harness

Testing

This Claude Skill runs the lm-evaluation-harness to benchmark LLMs across 60+ standardized academic tasks like MMLU and GSM8K. It's designed for developers to compare model quality, track training progress, or report academic results. The tool supports various backends including HuggingFace and vLLM models.

View skill

llamaguard

Other

LlamaGuard is Meta's 7-8B parameter model for moderating LLM inputs and outputs across six safety categories like violence and hate speech. It offers 94-95% accuracy and can be deployed using vLLM, Hugging Face, or Amazon SageMaker. Use this skill to easily integrate content filtering and safety guardrails into your AI applications.

View skill

langchain

Meta

LangChain is a framework for building LLM applications using agents, chains, and RAG pipelines. It supports multiple LLM providers, offers 500+ integrations, and includes features like tool calling and memory management. Use it for rapid prototyping and deploying production systems like chatbots, autonomous agents, and question-answering services.

View skill