We’re making it easier than ever to take your AI project from idea to shipped, all within GitHub. With the new GitHub Models repository integration, you get the building blocks you need to build with AI (e.g., models, prompts, and evaluations) all in your existing workflow.

Here’s what’s new

  • Version and review prompts like code: Store, version, and manage .prompt.yml files as part of your codebase. Use the built-in editor to test prompt variations and collaborate in natural language, then open pull requests for review. This works just like the rest of your code.
  • Lightweight, structured evaluations: Compare model outputs side by side across 40+ models including some from OpenAI, Meta, and DeepSeek. Use your own metrics or bring in an LLM as a judge to evaluate quality, relevance, or anything that matters.
  • Simple setup and free to start: Once you’ve optimized your prompt, use any available model in your code with a single API key. There’s no complex setup, and no extra infrastructure. Model access is free to start within our rate limits, so you can experiment before you commit.
  • Enterprise-ready governance: Everything runs on GitHub and Azure infrastructure, so your data stays secure and is never leveraged for training. Org-level model controls let you choose which models are available to your team. You can manage access by group, giving you flexibility without sacrificing control.

Start building with GitHub Models today

GitHub Models is available now for all GitHub users in public preview. Try it now by enabling it in your repository or organization, or learn more by visiting our documentation.

Help us shape the future

We’re just getting started, and your feedback can help shape what comes next. Join the community discussion to share your ideas and connect with other developers building the future of AI on GitHub.

Disclaimer: The UI for features in public preview is subject to change.