We're excited to unveil Prompt Evaluation, our latest feature designed to make building and improving LLM prompts significantly easier. Evaluations act as tests that can be run on your prompts to ensure you are avoiding regressions and are making forward progress. 

Highlights:
- Improve Prompts with Confidence: Critically assess and improve your prompts to ensure optimal LLM output. 
- Ensure Quality: Confirm your prompts lead to the desired content quality and relevance.

Why It's a Big Deal:
- Better Prompts, Better Output: Directly influence the quality of LLM-generated content by crafting superior prompts over time.
- Save Time: Efficiently iterate on prompt design to achieve better results faster. Run your test suite quickly, at scale. 
- Precision Control: Customize evaluation criteria to match your exact project requirements. 

We're Listening
Your feedback is vital for us. Please share how the Evaluation feature is shaping your prompt-design process in the #product-feedback channel in our Slack.

Review the Documentation

Walkthrough Loom 1 
Walkthrough Loom 2 

We have enabled the latest version of GPT-4 Turbo (0125 / Jan 25th) in all workspaces. This new build features improved reasoning, less "laziness" and a more recent knowledge cut off. We recommend testing your prompts before switching models. You can set the LLM step in your workflow to either the latest available version of GPT-4 Turbo, or a specific version.

Note : In early testing, this build is still not surpassing GPT-4 32k in extremely complex or longer-form tasks but is the best choice in the majority of complex use cases.  

We’ve just added Markdown support to app inputs within AirOps Studio. The short_text and long_text input fields now support the following:

• pasting RTF (Rich Text Format) content
• pasting Markdown content
• writing with Markdown syntax

We’re always looking for your feedback to improve our features, so please reach out to team@airops.com if you want to share any feedback!

We're excited to share three new GPT-4V(ision) templates!

GPT-4V(ision) can power many incredible new use cases, and we're excited to support you as you build with these new templates. You can access all GPT-4V(ision) templates under the 'Image' section in the templates dashboard.

Add Alt Tags To Your Website's Images

Add or refresh the alt text of your website's images through the HTML image tags. Additionally, you can push the new alt-tags on your pages directly if you use a CMS like Webflow. This template is a great addition to your SEO arsenal.

Image Classification

With this template, you can quickly and accurately classify an image, or identify objects in an image. To learn more about how you can get started with this template, please check this detailed tutorial.

Data Extraction and Entry

This template extracts data from an image and writes the results to Google Sheets. In this tutorial, our team member Cindy shows you how to extract details from an invoice and feed it to a Google Sheet.

👉 You can access all these GPT-4V(ision) templates under the 'Image' section in the templates dashboard.

We're excited to announce a new LLM Model Provider integration that will allow you to connect your Azure account to your AirOps workflows.

You can set up the new integration quickly: Go to Settings, and then API Providers to select Azure. Next, provide your Azure key and the name of your Azure deployment to complete the process. You can then use Azure in your workflow ☑️

To use Azure, create a new LLM step, and select Azure on the ‘Select AI Model’ dropdown.

Check out this quick video tutorial by our team member Rodrigo on how you can use the new Azure integration: 

We’re excited to announce a new integration with Contentful 🪄

If you use Contentful as your CMS, you will now be able to add it as an integration on your AirOps workspace. To set up this integration, first go to your Account Settings, then Integrations, and select 'Contentful' from the list to update your credentials.

When building an AirOps workflow, you’ll then be able to select Contentful in the Integration step. Then you can select one of the Action options for your Contentful entries.

Here’s a quick tutorial from our team member Nicolas to show you how to get the credentials from Contentful and get started with using the integration:

We have some good news for our enterprise users! AirOps now supports Single Sign-On (SSO) with Okta.

To enable it, go to your Account Settings, and then to Single Sign-On, and select the Okta integration to update your credentials. You’ll then have Sign in with Okta as an option at login.

Here’s a quick video from our team member Martin on how to enable SSO for your account:

If you have any questions, or if you wish to upgrade to an enterprise account, please contact us at team@airops.com.

Go to your Account Settings and then “Tags” to create and organise all your tags!

Here’s a quick demo from our team member Victoria to help you get started:

Do you find it challenging to write prompts that generate the results you want? Now, you can use AirOps's new Prompt Helper AI to optimize and improve the quality of your prompts directly inside an LLM step in the AirOps Studio.

Trained with the latest research and best practices in prompt engineering techniques, our Prompt Helper AI can help you get to great outcomes faster in just one click.

Watch the Prompt Helper AI in action in this video by our CEO Alex!

If you need help writing prompts when working with LLMs, just click on “Generate with AI” inside the LLM step, specify the type of task you want the prompt for, and write a basic version of your prompt. You can also choose the type of output you want— Plain text, Markdown, HTML, JSON, or YAML.

AirOps will not only generate a comprehensive System prompt but also a set of User-Assistant pairs to tailor the LLM’s output each time. You can edit the System prompt or the User Assistant pairs if needed, or add more User-Assistant pairs. If you want to learn more about User-Assistant pairs, we have a great video for you here.

We’re excited to hear your feedback and hope to see you supercharge your time to production-quality LLM outputs!

We heard you loud and clear— AirOps has a new Google Sheets integration ☑️

This integration will allow you to push the results of your workflow steps directly to your Google Sheet: no more copy + pasting the results to push your data to Google Sheets!

The new Google Sheets integration requires results in JSON format, which will accurately push the results to the columns on your sheet. And if you’ve never worked with JSON before, just include in your System prompt instructions for the LLM to return its answer in a JSON format- it’s that simple to set it up!

If you want a tutorial on how you can use the new integration, please watch this helpful demo by our team member Nico.

Happy building 🪄