Our general bulk evaluator to compare AI generated copilot answers against a collection of golden Answers.

A feminist AI bot for thoughtful, source-aware answers focused on the Indian subcontinent, grounded in intersectional perspectives and multilingual context.

Which AI model actually works best for your needs? Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other. Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing. To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit. More tips in the Details below.

this is my packing bot that read the picture and uploads data to firebase

the list update the arguments section in the function tool call and push to FIREBASE RTDB via function tool calling based on the packing data provided

Use this function to Log and return variables from any Gooey.AI workflow.

This run is useful if you are only interested in Regression testing, Monitoring and Evaluation, Observability and Bugs.

This recipe is used with https://gooey.ai/bulk to evaluate the latest private & open source speech recognition models (from Google, Meta, OpenAI and others). It takes a CSV file of golden (aka human provided) translations and compares those against a set of AI created translations to generate scores from 0 to 1. It then takes the mean of the scores to determine which model performed best.

Compare Swahili Speech Recognition and Translation to English with this run. We have 10 variations in this. Including the latest Seamless M4T v2, MMS, Azure, Whisper v3 and more.

Transcribe any YouTube, mp3, WhatsApp audio or wavs with the best of transcription and translation AI models from OpenAI (Whisper v2 & v3), Microsoft Azure, Google USM, Meta Seemless4MT, AI4Bharat, Bhashini, etc Optionally translate to any language too.

Transcribe any YouTube, mp3, WhatsApp audio or wavs with the best of transcription and translation AI models from OpenAI (Whisper v2 & v3), Microsoft Azure, Google USM, Meta Seemless4MT, AI4Bharat, Bhashini, etc Optionally translate to any language too.

This example collects all the parameters (the user's query, the bot's answer, WhatsApp number number, etc) from the copilot workflow and sends it to an arbitrary endpoint. Alter this example with the REST API of your own server to log every interaction.

Here we take an input sample of Kikuyu phrases (and their expert transcription and English translations) and compare the top Speech Reco and Translation models. As of Sep 23, 2024, we've found that Meta's MMS-Large works best for Kikuyu with Ghana NLP's Kikuyu to English translation services.

. Which AI model actually works best for your needs?
Upload your own data and evaluate any Gooey.AI workflow, LLM or AI model against any other.
Great for large data sets, AI model evaluation, task automation, parallel processing and automated testing.
To get started, paste in a Gooey.AI workflow, upload a CSV of your test data (with header names!), check the mapping of headers to workflow inputs and tap Submit.
More tips in the Details below.

Transcribe mp3, WhatsApp audio + wavs with OpenAI's Whisper or AI4Bharat / Bhashini ASR models. Optionally translate to any language too.

Transcribe mp3, WhatsApp audio + wavs with OpenAI's Whisper or AI4Bharat / Bhashini ASR models. Optionally translate to any language too.