OCC Interagency Guidance on Third-Party Risk Management Amidst government inefficiencies, it’s worth commending US banking regulators for their ongoing efforts to simplify and consolidate guidance and regulations related to third-party risk management. Earlier this year (June 2023) The Office of the Comptroller of the Currency (OCC) issued its final Interagency Guidance on Third-Party Relationships: Risk Management. …
Different LLMs have varying strengths and weaknesses. Understanding the strengths and weaknesses of different language models is crucial, as it allows you to select the most efficient tool for your specific needs. When you evaluate and test various LLMs, you are essentially comparing their ability to answer different types of questions, their performance, and their …
The Prompt Engineer Do you need a prompt engineer? Can you train your people to generate prompts? Can this be automated? Well, it depends. LLMs, like BARD, OpenAI GPT-3.5 and 4, Llama, or Flan, require a diligent and persistent approach to testing and refining prompts. Their variable performance for different use cases reveals the critical …
What is an LLM? To establish a baseline, we need to understand that generative AI is a broad field within artificial intelligence, primarily related to natural language and text construction. Large Language Models (LLMs) are a specific subset of generative AI, designed for task completions such as completing a sentence like “Humpty Dumpty sat on …
In this episode of The Union podcast, Chris and I review McKinsey &Co.’s “The state of AI in 2023: Generative AI’s breakout year,” exploring its impact on various industries and job functions and how it’s shaping the future of work. How High Performers Achieve Results with Generative AI McKinsey’s report summarizes 1684 survey responses and …
Companies evaluating AI want the most accurate machine learning models (ML) to predict or summarize business outcomes. However, many times achieving high levels of accuracy and confidence inflates expenses and erodes value versus adding to it. In this episode, Luther and I discuss what is and what is not AI, evaluating ML model accuracy against …
Moving from storyteller to journalist with Large Language Models (LLMs) What is an LLM? Generative AI is the area of artificial intelligence research devoted to all forms of natural language content generation. An LLM, or Large Language Model, is a Generative AI model trained on vast amounts of text specifically to produce text completions. That …
A global CPA firm is redefining audit processes by integrating AI-powered automation with Krista’s Audit Assistant Solution. Discover how the firm improves efficiency, precision, and transparency in auditing, resulting in increased revenue, customer satisfaction and enhanced risk management.
A North American eCommerce store transformed its operations by leveraging AI-driven automation. Read how Krista decreased operational costs, reduced resolution times, and boosts customer satisfaction.
Embracing Predictive Analytics in Decision-Making In this episode of The Union Chris and I discuss predictive analytics and how to use it to help you make better decisions. We explored how advanced analytics can help business process owners and IT professionals boost their decision-making prowess. The most important topic in this episode is using machine …
Read our comprehensive LLM testing guide
See how several LLMs fared in our test and steps to run your own tests for each of your use cases.
