We’ve received a lot of questions and inquiries regarding the recent AI executive order enacted by President Biden. Sam summarized his opinions and what they mean here. He recommends you follow the NIST AI Risk Management Framework for now as the agencies complete their reports per the 90, 180, 270, and 365-day deadlines in the order.
In the meantime, I wanted to ask an LLM the questions we received about the order to see the results. Many people who are not in data science or a technical role are wondering what the order means for them or what the proposed limits will be. I previously tested three different LLMs in a question-and-answer format to see which one produced the best results. I used a McKinsey report in that test but wanted to use the executive order this time to show you how you could do it with your documents, policies and procedures.
Here is how it works
One of the fastest time-to-value and least risky generative AI (GenAI) use cases is for knowledge management or a similar employee assistant. This use case helps employees find answers inside of your existing documentation. Instead of providing a list of documents for them to read or pointing them to knowledge articles, you can use GenAI to generate the answer for them. This speeds things up and makes for a better experience.
- I uploaded the Executive Order as a document in Krista.
- Krista reads the document using document understanding.
- I asked Krista questions about the documents.
- Krista generates answers for me and links to the source data.
It’s also secure since an implementation like this is only for your company. Your employees would use your instance of Krista to find information instead of them uploading your documents to a public GenAI interface. You don’t want them doing this. Doing so violates non-disclosure agreements your employees are supposed to be complying with and avoids data leakage.
What it looks like
Here is a video of me asking Krista the following questions about the executive order.
- What limits does the executive order pose on AI developers?
- What do AI developers need to report to the government?
- What does the order say about foreign employees or contractors?
- What are the real blocks or hurdles companies with good intentions now face that weren’t there before the Executive Order?
If you would like to ask your questions about the executive order, just type or paste your questions in Krista to the right.