- Byte-sized Intelligence
- Posts
- Byte Sized Intelligence May 15
Byte Sized Intelligence May 15
OpenAI's course correction, how to judge an AI model
AI in Action
Open AI reaffirms its mission-driven path
OpenAI has announced a significant shift in its organizational structure, choosing to maintain its nonprofit governance while converting its for-profit subsidiary into a Public Benefit Corporation (PBC). This move aims to balance the company’s mission driven goals with the need for substantial funding, ensuring that the development and deployment of AI technologies align with the broader goal of benefiting society as a whole.
The PBC model allows OpenAI to raise capital and build products like ChatGPT, with an added expectation to consider social good alongside shareholder returns. While enforcement of this obligation is limited in practice, the structure creates space—and some accountability—for balancing profit with purpose.
OpenAI’s decision could potentially influence the broader AI industry. Competitors like Anthropic and xAI have adopted similar PBC models, reflecting a growing trend toward balancing profit motives with ethical considerations. This shift may encourage other AI companies to reevaluate their governance structures, potentially leading to more mission-aligned approaches across the sector.
However, the hybrid structure of combining nonprofit oversight with a for-profit arm has attracted regulatory attention. State attorneys general in California and Delaware are expected to scrutinize OpenAI’s adherence to its public benefit commitments, highlighting the importance of transparency and accountability in this evolving landscape.
For everyday users, this recommitment suggests that AI tools won’t be shaped solely by market demand. With the nonprofit parent retaining control, decisions will still be anchored to OpenAI’s founding mission: to ensure that artificial general intelligence benefits all of humanity.
Bits of Brilliance
How we measure AI performance
When an AI model gives you a result, whether it’s recommending a stock, flagging a risk, or answering a question that result is called a prediction. It’s making its best guess based on patterns it learned during training. The model takes your input, runs it through everything it’s seen before, and predicts the most likely response. But how do we know if those predictions are good?
That’s where performance metrics come in. Here are four core ones, explained in everyday terms:
Accuracy: Overall correctness. Think of this like a test score, if an AI model answers 90 out of 100 questions correctly, its accuracy is 90%. Helpful, but can be misleading if the questions or data are uneven.
Precision: How careful the model is with its”yes”. Imagine a spam filter that flags 10 emails as spam, but 3 are actually legit, that’s 70% precision. High precision = fewer false answers.
Recall: How thorough the model is at finding the right stuff. If there were 20 spam emails total, and the model only found 15. That’s 75% recall. High recall = fewer misses.
F1 Score: balance between being careful and being thorough. This is your go-to score. It’s the balance between precision and recall, like giving the model credit not just for being right, but also for not missing anything important.
🔍 Comparative Performance Metrics of Leading AI Models
Model | Accuracy | Precision | Recall | F1 Score |
GPT-4 | 77% | 76.56% | 87.50% | 81.67% |
Claude 3.5 Sonnet | 72% | 85.71% | 82.14% | 81.6% |
GPT-4o | 65% | 86.21% | 82.14% | 81.6% |
Claude 3.5 Haiku | 70% | 85.0% | 66.0% | 75.0% |
LLaMA 3.1 405B | 74% | 83.0% | 73.0% | 77.97% |
Gemini 1.5 Pro | 74% | 89.0% | 70.0% | 78.0% |
Note: The above metrics are based on specific benchmark tasks and may vary across different evaluations.
Try This
Let AI plan dinner for you
AI isn’t just for emails and coding, it can be surprisingly creative in the kitchen. This prompt helps you test how well your assistant can adapt to your needs and preferences while adding a bit of fun to your weeknight routine.
Prompt to try:
“Plan a three-course dinner for 4 people, for a cozy cabin night. Make it vegetarian, seasonal for spring, and keep total preparation under 60 minutes. I’m an intermediate cook. Generate a menu, recipe, preparation steps, and grocery list with estimated cost from wholefood in CAD”
🌱 Spring Vegetarian Dinner Menu (Serves 4)
Starter: Asparagus & Pea Crostini with Lemon Ricotta
Main Course: Pasta Primavera with Seasonal Vegetables
Dessert: Strawberry & Rhubarb Crumble with Vanilla Yogurt
🛒 Grocery List & Estimated Whole Foods Prices (CAD)
Produce:
1 bunch asparagus – $4.99
1 cup fresh or frozen peas – $2.99
1 lemon – $0.99
1 pint strawberries – $5.99
2 stalks rhubarb – $3.49
1 zucchini – $1.99
1 yellow squash – $1.99
1 red bell pepper – $2.49
1 small red onion – $1.29
1 bunch fresh basil – $2.99
Dairy:
1 cup ricotta cheese – $4.99
1 cup plain Greek yogurt – $2.49
Parmesan cheese (for garnish) – $4.99
Pantry:
1 baguette – $3.49
8 oz pasta (e.g., penne or fusilli) – $2.99
1/2 cup rolled oats – $0.99
1/4 cup brown sugar – $0.99
Olive oil – $0.50 (portion cost)
Salt & pepper – $0.10
Estimated Total: $50.76
🍽️ Recipes & Preparation Steps
Starter: Asparagus & Pea Crostini with Lemon Ricotta
Ingredients:
1 bunch asparagus
1 cup peas
1 lemon (zest and juice)
1 cup ricotta cheese
1 baguette
Olive oil, salt, and pepper
Preparation:
Preheat oven to 375°F (190°C).
Slice baguette into 1/2-inch pieces, brush with olive oil, and toast in the oven for 10 minutes.
Trim and blanch asparagus in boiling water for 2 minutes; remove and chop into 1-inch pieces.
Blanch peas for 1 minute; drain.
In a bowl, mix ricotta with lemon zest, a squeeze of lemon juice, salt, and pepper.
Spread ricotta mixture on toasted baguette slices, top with asparagus and peas, drizzle with olive oil, and serve.
Time: 15 minutes
Main Course: Pasta Primavera with Seasonal Vegetables
Ingredients:
8 oz pasta
1 zucchini, sliced
1 yellow squash, sliced
1 red bell pepper, sliced
1 small red onion, sliced
1 cup peas
1 bunch asparagus, chopped
1/4 cup olive oil
2 cloves garlic, minced
1/4 cup chopped fresh basil
Salt, pepper, and grated Parmesan to taste
Preparation:
Cook pasta according to package instructions; reserve 1/2 cup pasta water.
In a large skillet, heat olive oil over medium heat. Sauté garlic and red onion for 2 minutes.
Add zucchini, yellow squash, bell pepper, asparagus, and peas; cook until tender (about 5-7 minutes).
Add cooked pasta to the skillet with reserved pasta water; toss to combine.
Stir in fresh basil, season with salt and pepper, and top with grated Parmesan before serving.
Time: 20 minutes
Dessert: Strawberry & Rhubarb Crumble with Vanilla Yogurt
Ingredients:
1 pint strawberries, hulled and halved
2 stalks rhubarb, chopped
1/4 cup brown sugar
1/2 cup rolled oats
1/4 cup flour
2 tbsp butter
1 cup plain Greek yogurt
1 tsp vanilla extract
Honey to taste
Preparation
Preheat oven to 375°F (190°C).
In a bowl, mix strawberries, rhubarb, and half the brown sugar; place in a baking dish.
In another bowl, combine oats, flour, remaining brown sugar, and butter; mix until crumbly.
Sprinkle oat mixture over fruit and bake for 20 minutes until golden and bubbly.
In a small bowl, mix Greek yogurt with vanilla extract and honey to taste.
Serve warm crumble with a dollop of vanilla yogurt.
Time: 25 minutes
Total Cooking Time: Approximately 45 minutes
Enjoy your delightful spring vegetarian dinner!
Byte-Sized Intelligence is a personal newsletter created for educational and informational purposes only. The content reflects the personal views of the author and does not represent the opinions of any employer or affiliated organization. This publication does not offer financial, investment, legal, or professional advice. Any references to tools, technologies, or companies are for illustrative purposes only and do not constitute endorsements. Readers should independently verify any information before acting on it. All AI-generated content or tool usage should be approached critically. Always apply human judgment and discretion when using or interpreting AI outputs.