Metrics Blog

• Measuring AI August 20, 2025
  How Do You Measure AI? | Communications of the ACM Due to my background in software metrics, I’ve been interested about measurement of AI systems for a while. What I found is that there are benchmarks and suites of metrics used for measurement of AI. But…. When GPT-5 was announced, most of the metrics that […]
  Miroslaw Staron
• Software on Demand: from IDEs to Intent August 14, 2025
  OpenAI’s latest keynote put one idea forward: coding is shifting from writing lines to expressing intent. With GPT-5’s push into agentic workflows—and concrete coding gains on benchmarks like SWE-bench Verified—the “software on demand” era is no longer speculative. You describe behavior; an agent plans, scaffolds, implements, runs tests, and iterates. Humans stay in the loop […]
  Miroslaw Staron
• GPT-5 – the best and the greatest? August 11, 2025
  In the last few days, OpenAI announced their newest model. The model seems to be really good. In fact, it is so good that the increase from the previous ones are in only 1% in some cases (from 98% to 99%). This means that we need better benchmarks to show how the models differ. Well, […]
  Miroslaw Staron
• Is Quantum the next big thing for the masses? May 9, 2025
  But what is quantum computing? (Grover’s Algorithm) If you are looking at the quantum computing, and you are a programmer, people start “dumbing-it-down” for you with telling about superpositions and multiple bits in one. Well, not entirely true and this is a misconception. In this video, the author explains how quantum works, based on the […]
  Miroslaw Staron
• Do we need a large model to generate good code? May 2, 2025
  arxiv.org/pdf/2504.07343 Code generation in all forms, from solving problems to test case creation, adversarial testing, fixing security vulnerability, is super-popular in contemporary software engineering. It helps the engineers to be more efficient in their work, and it helps the managers to get more out of the resources at their disposal. However, there is a bit […]
  Miroslaw Staron
• Requirements and AI April 16, 2025
  The last few months took a lot of my energy to transit from administrative duties to more research oriented ones. Although I like blogging a lot, there was simply no time left for that. Well, I did write and there will be a new book coming out soon, so here is a preview of what […]
  Miroslaw Staron
• New kids on the block, or are they? March 18, 2025
  A bit of a different blog post today. I’ve just finished a course that I teach to 2nd year undergraduate students – embedded and real-time software systems. I love to see how my students grow from not knowing anything about C to programming embedded systems with interrupts, serial communication between two Arduinos and using preprocessor […]
  Miroslaw Staron
• Agents, agents, better agents… January 22, 2025
  Image by Aberrant Realities from Pixabay Introducing smolagents: simple agents that write actions in code. In the work with generative AI, there is a constant temptation to let the AI take over and do most of the jobs. There are even ways to do that in software engineering, for example by linking the code generation […]
  Miroslaw Staron
• AI, AI and one more time AI January 15, 2025
  AI has transformed the way we develop software and create new products. It is here to stay and it will just grow bigger. This year, one of the important events is CES where the Nvidia’s CEO shows the latest developments. Well, no surprise that generative AI is the key. Generating frames, worlds, programs, dialogs, agents, […]
  Miroslaw Staron
• Let’s make 2025 an Action Research year! January 8, 2025
  Image by Haeruman from Pixabay Guidelines for Conducting Action Research Studies in Software Engineering Happy 2025! Let’s make it a great year full of fantastic research results and great products. How to achieve that goal? Well, let’s take a look at this paper about guidelines for conducting action research. These guidelines are based on my experiences with working […]
  Miroslaw Staron