Metrics Blog

• The close future of software engineering February 5, 2026
  https://www.arxiv.org/pdf/2601.10220 We’re witnessing a transformative shift in embedded software engineering as generative AI moves from a tool to an active participant in development pipelines. In our recent study, we explored how embedded software teams—especially in safety-critical and resource-constrained domains—are adapting to this change. Unlike conventional programming, embedded systems demand determinism, reliability, and traceability, attributes that […]
  Miroslaw Staron
• What happens if you give a compiler to an LLM… January 29, 2026
  https://www.arxiv.org/abs/2601.12146 Large Language Models (LLMs) are now central to code generation, but they often produce non-compiling or incorrect programs. We investigate how giving an LLM direct access to a real compiler (gcc) transforms it from a passive code writer into an active programming agent. We conduct an extensive experiment on 699 real programming tasks in […]
  Miroslaw Staron
• New year, new book! January 22, 2026
  Link to amazon During the entire 2025, I’ve had a chance to get into details with programming of agents, LLMs, and what have you. Thanks to the fact that my role as pro-dean ended, I’ve been given a lot of time to do it. My family has supported me a lot too. Without them, this […]
  Miroslaw Staron
• Quantum computing, or can we live on Mars? December 19, 2025
  Once in a while I get to read a book that has nothing to do with my field. It’s mostly for enjoyment. Not many know that I was an astronomy freak when I was a kid. Somewhere in the middle of my primary school, I read books about red dwarfs, black holes, distant galaxies, and […]
  Miroslaw Staron
• The thinking machine, or machine that makes machines November 30, 2025
  Artificial Intelligence, and in particular Generative AI, is probably the hottest technology in town. Everybody we know talks about it, everybody we know wants to use it, but almost no one gets it to work on the industrial scale. Well, that is true with a bit of modification. We have the OpenAIs and Anthropics of […]
  Miroslaw Staron
• The Singularity is nearer October 31, 2025
  Image generated by Claude, text written by myself 🙂 https://www.adlibris.com/sv/bok/the-singularity-is-nearer-9780399562761 I’ve had vacation this week, so I managed to read a few books. One of them was the book by Ray Kurzweil about AI. It’s a continuation of the classical book “The Singularity is Near” by the same author. I like both of them…. Now, […]
  Miroslaw Staron
• The AI 2027 Report: A Glimpse into a Superintelligent Future September 8, 2025
  Summary — AI 2027 In April 2025, the nonprofit AI Futures Project, led by former OpenAI researcher Daniel Kokotajlo, released the AI 2027 scenario—a vivid, month‑by‑month forecast of how artificial intelligence might escalate into superhuman capabilities within just a few years. Key Developments Why It Matters The AI 2027 report isn’t a prediction but a provocative, structured “what-if” […]
  Miroslaw Staron
• Software-on-demand – experiments September 4, 2025
  miroslawstaron/screenPong miroslawstaron/screenTerminal I was keen on testing the Software-on-demand hypothesis advocated by OpenAI in their last keynote, but it took me a moment to see how to test it. Then, I realized that I could work with creating screensavers based on my ideas. Not the ones that change images, we don’t need AI for that. […]
  Miroslaw Staron
• Measuring AI August 20, 2025
  How Do You Measure AI? | Communications of the ACM Due to my background in software metrics, I’ve been interested about measurement of AI systems for a while. What I found is that there are benchmarks and suites of metrics used for measurement of AI. But…. When GPT-5 was announced, most of the metrics that […]
  Miroslaw Staron
• Software on Demand: from IDEs to Intent August 14, 2025
  OpenAI’s latest keynote put one idea forward: coding is shifting from writing lines to expressing intent. With GPT-5’s push into agentic workflows—and concrete coding gains on benchmarks like SWE-bench Verified—the “software on demand” era is no longer speculative. You describe behavior; an agent plans, scaffolds, implements, runs tests, and iterates. Humans stay in the loop […]
  Miroslaw Staron