Semaphore Uncut

Flaky test data is now accessible through the sem-ai API, and this week also brings a skill that uses that data to fix the tests automatically.Flaky test data is now generally available through the API. You can query your flakiest tests programmatically, sorted by number of disruptions, with failure timestamps and logs included. Find it on github.A new sem-ai skill can identify and fix flaky tests end-to-end. The agent pulls the highest-disruption tests, gathers failure context, determines the root cause, and writes a fix. It then verifies the result, first by running tests locally, and if that’s not possible, by spinning up Semaphore test boxes to run the test across multiple machines in parallel. Running the test repeatedly across machines is especially important for flaky tests, since a single passing run isn’t enough to confirm a fix. Benchmarking on a real open source project with Claude Opus on high effort showed a cost of $1 to $1.50 per fix.Four existing skills were improved with additional examples. Agents were occasionally not following skill instructions due to a lack of examples. Adding concrete examples improves adherence and makes sem-ai’s output more consistent across runs.What’s ComingUser and organization management will be added to the API in an upcoming release. The team is also continuing to refine skills and commands based on usage patterns.* Try sem-ai* Try Semaphore Cloud* All product newsTill the next time, Pete Miloravac https://semaphore.io This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com

AI agents can reason, but they don’t actually understand your systems. MCP servers fix that by giving your copilots and assistants structured access to your tools, APIs, and CI/CD data. And the best part is that building one is much simpler than most people expect.In the latest episode of Technical Tips, Tommy walks through how to create a functional MCP server in just a few minutes. He connects it to Semaphore’s API, pulls real project data, and shows how to expose those insights to tools like OpenAI Codex. It’s a straightforward, hands-on demo that finally makes MCP feel practical instead of theoretical.If you’ve been curious about MCP or you’re trying to make your AI tools genuinely useful in day-to-day engineering work, this is the perfect place to start. You’ll see how an MCP server communicates with AI clients, how to wrap a real API into it, how to test everything using the MCP Inspector, and how easily you can turn your CI/CD workflows into a conversational experience.By the end, you’ll understand how surprisingly little code it takes to give your AI agents real operational awareness.Access the full guide on our blog. This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com

In this episode of Technical Tips, Tommy shows you how to run tests across multiple environments without duplicating your CI/CD setup or writing repetitive jobs.He explains how job matrices in Semaphore help you expand test coverage, catch regressions early, and keep your pipelines organized and efficient.You can also check out the blog post Job Matrix: Feature Showcase for a detailed walkthrough with examples in both the Workflow Editor and YAML.Happy building,The Semaphore Team This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com

In this episode of Technical Tips, Tommy walks you through three core principles of automation and CI/CD. These are the foundations that help teams deploy faster, avoid stress, and keep pipelines running smoothly.Learn more: https://semaphore.io/blog/pipelines-explained-principles-ci-cdLike this episode? Be sure to leave a ⭐️⭐️⭐️⭐️⭐️ review on the podcast player of your choice and share it with your friends.🎙️ This podcast is powered by Semaphore! 🚀Show Semaphore Some Love ❤️⭐ Star us on GitHub: https://github.com/semaphoreio/semaphore🚀 Join us on discord: https://discord.com/invite/FBuUrV24NH⬆️ Upvote on Product Hunt: https://www.producthunt.com/products/semaphore-open-source-ci-cdLet’s make open-source CI/CD even better—together! ✨ This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com

In this episode of Technical Tips, we break down GPT-OSS — OpenAI’s open-source LLMs you can run anywhere. From local setup to cloud hosting, fine-tuning, and performance tips — here’s everything you need to get started with GPT-OSS.Like this episode? Be sure to leave a ⭐️⭐️⭐️⭐️⭐️ review on the podcast player of your choice and share it with your friends.🎙️ This podcast is powered by Semaphore! 🚀Show Semaphore Some Love ❤️⭐ Star us on GitHub: https://github.com/semaphoreio/semaphore🚀 Join us on discord: https://discord.com/invite/FBuUrV24NH⬆️ Upvote on Product Hunt: https://www.producthunt.com/products/semaphore-open-source-ci-cdLet’s make open-source CI/CD even better—together! ✨ This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com

In today’s episode of Technical Tips, Semaphore engineer Veljko Maksimovic shares how we’re using ephemeral environments to test open-source projects across multiple clouds. From spinning up short-lived environments with Infrastructure as Code to running cross-cloud acceptance tests — hear how we’re improving test coverage, speeding up feedback loops, and reducing cloud waste.Like this episode? Be sure to leave a ⭐️⭐️⭐️⭐️⭐️ review on the podcast player of your choice and share it with your friends.🎙️ This podcast is powered by Semaphore! 🚀Show Semaphore Some Love ❤️⭐ Star us on GitHub: https://github.com/semaphoreio/semaphore🚀 Join us on discord: https://discord.com/invite/FBuUrV24NH⬆️ Upvote on Product Hunt: https://www.producthunt.com/products/semaphore-open-source-ci-cdLet’s make open-source CI/CD even better—together! ✨ This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com

In this episode of Technical Tips, Semaphore engineer Amir Hasanbašić shares how we’re rebuilding our API from the ground up. From a fragmented system to a unified interface — hear how we tackled legacy challenges, redesigned for scale, and what we learned along the way.If you're into API architecture or scaling big systems, this one’s for you.Like this episode? Be sure to leave a ⭐️⭐️⭐️⭐️⭐️ review on the podcast player of your choice and share it with your friends.🎙️ This podcast is powered by Semaphore! 🚀Show Semaphore Some Love ❤️⭐ Star us on GitHub: https://github.com/semaphoreio/semaphore🚀 Join us on discord: https://discord.com/invite/FBuUrV24NH⬆️ Upvote on Product Hunt: https://www.producthunt.com/products/semaphore-open-source-ci-cdLet’s make open-source CI/CD even better—together! ✨ This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit semaphoreio.substack.com