From A to B

A/B testing tools - all they do is randomize traffic. So why are we spending thousands of dollars for it? Jonas "Elvis" Alves (of AB Smartly) joined the pod to discuss some of the major challenges in building A/B testing tools. It kinda started in a way I had no idea it would - that you're not buying a testing tool, but buying a... trust platform? Jonas throws some shade at other testing tools, but I bleep it out, don't worry ;) . (And thankfully, he doesn't sales pitch at all. )We got into:- Jonas makes the case for BOTH building in-house and buying an external tool- How to earn back trust once it's broken, through data or experimentation- Booking.com ran A/B tests on A/B testers (it's super meta and super cool)Go follow Jonas on LinkedIn:⁠https://www.linkedin.com/in/jonasalves/Also go follow Shiva Manjunath on LinkedIn:⁠⁠⁠https://www.linkedin.com/in/shiva-manjunath/⁠⁠⁠Subscribe to our newsletter for more memes, clips, and awesome content!⁠⁠https://fromatob.beehiiv.com/

Is 'ethics' something we've undervaluing when it comes to experimentation? Should we actually care about this nerd stuff of 'ethics'?!Well, yes. Obviously. AJ "Does No Wrong" Long joined Shiva to chat about this specifically, as someone who works in the fantasy sports realm of things, ethics can be a contentious subject. We got into:- Why "users first" is really the only way to foolproof ethnical experimentation (and low-key, the only great way to run a business long term) - How PrizePicks fosters 'responsibility' in fantasy sports (really cool things they're doing there)- How to set (and enforce) guardrails in programs. Which is stupidly important in experimentation, when people want to break it down and hack it as much as possibleGo follow AJ on LinkedIn:⁠https://www.linkedin.com/in/angusjlong/Also go follow Shiva Manjunath on LinkedIn:⁠⁠⁠https://www.linkedin.com/in/shiva-manjunath/⁠⁠⁠Subscribe to our newsletter for more memes, clips, and awesome content!⁠⁠https://fromatob.beehiiv.com/

Emotion in data analysis, from what we've been told, should never happen. But the kicker - humans are humans. We use emotions in literally everything we do. So how do we channel it best to make sure we are positively impacting the business?Gerda "The koala" Thomas joined Shiva to chat about this topic. Where does it make sense to channel emotion? In getting EXCITEMENT about testing, and ideas! But maybe we park it when actually analyzing tests, because that can lead to bad analysis. We got into:- The good (and bad) about data. Because sometimes a hyper-fixation on certain data leads to dark patterns and bad UX- Emotion can actually be GOOD in building a culture of experimentation (well, some emotions....sometimes)- Is 'hiring culture' really THAT important to getting people involved in data? (yes....yes it is)Go follow Gerda on LinkedIn:⁠https://www.linkedin.com/in/gerdathomas/Go check out her company, Koalatative:https://koalatative.com/Also go follow Shiva Manjunath on LinkedIn:⁠⁠⁠https://www.linkedin.com/in/shiva-manjunath/⁠⁠⁠Subscribe to our newsletter for more memes, clips, and awesome content!⁠⁠https://fromatob.beehiiv.com/

Slobodan Manić and Shiva Manjunath join another episode of #CRO after dark to discuss their trends in 2026, what will die, what will live, and how Better Call Saul is definitely better than Breaking BadGo check out his second best podcast No Hacks (https://www.nohackspod.com/)

Don't know what the hell CRO and experimentation is? Trying to understand the basic concepts and process? We gotchu. Rommil "The Thrill" Santiago and Shiva Manjunath went into all the common topics, and we can even help you explain this to others who might not fully understand what you do in CRO. Please passive aggressively share this episode to people who don't understand CRO. I will fall on my sword for you. We got into:- Why CRO is seen as a Hail Mary (and why it SHOULDN'T be....)- CROs shouldn't exist. Because everyone should be doing CRO in some way- What the hell MDE really even is? And do you even need it? (Yes....yes you do)Go follow Rommil on LinkedIn:⁠https://www.linkedin.com/in/rommil/Go check out his book:https://www.experimentnation.com/prove-it-or-lose-itSign up for Experiment Nation (I'm there... he's there too I guess): https://www.experimentnation.com/Also go follow Shiva Manjunath on LinkedIn:⁠⁠⁠https://www.linkedin.com/in/shiva-manjunath/⁠⁠⁠Subscribe to our newsletter for more memes, clips, and awesome content!⁠⁠https://fromatob.beehiiv.com/