Episode Description

In today’s episode, I’m thrilled to chat with Dr. Alaina Szlachta, an expert in educational research and data-driven decision-making. Dr. Szlachta shares her transformative approach to education, emphasizing the power of good data in shaping effective corporate learning strategies. We dive into how leaders can make better decisions by leveraging robust data and the pitfalls of relying on outdated measurement models. Interested in discovering how to enhance your leadership skills and improve your organization’s learning outcomes? Tune in!

Learn more at: https://dralainaszlachta.com/

Keep in touch on LinkedIn: https://www.linkedin.com/in/drszlachta/

---

Want more tips on effective training? Sign-up for our weekly newsletter: https://www.bettereverydaystudios.com/newsletter

Visit us at https://www.bettereverydaystudios.com

🤖 Automated Transcription

Dr. Alaina Szlachta [00:00:00]:
If we don't have a clear strategy at that high level of like, well, what are we really trying to do here? And how is this program going to solve the problem that it was introduced to us in the first place? Well, what is that problem? Do we know enough about the problem to make sure that we're doing the right solution? And then how does that problem get solved? Through training and people development, and then what becomes possible for people in the organization longer term and shorter terminal when these programs are implemented? So that's a strategy. We are missing strategy in our thinking. We're missing that critical thinking first step of, well, wait a minute. Before I jump into any model or assume that ROI or the Kirkpatrick or Brinkerhoff or whatever you love is the right one at all times, let's just take a step back and go, what are we doing and why? And make a hypothesis.

Matt Gjertsen [00:00:52]:
Whenever I start talking with clients, or even potential clients, one of the first things that they ask me is, how are we going to measure this? You know, manager development, leadership development. It's one of those things that can be notoriously hard to identify whether or not you're moving the needle and having an impact with any given training, intervention. So that's why I'm really excited for this week's guest on the leadership launchpad, Alaina Schlatka. Alaina has been a friend of mine for a couple of years now. She's actually been on the podcast once before, but she has a new book out, and so we wanted to have her back on. Alaina's background is on the science of measurement and how you can use data to make better decisions. In this discussion, we talk about our shared love for the book, the one thing, and what she learned working at the organization that inspired that book, Keller Williams. Then we dive into some simple ways to think about data and measurement to give you tips on how you can start gathering data to make better decisions.

Matt Gjertsen [00:01:54]:
A lot of this discussion is very learning and development focused, but even if you aren't in L&D, there are a lot of great lessons here, because Alaina's approach to measurement and evaluation is really universal. Before we get into the discussion, I do want to remind you that if you're not subscribed, make sure you subscribe so you never miss a future episode. And if you are already subscribed, then I humbly ask you that you share this show with at least one other person, because that, after all, is really how we grow, and I can't tell you how much it means to me. So with that let's get into the discussion with Alaina Schlatka. Alaina, welcome to the leadership launchpad. How are you doing today?

Dr. Alaina Szlachta [00:02:35]:
I'm doing fabulous. I love having conversations with you. This is our second official podcast conversation. I couldn't be more thrilled to be having this with you today.

Matt Gjertsen [00:02:45]:
Yeah, I'm really excited. Yeah, you were on. We had one conversation pretty early on. Yeah. We've known each other for a couple years now, so it's exciting. It's interesting, though, the last time we met. So we met up in person just a couple weeks ago as this recording. And while you were presenting, I learned that we have a shared love of the book.

Matt Gjertsen [00:03:05]:
The one thing. What is that book, and why do you like it?

Dr. Alaina Szlachta [00:03:10]:
Okay, so I plug the one thing all the time. In fact, I use it in some of my own approach to measurement, which I know we'll talk about shortly. But the one thing, it has this concept that I think about in my personal life as a business owner, as a measurement professional, what's the one thing? I think about it in the domino effect, and in the book, they have, I think even the front cover has this, like, series of cartoonish, really well done graphics of, like, knocking dominoes over. So, like, if there was one domino we could knock over, that would make everything else easier or no longer necessary. What is that domino? And I think that way of thinking is so smart, and it applies to everything we could do, and I use it all the time. So I, you know, in that conference presentation, at core four, I talked about that in my workshop about, what's that domino for us? And I use it in different contexts. And, of course, in that session, it was, if measurement is so difficult, what's the one thing that we could do that domino we could knock over that makes measurement easier and eliminates the things that make it hard. So that's how I talked about that in our conference context.

Matt Gjertsen [00:04:29]:
Yeah, you're right, though, that it does apply to so many contexts for managers and business owners and in everything. And I do think recently I heard an interesting take on it where it was kind of like, if you don't know your one thing, then your one thing is figuring out your one thing. You know, it's like, it's really that important because it's just so easy to get so distracted with all these different things to do, especially if you're the one in charge and you're the one who's supposed to be kind of setting those priorities. You, even though you worked for a little bit at Keller Williams, which is kind of where the book comes from. I don't know what not kind of.

Dr. Alaina Szlachta [00:05:09]:
It is. It is exactly where the book comes from.

Matt Gjertsen [00:05:12]:
Yeah, yeah, yeah. So what was your experience like there? And was there anything that you learned or kind of took away from that time?

Dr. Alaina Szlachta [00:05:18]:
Yeah. So there's two things that I learned at Keller Williams, one good and one not so good. And there's another thing about Keller Williams I think is very well known that makes them what they are today. And I'd love to share that as a way of launching into our measurement conversation the two things about them that I learned during my time. One, I'll start with the good thing. One, I learned so much about being a smart real estate investor. So I had the privilege of overseeing all the curriculum development and part of the approach that many L&D professionals use. But Shirley Keller Williams team members, we leaned heavily on our expert, very successful real estate agents as subject matter experts.

Dr. Alaina Szlachta [00:06:04]:
So I got to interview some of the best of the best real estate investors of the last 20 years who sort of grew up and became successful inside of the Keller Williams ecosystem. And so I got to work with them, learn from them, build curriculum, be in the room while curriculum and programming was being facilitated, iterate on those programs. And so how could I not walk away with so much incredible knowledge? And before I worked for Keller Williams, I'd already been in the real estate investing mindset. So I bought my second investment property, made plans for more, and just got smarter as an investor. And I can tell you, Matt, that fast forward, it was those investments and knowledge that equipped me to start my own business and jump into the entrepreneurship journey. And without that background, I wouldn't be where I am today. So I have Keller Williams to really thank for that.

Matt Gjertsen [00:07:02]:
So the power, you know, I think it just shows the power of kind of combining the subject matter experts with some good support of instructional design to, like, craft really good curriculums, to really bring deep knowledge to people who otherwise wouldn't get it. That's neat.

Dr. Alaina Szlachta [00:07:19]:
Yeah. Yeah. And one of the benefits that I always enjoy being in the L&D sector, because, and, you know, when we work with our own clients, we get to work with the best of the best who are wanting to give back their knowledge and expertise and working alongside them just makes us better and smarter. And I love that about our work. So the second thing, which everyone's like, well, what's the bad one? So the second thing I took away from Keller Williams, and that really opened my eyes to what I now know as a pervasive problem in corporate learning. And that is, here's the example at the time. Now that CEO is no longer at Keller Williams, but at the time I was working there, the CEO was adamant that the metric of success for our L&D programming was, Drumroll. The NP's score.

Matt Gjertsen [00:08:16]:
Yes. And being all about learner satisfaction.

Dr. Alaina Szlachta [00:08:22]:
Yes, and. But, yeah, being who I am, I am an educational researcher, a doctor in education who has worked in many other sectors where measurement was such an important, critical part of our work because we were grant funded or because we were doing public health and the public deserved to have curriculum and education that actually made a difference. And so coming from a world not only of research and education, but also of rigorous measurement in other sectors, from my boss to say, our metric of success is an NP's score, I said, you're kidding, like, you gotta be kidding me. And my boss, like, was straight faced, like, how could I push back against that? And I said, well, where does that directive come from? Because that's like one of the least useful metrics of all the things we could be measuring in terms of the effectiveness of our programs. And my boss said, it comes from the CEO and he's not willing to budge. And I said, but can't we measure other things? And they're like, yeah, well, but we're not going to give you any resources to do anything like that. So there I was, stuck in what we know as level one reaction metrics that aren't going to help us improve the programs or nor are they going to help us tell any kind of story of actual behavior change and impact, because that's just not how that works. But what I was introduced to at that time was something I had never been introduced to before.

Dr. Alaina Szlachta [00:09:55]:
And it was the perception that comes from some senior leaders in organizations of what learning is and how we should measure it. What's the value of learning and how we then track and monitor that value. And I hate to say it, but at that time, Keller Williams had it wrong. And I think we could have been doing something so much greater than we could have now. That was so many years ago, and I only know that it would probably be better. Different leadership, different directives. I'm sure that the team is experiencing something completely different than what I experienced. But my takeaway was that the perception and the directives of senior stakeholders are often the thing that determines our measures of success, rightly or wrongly.

Dr. Alaina Szlachta [00:10:49]:
And we can be stuck in boxes that we can't easily move out of, even though we know we can do better. And should be doing better and different things. We don't because we don't have the partnership and support of senior leaders. And so that was the very first time in my career I had experienced that in every other place that I had been. I was the person who guided our measurement approach and helped us to incrementally improve all the time. And not having that power really, or authority or even respect to question and make suggestions was a real wake up call for me. And turns out a lot of people in our industry feel that every single day.

Matt Gjertsen [00:11:34]:
Absolutely. And I mean, I always say that I think a lot of it stems from the fact that the common denominator that everyone has experienced regarding, quote unquote, training is formal education. And they just, like, interposed, they just transpose the two as one and the same. And so since everybody's experienced that, that's kind of where the expectation sits. And there's just not, you know, in most education, at least early education, there's, I mean, there's, there's now like lots of data, but it's, it's like, it's pretty high level. It's pretty far away from like any kind of like tactical impacts on, you know, because you're not going to see a direct impact from primary education, like on, like, is somebody going to get this job versus that job or be more effective this way and that way? Because that's not what you're worried about in, in primary education or even in like a liberal arts education. That's not really what you're worried about. You're worried about other things.

Matt Gjertsen [00:12:25]:
And so when you take that idea into the corporate setting, it just leaves people at a pretty big disadvantage in terms of what they're thinking this is all about, I think. Did you have one more thing or was that kind of the lead in? Because I think it leads in really well to this idea of, we had briefly talked about before of kind of definitions around some of this stuff, measurement data, and how it sounds like there's a lot of like, kind of legacy beliefs around what this can be in the corporate world that keeps it from really being successful.

Dr. Alaina Szlachta [00:13:01]:
Yeah, well, that wasn't the thing. And there is one more thing that I think is really important to share about Keller Williams, and it does lead us into some definitions. In fact, it gives us an example that makes a definition easier and more intuitive to understand. So in my book that I have coming out, out measurement and evaluation on a shoestring, one of the chapters is devoted to data literacy. And in my career and in all the theories and things I've read and all the thought leadership that I've been exposed to, I believe that the one thing we could do differently as an industry, and that even expands into marketing and customer success, like, I don't believe this is just an L&D thing, that if we developed more data literacy, it would be that domino that would, should we knock that over, everything else becomes easier and the obstacles may be eliminated. And so Keller Williams is an organization. I feature in my chapter on data literacy because I wanted people to have examples of, like, well, what does it mean that an organization is using data and data literate principles in everyday practice? And then, so what? What's the benefit of doing that? Yeah, so, Matt, you mentioned before we hit the record button that one of the stories you'd heard about Keller Williams is some of their success is due to their training. That comes from Gary Keller.

Dr. Alaina Szlachta [00:14:28]:
And yes, that is absolutely true. But what's lesser known is that what has driven Keller Williams success are their data systems and their ways in which they kept data on every single transaction. From the moment their doors opened. Back in the eighties, before, we had really robust computer and technology systems to assist us. And as Keller Williams grew, and so here's the thing that I think is not talked about enough. Oftentimes, as businesses grow and expand, they don't keep an eye on their systems. They let their systems go awry, and then eventually they take a look back and go, oh, crap, we should have probably done that differently. And then they have to invest time, energy, and resources to go fix it.

Dr. Alaina Szlachta [00:15:15]:
Well, Keller Williams, from the moment they opened doors all the way up to today, and all the global franchises they have, they have kept the same system. Now, not the same system in the sense of, like, their technology has evolved, but they have required that every single franchise, all the data on every single agent when they join, how many leads they have, how many doors they've knocked on, all the way to the transactions that they've done, and how much the commission was, every single data point. Plus you can imagine demographic details on the agents has been documented since the days of opening. And that huge amount of data has compounded to become something that allows Keller Williams to be really, really intentional with where they go in the market, who they go after, how they support people, and just being the number one, whether that's an agent count or number of homes sold or the amount of commission or the volume that they do. So they've been number one. And the reason for that is their very intentional use of data and making it such that as they grew, everybody used the same system so that that data could become so powerful as they made choices. Well, now, fast forward, they've got their own CRM. All the data now is harnessed in a way more meaningful way.

Dr. Alaina Szlachta [00:16:44]:
And they're making choices all the time with what markets do they expand into? When do they switch out leadership? How do they support these people? Because everybody's making money on agents closing deals. So how can they be more intentional with doing that? So that's data and data literacy in its finest. It's being aware of the importance of data and what using information and insights can do to help us make smart choices, to take next steps in growth and optimization and fixing problems. And without that kind of robust data, it's very difficult to make some of those decisions in a smart way. Sometimes our decisions are risky. And if we have to make a big risky decision, using good data helps sometimes eliminate the risk or at least reduce the risk of the decision and investments that we make in things of that nature for the business. So, I love Keller Williams for being a role model in what's possible when we think really intentionally about how we use data, and not only how we use it, but, like, the systems we use and why it's important, and getting everybody enrolled and onboarded into, like, why that system is important. So, yeah, I think that is just really brilliant.

Matt Gjertsen [00:18:04]:
Interesting. So how does that clash with what you see in a lot of places where there isn't that same understanding or rigor of what data is or can do for you?

Dr. Alaina Szlachta [00:18:19]:
It's really simple. It's like being blind.

Matt Gjertsen [00:18:24]:
Yeah. Yeah.

Dr. Alaina Szlachta [00:18:27]:
So why I love being.

Matt Gjertsen [00:18:30]:
No, go ahead.

Dr. Alaina Szlachta [00:18:32]:
So why I love being a researcher, and this is how I think of myself. So, my training and my doctorate degree program trained me how to think. I believe any higher education we do teaches us how to think or how to think differently. And for me, I walked away forever changed, and that I will always look at the world with that research, that curiosity, that investigative mindset. And I'm always going to want to look for good evidence and data to help me make choices, because that's what researchers do. And so, with good data, we can see things that we could never see before. And whether we collect data or we just analyze it in a new way, it gives us visibility into really important things. And so without the data, and heaven forbid, sometimes even the data we have isn't the right data or good data.

Dr. Alaina Szlachta [00:19:27]:
And I'm happy to talk about what makes it good. But without that, we can be making bad decisions. We can't back our ideas around. Why should we make these changes? You know, if. Maybe if I had some really good data and presented it to the CEO all those years ago, back to Keller Williams about, hey, here's why. The NP's score isn't the best metric, and if we decided to use these different metrics, what it could do for the business. Maybe if I had approached it that way, things would have looked different. But I was new at the time and didn't feel confident having that conversation with my boss or the CEO.

Dr. Alaina Szlachta [00:20:02]:

But, yeah, data helps us see things that we can't or couldn't see before.

Matt Gjertsen [00:20:08]:

Yeah. Everything you're saying, it really reminds me of Annie Duke. Do you know who Annie Duke is?

Dr. Alaina Szlachta [00:20:15]:

I do not.

Matt Gjertsen [00:20:17]:

She's a professional poker player, but she's also. I forget if she was trained as an economist or what exactly she was trained in, but she has a. One of her books is called thinking in bets, and a lot of it has to do with the importance of data and the idea of, you can't base your decisions purely on the outcome of that one decision. You can make the right decision, but have the wrong outcome, and it's just kind of, you know, it could just be dumb luck. And the example that she uses, that's really common. That's. That's close to my heart is from the, the Super bowl where the Seahawks were playing the Patriots, and it's just like one of the best Super Bowls ever comes down to the wire, the very last play of the game, where they're, the Seahawks are right on the. Right on the line to score a touchdown, and everybody thinks they're going to go to their running back.

Matt Gjertsen [00:21:09]:

Cause he's like one of the best running backs, and just. They're just going to shoot. Shoot it right in, and instead they go for a passing play that gets intercepted and everybody's just like, Pete Carroll, you're the worst football coach ever. Why would you ever do this when, if you look at the data of situations like that, play an interception in that, it's. It's like, there's like a four and a half.

Dr. Alaina Szlachta [00:21:31]:

So unlikely. Yeah.

Matt Gjertsen [00:21:32]:

You know, it's such an unlikely thing to happen. So it was probably the right decision based on the data. It just happened to have the wrong outcome this time. Yeah. And you can never know that unless you have all that data.

Dr. Alaina Szlachta [00:21:47]:

Yeah.

Matt Gjertsen [00:21:47]:

So I love. Thank you for kind of that walkthrough of time, kind of your time in Keller Williams, but then even more importantly, your time before that, and all of your experiences of research, because I think you're right. It's really, it's really data in, especially in the corporate learning world, is very boxed in. And so having that deep background of allows you, I think, that different way to look at it because, you know, the impact that it can have. And I have to believe, you know, that's kind of what led to your formulation of how, you know, measurement and evaluation can work in the learning world. The thing that everybody goes back to is kind of the Kirkpatrick levels, or it's like level 1234. There's some, some very basic metrics. But your system, I think, is a, simpler and b, much more broadly applicable.

Matt Gjertsen [00:22:37]:

I don't think it's just applicable to kind of like a learning sense. Right. I was wondering if you could kind of walk us through your process or your thoughts on that.

Dr. Alaina Szlachta [00:22:47]:

Yeah. So I want to start by saying I don't believe any measurement model, whether it's an L&D specific model, like the Kirkpatrick model, or the ROI methodology, or the LTEM framework, or Brinkerhoff success case method, there's many of them. There's so many more that we don't know. None of those models are wrong. And I'm not going to stand up here and say, you should use this always, forever, because it's the best model. I think every model has its place and its value and the challenge for us. And I think this is human nature coming in a little bit. As humans, we want the easy button.

Matt Gjertsen [00:23:25]:

Yeah.

Dr. Alaina Szlachta [00:23:26]:

And in some way, give me the answer.

Matt Gjertsen [00:23:27]:

Just tell me the right answer.

Dr. Alaina Szlachta [00:23:28]:

Yeah, yeah, yeah. In some ways, it's the human nature of wanting to do what's easier versus what's right. And so to be using one model to evaluate, measure, monitor, tell the story of success for every single one of your learning programs, now, that's wrong, because at one model, and this is my expert opinion, others will disagree with me. And that's okay. We could debate this, and I'm happy to, but I don't believe that there's one model that is appropriate and ultimately useful. Like, we want to use a model to measure and monitor our effectiveness based upon what our goals and context and resources are. And so there's a little bit of a dance that we have to do. Now, there may be one model that works best for your organization almost all the time, but not every time.

Dr. Alaina Szlachta [00:24:25]:

And trying to use the same model in every context, every program, every time, might make things more difficult than they need to be. So for me, before I jump into a model, because I think the problem is the models give us tactics, actions, stepwise strategies. These are things that get us right into action. And that's great, and that's why they're useful. The problem is, if we don't have a clear strategy at that high level of like, well, what are we really trying to do here? And how is this program going to solve the problem that it was introduced to us in the first place? Well, what is that problem? Do we know enough about the problem to make sure that we're doing the right solution? And then how does that problem get solved? Through training and people development, and then what becomes possible for people in the organization longer term and shorter term when these programs are implemented? So that's a strategy. We are missing strategy in our thinking. We're missing that critical thinking first step of, well, wait a minute, before I jump into any model or assume that ROI or the Kirkpatrick or Brinkerhoff or whatever you love is the right one at all times, let's just take a step back and go, what are we doing and why? And make a hypothesis. So being the researcher that I am, I always hypothesize, okay, well, what are we doing here? If people participate in our programs and they complete that? Well, how does that develop them? And what does that look like? And what is that development going to do immediately, in the immediate term, what becomes possible for the organization, for our department, whatever, and then what becomes possible longer term? Because that shorter term thing took place.

Dr. Alaina Szlachta [00:26:11]:

This is a hypothesis that helps narrow us. And I think the benefit of it is we have a lot of scrap learning. There's data out there that says that 70% to 80% of learning is wasted. Time is wasted, money is wasted, and we don't want to do that. Ideally, we are helping the business manage its resources and making smart choices about the length, the focus, and the supports that we do in our programming. So your hypothesis will really help to narrow that down and try to eliminate some of those unnecessary things from the get go, because your hypothesis is what keeps you sort of accountable. The other piece about that is the hypothesis can help you then figure out, well, what data should we be looking to, to, you know, test if our hypothesis is accurate or not? And then you can figure out, well, what model would help me to collect the data, to create assessments or whatever, to then be able to test the hypothesis in time. So I'm a strategic thinker, and I believe we just need more big strategic ideas before we dive into our measurement models that will just make things a lot easier.

Matt Gjertsen [00:27:23]:

There's a lot to unpack there that I really, really like. One, I think just at a. I love how one of the first things that you talk about is the importance of taking into account a lot of other factors, such as the resources that you have. Because oftentimes, you know, we might say, like, okay, like, yes, this would be amazing. But is it really, like, I mean, in my world of, you know, leadership development and really trying, you know, there's lots of big picture changes that we would love to make in an organization based on it. But in some cases, you know, you could, like, write a thesis around trying to prove some of these longer term outcomes. And so to just say, okay, like, that's unrealistic. Let's try to look at something else.

Matt Gjertsen [00:28:12]:

And then I think kind of to your model and kind of how you think about it, if I could use slightly different words, the. What I took away from, and correct me if I'm mishearing this, it's almost like, okay, what are we trying to achieve with this decision? Or what are we trying to achieve with this intervention? What are the leading indicators that that's happening? And what are the lagging indicators that that's happening? And then you can go figure out, okay, how do we measure that stuff? Like, is that kind of. Right, right frame?

Dr. Alaina Szlachta [00:28:42]:

It's actually simpler than that.

Matt Gjertsen [00:28:45]:

Excellent.

Dr. Alaina Szlachta [00:28:45]:

So, um, you know, there are a lot of jargon and terminology like formative assessments versus summative assessments, leading indicators, lagging indicators, and I think, like, cool, but, like, it's actually simpler than that. Let's break it down to just data artifacts. Like, they might be leading indicators, they might be lagging indicators, but the best thing that we can do for ourselves, and I talk about this in my book, too, is, like, once you've got your hypothesis loosely mapped out, there's a lot of people that talk about the chain of evidence between a learning program and longer term outcomes. Once you've got that loosely outlined, the most important question we can ask ourselves is what data artifacts will help us to test, improve our hypothesis, and then to brainstorm all the possible things. Because there's not just going to be one data artifact, there's likely going to be 20. We're limited only by our strategic, creative thinking. And then we ask ourselves, of all these data artifacts, what is the most realistic for us to be utilizing? So, screw leading and lagging indicators, not literally, those are important things to think about, but for those of us who just need to start measuring more and have a little more integrity with our measurement approach, we need to figure out what's the best data for us to be collecting to test that hypothesis. But then what's realistic.

Dr. Alaina Szlachta [00:30:09]:

And here's an example. I don't think we should be writing our own assessments because we are not experts in writing assessments. And if we want good quality data to help us test and prove if growth took place, especially if that growth is in performance, we shouldn't be writing assessments. We should be buying assessments that have been validated and are reliable by companies for whom, like, that's what they do for a living. Like, if you want really good data, we need to take into account what creates good data and poor assessments, thoughtless assessments. Not to say that us in the industry are going to be thoughtless. We'll probably do the best that we can. But we are not experts in writing assessments that are going to give us good data.

Dr. Alaina Szlachta [00:30:56]:

And if that's the primary method in which we are collecting data on knowledge and performance changes, we're going to have so much bias in that that it's not going to be a good indicator if we are moving in the right direction. So that lens of what's realistic but also has the most integrity in some cases, that's where you make smart choices in bringing in external vendors to partner with you to give you some assessments. Other times, like I use chat GPT and Claude, I think performance assessments are super powerful and like, let's be honest, we want to change behavior with most of our programs. So, like, help write good rubrics for evaluating performance using artificial intelligence because it can really help you to, with the right prompts, create rubrics that are actually useful to then have everybody use the same rubric at different times in somebody's learning journey to evaluate their growth and change in that performance. So, you know, that's one thing we can do. But ultimately, what's the data artifact that's the most realistic and has the most integrity, regardless if it's formative, summative, like, what's the most realistic for what we need right now?

Matt Gjertsen [00:32:10]:

Yeah, and thinking back to my time as leading internal teams and companies, like, you know, I'm hearing everything you're saying and just thinking like, man, that just sounds like a lot of work. There's just like we don't have time to do to be that deliberate about things. But then, of course, the answer is just like, well, that means we just need to be doing less, because if we're not doing this, then we're just wasting our time, or we don't know if our time is being used effectively. And so chances are we just need a lot fewer, but more effective learning interventions. And that's really how we change things.

Dr. Alaina Szlachta [00:32:41]:

Yes, that's right. Yeah. A lot less formal. Like, this is, this is really, it goes against so much of our industry, but a lot less formal education and more, like, in the flow of work performance support. And if you're interested in learning more about that, JD Dillon wrote a fantastic book called the modern learning ecosystem that I think outlines a really good plan for what is the ideal proportion of formal learning, performance support, job aids, etcetera. And I think it works. And he knows it works because he's been living and breathing it for his whole career. I think our whole industry would be better served following that model.

Matt Gjertsen [00:33:18]:

I love it. Well, as we close, one thing I'd love to kind of finish with is given your background and everything that you know about data and, and research and using it to make decisions. If there was one piece of advice, I'm kind of throwing this at you out of left field. If there was one piece of advice, you had to help all people, whether they're leaders. Learning, learning, folks make more data based decisions. What would that piece of advice be?

Dr. Alaina Szlachta [00:33:50]:

Start in an environment that's a little bit low stakes, because the truth of the matter is, no matter if it's working with data or if it's baking biscuits for the first time, because I don't cook and baking biscuits is intimidating to me, or driving a car, you're new to driving whatever it is, doing new things is always intimidating. So I would say, probably don't start testing data and data driven decision making in a high stakes thing where your job depends on it. Do it in a space where you can learn, make mistakes, and if you do make mistakes, you can learn from them. But there's no, like, big, risky outcome. And so I would say, and I say this as many times and as many places as people will accept me saying it, because I think we need to hear it. Find areas in your personal life where you can practice using data to make smarter choices for things that matter to you, because imagine you're the CEO of your own life. So what are some things that are important, important decisions for you to make in your own life? And you want to use good evidence, trustworthy data to make the right choice. That could be, what car do I purchase next? That could be how do I figure out how to save $1,000 a month to buy a new house? That could be a lot of things.

Dr. Alaina Szlachta [00:35:09]:

Do we have another child, right? So what are some of those big, important decisions in your life that you have to make and you want to make them smartly? And how do we think about good data, sources of data, unbiased data, to help us make those wise choices? And then you'll learn, because you're not going to get it right. And then only after we made a choice, this everyone's head who's listening, like, yes, I can see myself that that's happened. I make a choice and I'm like, oh, if only I could have remembered or I would have thought of doing this now. You'll do it differently next time. So pick a low stakes environment, most likely in your personal life, where it matters to you, some decision. It's important, it's big, and you want to use data. And then we go through that data literacy lens, which is what data do I need? Where do I get it? How do I make sure it's trustworthy? How do I then look for insights from that data? What do the insights tell me? What choice am I going to make? Make the choice and then look back, go, how would I change my sources of data based upon the outcome of that results, et cetera, et cetera.

Matt Gjertsen [00:36:23]:

I love it, finding ways to exercise that muscle, because it's not just going to happen right away. That's great advice. Awesome. Well, Alaina, it's always great talking to you. There's so much great stuff in here, I think just that people can use in all aspects of their life. As we finished. So as always, really appreciate your time. Thank you so much for being here today.

Matt Gjertsen [00:36:45]:

And I look forward to the next time we can chat.

Dr. Alaina Szlachta [00:36:48]:

Yeah, well, and if folks are interested in following more insights, methodologies, thought leadership, or just thinking differently about measurement, there's two places that you can go for that. One is more hands on. We have a Monday meetup. It's at twelve Eastern. It's free. It's for any nerd who wants to geek out and improve their measurement and experience and thinking, working with data. And then I have a newsletter. It's more of an e publication.

Dr. Alaina Szlachta [00:37:16]:

It comes out every weekend for people just to think differently and invite inspiration around working with data and measurement. And that is on substack. You can get both of those things at dralaina.com/mme for measurement made easy.

Matt Gjertsen [00:37:34]:

Excellent. And we'll link to that in the show notes. And then, of course, I almost forgot to when does your book come out? What's the date again?

Dr. Alaina Szlachta [00:37:40]:

Not often or not soon enough. No, it comes out November 26, which is I don't know if it's good or bad. It's the week of thanksgiving, so maybe everybody is going to be hungry and tired and just want to kick their feet up and read a new book. So that could be great or everybody will forget about it because they're having too much fun with their families. So we shall see. But nonetheless, November 26 is the release.

Matt Gjertsen [00:38:02]:

Date and it's just in time to get on everybody's Christmas list.

Dr. Alaina Szlachta [00:38:06]:

So I do think that's one of the bonus pieces about that. Yeah, exactly.

Matt Gjertsen [00:38:13]:

Awesome. Well, great chatting with you. Have a great rest of your day.

Dr. Alaina Szlachta [00:38:17]:

You too.

Matt Gjertsen [00:38:19]:

Thank you so much for listening to today's show. If you are looking for help turning your organization's great engineers into great managers, me and my team at better, everyday studio studios would love to help. We deliver targeted and interactive training workshops that are designed to help build the three fundamental skills of any new manager, building trust, giving feedback, and setting goals. Reach out to me through Matt ettereverydaystudios.com so we can start making your organization better every day.

Subscribe to listen to your favorite episodes!

Listen on

Spotify

Listen on

YouTube

You may be interested in