Audience Testing in Theory
📈

Audience Testing in Theory

Let's talk about audience targeting and testing. This is more of a theory thing, so we'll power through this.

As we know from our little previous discussion, testing is always happening. And so, we need to have a process to deal with that necessity.

What is Audience Testing?

So let's talk about audience testing first.

So for audience targeting and testing, we have a couple of basics.

So first and foremost, we have a few buckets of top-of-funnel audiences that we can play with.

We don't test middle funnel audiences.

We don't really test bottom-funnel audiences. In that sense, we try cold traffic. The top, middle, and bottom funnel audiences are almost exceptionally well defined. And I would say 90 to 95% of cases. There are minimal variations. Whenever I'm saying audience testing, it always means top funnel.

So if there are a few buckets of top-of-funnel audiences we can play with.

  • We can talk about lookalike audiences.
  • We can talk about interests, AKA detailed targeting.
  • We can also speak about broad targeting
  • then talk about different countries and regions, which, in theory, will be different audiences.

So here's the thing.

And this is just from a lot of ad spend working with many other accounts, niches, etcetera.

Audience testing is pretty much anything but common sense.

In theory, a 1% lookalike of purchasers will be the best possible audience you would ever test in practice.

It's pretty much rarely the case.

What would end up happening instead is that it might do well in some accounts and other audiences do better in different accounts.

So it's just kind of the way it is.

If it knows that wasn't the case, then there would be no such thing as audience testing.

And right now, you'd be lying on a beach because we would know the best audience, and there would be no need for audience testing, which would be awesome.

We haven't solved that problem just yet.

One important thing to remember about why this is the case is that Facebook will often use creative and account data to target just as much as the audience definition we provide Facebook.

So that's why no targeting audiences can work well at scale MIS parenthesis there at the end, but that's why at high scaled accounts, 5k 10 K plus per day, usually just using no targeting and only just using ages, for example, can work well.

So Facebook does not just target based on our audience definition. It will do that, but then it will further subset based on that, based on the creatives, the copy, the video image, the account history, etcetera, etcetera.

So more targeted slash and more narrowed is not always better. Typically, the Facebook algorithm will like bigger, broader audiences, audiences with many people in it, 10, 15, 20 million people plus now. That doesn't always align with what we want to be doing. Sometimes our total market size might only be 500,000 or a million. The problem is that the more we try to restrict, the more we try to narrow down, and the more we try to have a targeted audience; Facebook hates that, and they drive the CPM up and charge us a lot more to do that.

And often, the economics of it don't factor out. So typically, more target is not always better for you in theory. What you want to do is keep everything wide and broad there, of course, is a nice balance to strike, which we're going to talk about. But in most cases, more like lasered in a smaller audience is not always better. It's just going to be more expensive. A quick little rule is that all potential audience sizes should be above a million for the top of the funnel to be scaled into again. You know, are there edge cases for this? Yeah, sure. So if you're, you know, if you're watching this and you're saying, and you're saying yourself, okay, but there are only 250,000 people in my audience, or there are only a million people in my audience is total.

So how will I do a bunch of these different tests completely get it? Don't worry about it. What you want to do is you won't have large audiences, and then again, your creative copy, etcetera, will do most of the work there. Okay. So let's talk about, look likes in general high level, I, this, I don't want to get too, too far into the weeds of how Facebook does this, but because it doesn't matter, to be honest with you. It does, to an extent, but more so, it's just, how do we use this rather than how are the deep intricacies of this working? So what happens is Facebook will take a seed audience that we give it, whether it's a customer list, an email list, or pixel data, but Facebook will take this audience.

And we upload that to Facebook and say, Hey, Facebook, find us a bunch of other people who are most similar to this group of people I gave you. That's a look at its base form. 1% look like purchasers is often again the best audience in theory. Still, it is almost never the best audience in practice after multiple, multiple, millions of dollars in testing. Okay. And so, again, it, it's one of those things where even though I know that this is the case that we always want to incorporate some at least, 1% look like of purchaser testing, it is often a good audience, but it's usually not the best, even though it should be. So don't sleep on lookalikes of leads, ads to cart, video viewers, site visitors, page engages, et cetera, et cetera. Again, if you ever start to run out of ideas for look-like ideas, just check out our custom audience list.

So like that massive document that we have with a bunch of different custom audiences and different look likes that you can create from those. So, in general, with a lookalike, you want to start at 1%, and if you find gold within one of those audience tests, then you would continue testing with higher percentages. So if 1% lookalike Add to Cart does well, your next audience test could be 1% to 2% lookalike ads. You can also play with date ranges here. So a lookalike created from the purchasers of the past 14 days can be way different than all-time customers. And why is that? While longer date ranges will take into account holidays, sales events, etc. And we may or may not want this. So, for example, imagine that you had an offer where you were selling your product, which is typically priced at $20, but you were selling it for $1 for two weeks straight. Most likely not happening, but as an example, if you did that, and then you created a lookalike based on the past 14 days of purchasers, you know, raised your prices back to the normal price.

After those 14 days, Facebook will essentially be finding a bunch of people who want to buy a $1 product or another $20 product. So that's where it isn't good. So think about it before you create your day range, typically again, 180 day or all-time customer list, 180 days, 90 days, etc., those are going to be completely fine to do. But again, think about this. So the seed audience of 100 is a minimum. So it needs at least a hundred people in size for Facebook to create a lookalike audience from 500 to a thousand probably is better. So if you do have a hundred, you can try it. But it's going to be 50-50, whether it produces a quality audience or not, okay, following interests in detailed targeting. So this is what I like to think of in three different layers.

So three different orders of interest, and I call this tangential targeting.

So we have first-order interest, second-order interest, and third-order interest.

Let's take an example here.

At a high level, interests are people who have expressed interest in this thing in Facebook's detail targeting section.

It lets us show ads to people who have expressed interest in this thing, whatever it may be. As an example, let's take a higher-end hair care brand.

So the first order of interest is going to be directly related, related to the product. So competitors, in this case, dove and head and shoulders. People who are interested in hair care, people who are interested in shampoo, that's our first order. So highly, directly related to the product. The second order of interest would be things that people are closely tangentially interested in the product.

So skincare, beauty, right? Long hair, beautiful hair, hair, etc., All of these things can, of course, be good, related interests. Now the third-order interests are where things get interesting, which is tangential. So, the framework from this is what else is my perfect customers interested in. Questions can you ask to tease this out? What do they do on weekends? Where do they shop? What stores do they shop at? What do they buy for gifts? What TV shows do they watch? What clothes do they wear? All these things, what they sufficiently large brand are going to have an interest for you to target on Facebook, which is exactly what you want. So, in this case of higher-end hair care, whole foods, right? Whole foods, of course, being a little bit more of an upmarket grocery brand, will probably attract higher quality customers.

Speaker 1: (

07:49

)

People who are interested in it, people have some money to burn apple. So apple, as in the technology comp, a company, apple, yes, birds bees obviously like a little bit higher end higher end lip Balum lotion, I think maybe, but definitely lip balm Lulu lemon. So again, higher, higher end leisure wear ale wear Sam PE Greeno, listen, I'm a complete sucker for sparkling water. So you show me an ad with this as me in the target. I'm gonna be seeing these ADSS all day vegan as an interest again, completely cool there guacamole and yes, seriously, these are, by the way, these are all real interests that we have tested for a higher end hair care brand. And all of these to an extent have actually worked. And some of these have been really, really good. Some of these have actually been in the third order, specifically, some of these have been the best audiences in the entire account for a really long time.

Speaker 1: (

08:35

)

So yes, we did actually try guacamole interest and it did perform up. So you can't really get too, too crazy with this. That's kind of the thing. So other advertisers aren't targeting these, that's why this works. There is not a lot of competition for hair care brands to be targeting guacamole, to be targeting whole foods. Okay. So what else your customers interested in? You can use the suggestions tool to get new ideas for this. And again, once we go into ads manager, I'll show you what that looks like. But you pretty much will never run out of ideas. And again, just a caveat here, remember to keep the potential reach above 1 million for your interests. And if you can't do that, just combine a couple of them to get above a million. All right. Last kind of subset here of audience targeting is no detail targeting.

Speaker 1: (

09:11

)

So it's just broad, no detail targeting no lookalikes, that's it? Age, gender, and country, nothing else. When this works, this is pretty much the best audience to scale with you. Pretty much. Don't have to worry that much about audience testing. After from here, you just focus on creative offers, messaging copy, et cetera, which of course is really the stuff that does move in, add account forward. You know, audiences of course are extremely important, but creative and offers way more. And with enough sufficient data, this type of audience, like I said is fantastic. Does it always work? No. you know, typically like accounts will need a, a little bit of data in them. And obviously if you're watching this, you probably already have that. So it's worth a shot. Put it that way cuz when it does work and when the creative and messaging is really good within an ad, then again, I gotta it's money at scale.

Speaker 1: (

09:58

)

Okay. This is why if we go back to this slide, remember Facebook will target based on what's in the ad itself. That's why this broad targeting works. It's not just showing to every person in the us it's being targeted based on your account, history, creative, et cetera. Okay. Again, remember one of the reason why this is good is that it brings down your CPMs in a lot of cases. So it makes things cheaper because Facebook loves these big broad audiences. Okay. So this is really giving Facebook what they want. So in terms of, you know, one of the most common things for audience testing, one of the most common questions is what should I test next? And the answer is that you don't always need to come up with the most outside the box audiences to find a really amazing one. And again, that's not to say that don't be creative.

Speaker 1: (

10:35

)

It's just to say that, Hey listen, you don't always need to reinvent the wheel. Oftentimes what we need to test next is actually right in front of our face. So of course with our third order tangential interest type of targeting, that's where it's gonna be a little bit more off the wall, but you can use the suggestions tool to help you out with that. Okay. but in terms of contextual texting, it's all about taking the account in context at the moment, if lookalike are outperforming interests at a kinda account wide level in testing and in scale, that means that you're probably gonna wanna start testing lookalikes a lot more heavily. If the inverse is true, if interests are performing way better than lookalikes, even better start doing a lot more interest testing. So a lot of it, a lot of it is in context, certain accounts crush it within interest and look likes are just alright, other accounts couldn't function with interest and looklike are pretty much exclusively where it's at.

Speaker 1: (

11:24

)

So it is a little bit dependent and this can change like this changes all the time. So it's always important to be testing a little bit of both. You know, this is the beauty of testing is that it's relatively low stakes in terms of your financial ROI. So there's not a whole lot of downside to it. But what does this actually look like? You know, it's usually easier to go deeper rather than wider. So in terms of a lookalike audience, if you test a 1% looklike of leads in the past 180 days and it does amazing your next few audience tests are a complete no-brainer. So you're gonna test your 1% to 2%. You're 2% to 3%, 3% to 5% cetera. And you can test all of these at once. Or you can test these in sequential order. It's gonna depend on where you're at, right?

Speaker 1: (

11:56

)

It's gonna depend on your testing budget. It's gonna depend on how fast you're trying to scale, how, how fast you're currently scaling. It's gonna depend on how many audiences you already have. Again, this is all contextual, but the easiest thing to do is you take a look like audience that is doing really well in testing and or in scaling. And you just utilize that. The other way to do it is you can do it with percentages on one dimension. You can do it with date ranges on another dimension. So not included here, but you can. So if 1% look like of leads in the past 180 days are doing well. Let's try 1% look like of leads in the past 30 days. Okay. If that does well, then we can do a 1% to 2% there. This is where with lookalikes, you have basically just a multiplier factor.

Speaker 1: (

12:29

)

So you have 1% to 10% of, you know, a specific pixel event. And then you can do date ranges as well. So there're just so, so so many audiences and from an interest slash detailed targeting perspective, if you test whole foods if you test whole foods interest and it does really well then try trader Joe's right next one. So if whole foods is doing really well and Lululemon is doing really well, then what you wanna do in that case is again, go deeper on that. So I, what I really want you to do after this is actually think about your audience testing. Once something is doing well, you know, use the data that you're paying for, right? Obviously you're making a return on your testing in most cases, but use the data that you're paying for to actually inform your next decision.

Speaker 1: (

13:05

)

So don't just be mindlessly copy, pasting and duplicating and et cetera, et cetera, with an manager, that's not the way to do it. What you really wanna do is use your brain and you really want to use the data that you have available to inform your next testing decision. Okay. So that's the takeaway there. Remember audience performance does not always make logical sense nor does it have to. We don't really care to be honest with you. We do, to an extent we don't really care why something works as much as that it works. Obviously it's important to inform your next move. Like, you know, what should you do? But at the end of the day, we need to get working first. Okay. The second thing is a little bit more of like a fear slash objection that some people have around audience testing.

Speaker 1: (

13:42

)

And I get it because this is like the illogical part of it. So it's really difficult to have a bad audience test unless there's something that is just so far against the grain of common sense and it just doesn't make any sense at all. So, you know, unless something super ridiculous, like advertising meat to vegans or, you know what I mean, advertising a geez, I don't know, advertising a supplement meant for 60 plus women to 18 to 24 men. You know, other than that, there's not really a worry that you should have of, oh, should I test this? Or shouldn't I test this? We love to be surprised with audience testing. There's nothing where I love than testing on a really weird interest. And it does better than a look like that to me is so cool. So always try to kind of strive for that strive to strive, to basically like beat your audience testing with something even crazier.

Speaker 1: (

14:23

)

And remember from our previous discussion about testing in general, if you're not breaking even or losing money on certain tests, you are not testing enough outside the box audiences. Remember you wanna be seeing a nice variance in your testing data. You wanna be seeing some stuff that is doing horribly and then some stuff that is doing really, really well. The losses are going to be extremely minimal on the ones that are doing horribly. Whereas the gains on the ones that are doing really well over the next, you know, 1, 2, 3, 4, 5, 6 months that you run, those audiences are going to more than outweigh those losses. All right. So

Speaker 2: (

14:50

)

You do wanna be losing if you're not losing, then you're not testing enough crazy stuff or you have the best offer ever in the world, in which case respect . Okay. And so the caveat here is that don't get stuck in the comfort of button pushing with audience testing, audience testing is extremely easy to do. And oftentimes audience testing is kinda like the, the busy thing basically think about it. Like email. It feels really good when you clear out your email inbox, but what did you really do? You know, you just archived or deleted a bunch of emails. It's not really productive. You didn't make anything that is going to be useful in the future. It's not really an asset. It's just a little thing that gives you a dopamine hit. And then you're off to the next thing. That can be what audience testing is for some people.

Speaker 2: (

15:24

)

So this is why you wanna probably batch out your audience testing to two days a week. Like we have talked about previously, you can knock audience tests out in most cases in like, geez, I dunno, probably 15, 20 minutes. They're extremely simple to do, and that is effectively it, in terms of your audience research and audience testing setup, it's gonna be different of course, from your analysis and what you actually do from it. But in terms of setup research, etcetera, that's it, it's actually not that difficult for audience testing. It's relatively simple. I was gonna say something a little bit before this, but I completely forgot. And I think it was when I was talking about it being comfortable with being productive busy. Oh yeah. One last caveat here is again, you know, we talked about this previously, but make sure that you are using your best current creative with your new audience tests. Right. And we're gonna go over that as we dive into another account and actually set some audience tests up, but make sure you're using your best creatives with your audience tests. And that's it. We'll we'll dive into manager here in the next video. See you there and start thinking of some cool audiences.